A factional war risk masked the beginning of Labor’s second term, with senior ministers Mark Dreyfus and Ed Husic risking the risk of being driven out of the cabinet by sources of the fighter party, described as increasingly cruel.

Before the first caucus meeting after Labor's astonishing election victory, MPs allege with Victorian right factions heading to Thursday's Cabinet Attorney General Dump Dreyfus as they were held in the Parliament Building on Friday.

The Guardian Australia was told Dreyfus personally appealed to Prime Minister Anthony Albanese to maintain his position. But he faces the replacement of Victorian backstage and faction convener Sam Rae.

Hawke Congressman Rae worked closely with Deputy Prime Minister Richard Marles.

Dreyfus, who has served as Attorney General since 2022 and held the same position at the end of the Rudd-Gillard administration in 2013, rejected rumors that he was preparing to resign before the federal election.

In addition, supporters of Industry and Science Minister Husic will be kicked out of the cabinet as NSW rightists are overrepresented at the top of the government.

One supporter said it cannot be believed that Labour forced senior Muslims and Jewish MPs to withdraw from office shortly after the election.

"Liberals show what happens if you don't make a tough decision and renew your signature," a Labor source said. "It's ruthless."

Front stands, including Chris Bowen, Tony Burke and Jason Clare, are all from NSW.

Party members said there was no internal cut to the appetite of senior cabinet women this week, although communications minister Michelle Rowland could be transferred to another portfolio.

New South Wales Senator and Assistant Minister Tim Ayres is expected to be promoted and evacuated by former assistant finance director Stephen Jones. Ayres personally approached Albanese, was widely praised among colleagues and was a member of the strong national executives of the ALP.

Former Disability Secretary Bill Shorten, who resigned before the federal election, must also replace him. His portfolio covers the National Disability Insurance Program, and government services may give newly appointed ministers.

The upcoming Tasmanian MP Rebecca White, who is with former state opposition leaders, may appoint the ministry from the left, including Victorians Jess Walsh and Ged Kearney.

Labour MPs and political parties believe that Albany’s decisive election victory means his authority within the party means he can intervene when necessary.

If a deal cannot be reached at a faction meeting Thursday afternoon, then a vote of MPs may be held at a caucus meeting on Friday. It was expected to be a ritual meeting, with the leadership group's photography opportunities and speeches celebrating the party's blow to the coalition.

Labor's factional struggles could reduce blood circulation between the Liberal and the Greens, both of which lost their leaders and faced their own internal negotiations.

Albanis said he expects the new ministry to be sworn in Canberra next Tuesday.

There are 20 cabinet positions and 10 external departments to fill. Once the faction selects a candidate, Albanes assigns the portfolio to a single member of Congress.