Ed Husic blamed Richard Marles for ousting his shock to the cabinet this week, accusing the deputy prime minister of being a "factual assassin."
Husic said on Sunday that he believed his speech on issues like Gaza was a "factor" for his departure, saying the prime minister should intervene.
"The difficult problem here is that we have exposed our ambitions and the Deputy Prime Minister (who) wields a faction club to reshape the ministry," he told an ABC insider.
“I think when people look at the deputy prime minister, they want to see a politician, not a factional assassin.”
Since the new ministerial group was decided, Hask said in his first public comment that he voluntarily left the front desk.
Under the factional agreement within Labor, rightists in New South Wales sit there and need to make room for members of the left.
The other three senior men from NSW right are Tony Burke, Jason Clare and Chris Bowen.
Hask said he does not want to make a choice through a national vote.
"I made the decision. Ultimately, we have to bring it to a country right-vote. The way it manages is the last minute," he said.
"I don't want my colleagues to vote nationwide. Again, I did it for the sake of stability."
Husseck said Anthony Albanese called him two days after he officially announced the decision on Thursday.
Host David Speyers asked repeatedly whether the Prime Minister thanked Husic for his service, and Husic said it had a "very brief" discussion.
He said Albanes should intervene to save him.
He said: "I won't sit here with false modesty. Of course, when you hear his (Albanes) shaky harassment...the names of those who will keep the minister's attractions, I'm sure I'm not the only minister who wants to be on that list."
“If he (the Albanian) exercised this authority, I don’t think anyone would be bound.”
Mark Dreyfus, also reportedly was dumped from the Albanese cabinet, reportedly young Victorian right-wing MP Sam Rae, who called Mars and factional allies to secure his place.
The Prime Minister also did not intervene to save his position.
Husic was the first Muslim to sit in a cupboard and was sworn in with the Quran.
He has been outspoken in the war in Gaza and was the first member of the government to accuse Israel of “collective punishment.”
He said: “You can’t celebrate diversity and then expect it to sit in the corner.
"I certainly tried to help us introduce horror difficult problems in the October 7 horror movie."
Outside the ministry, Husic may feel free to express his views on the conflict and labor policies associated with it.
"We have seen the Israeli parliament say over the past week or so that it wants to annex Gaza, effectively it is a form of ethnic cleansing," he said in an insider.
“By not providing humanitarian assistance, we have seen people’s hunger.
"It (the Netanyahu government) should be detained. Hunger is a war crime."
Hask said he would stay in Labor and hopes to return to the front desk.
"I have made a contribution and I want to continue to do that," he said.