Hundreds of refugees are protesting on Papua New Guinea's Manus Island as efforts intensify to evict the men from the Australian run detention centre.
Opened in 2013, the camp is due to close by November after it was found to be illegal last year, but more than 800 asylum seekers still live there.
The Kurdish journalist Behrouz Boochani said the peaceful protest was against pressure being exerted on the men to settle in PNG.
"We refugees are asking Australia and PNG to stop pressuring us to leave the prison camp and accept settlement in PNG," he said.
Mr Boochani said water and electricity had been cut to the detention centre's Foxtrot compound this week, to force about 100 men to move to the transit centre in nearby Lorengau.
He said three more attacks by Lorengau locals on refugees over the weekend, showed it was not safe for them outside the camp.
"Im sure the Manusian people are supporting this protest because they do not agree with this cruel policy."
Meanwhile, PNG police said more pressure could be applied on refugees today to leave.
Manus Island police commander David Yapu said police withdrew from a standoff at the gate of Foxtrot compound yesterday when refugees declined to depart.
"There was tension. We decided to withdraw. But our men are still there just to assist to move the refugees from the Foxtrot compound to the Mike compound," said Mr Yapu.
"Also those genuine refugees might be moved to the East Lorengau Transit Centre," he said.
Senior inspector Yapu indicated that police would not use force to remove the refugees, but he did not rule out the use of force altogether.
"They must voluntarily move. We will have to assess the situation to see the next course of action to take," he said.
Mr Yapu also revealed that police might know who was behind the weekend's violent attacks.
"We have some information as to the identity and whereabouts (of the perpetrator, but) we have to go through the process, meaning a complaint must be lodged by the victim," he said.
Refugees were encouraged not to go out at night in Lorengau, according to Mr Yapu, which he admitted was especially dangerous for foreigners.