They live on the fringe, unable to legally work because the country — like Thailand and Indonesia — does not recognise asylum seekers or refugees.
Most scrape by on dirty or dangerous jobs that are shunned by most Malaysians. Most live in squalid shanty-town settlements, cramped low-cost flats or isolated houses where they work on construction sites, restaurants, factories and plantations.
They have no access to free healthcare and state-run schools.
But for many, even living on the margins of Malaysian society is an improvement from what they faced in Myanmar.
"Only my younger brother and one older brother are still alive in Myanmar," said Muhammad Ayub. "The rest have been killed."
He has lived for four years in a small shanty settlement on the outskirts of Kuala Lumpur that includes a small mosque and a school teaching children the Quran.
He works odd jobs when he can get them, and said that if Myanmar ensures the safety of Rohingya. "I will surely go back."
Another Rohingya who has been in Malaysia for six years, Ibrahim Mohamad Hussein, said he worried about the fate of his relatives who are among some 200 people still living in his village in Myanmar.
"They have increased the military presence. No one is allowed in or out," he said. They have "no food, no work. It's hard for them."
Earlier this year, Malaysia started a pilot project to let Rohingya refugees with UNHCR cards work to prevent them from being exploited as cheap labor. But officials said the response was poor, as most Rohingya did not want to leave their communities to work in plantations or factories far away.
Malaysia has been cautious of being swamped by an influx of migrants.
In 2015, boats carrying Rohingya and Bangladeshi refugees were pushed back into international waters by the Malaysian and Thai navies. But Malaysia and Indonesia later took more than 1,600 of the refugees in.
On Monday, Malaysian officials said they were bracing for a possible new influx of Rohingya amid the renewed violence in Myanmar and pledged that anyone arriving by boat would be treated humanely.
New arrivals would be given water, food and medical aid, before being handed over to the Immigration Department, said Malaysia Maritime Enforcement Agency Director-General Zulkifli Abu Bakar.
Only about 250 Rohingya live in Nepal since anti-Muslim riots erupted in Myanmar in 2012, according to the UN refugee agency, which offers them education and medical support.
The refugees live in a ramshackle camp carved out on a slope on the outskirts of the capital, Kathmandu. Their huts of tin, bamboo and plastic sheets are connected by narrow stone steps.
There is also a large communal hut, where children study the Quran each day before school and men gather to discuss the latest news from Myanmar received in phone calls from family.
"Just five days back, I heard my uncle was hacked to death in the village," one refugee, Rofique Aalam, said Sunday. He has been in Nepal for two years.
"Fortunately, I also heard that my father, mother, brother and sister safely made it across to Bangladesh."
Most Rohingya in Nepal work as labourers, masons or plumbers. They do not get paid regularly, and also have trouble with language barriers, they said. But they live in peace, and local businesses and social workers have donated tin sheets and bamboo for them to build their makeshift homes.
"We have not had any problems with the local people or the authorities. They are helpful," Mr Aalam said.
Still, many dream of going back to Myanmar.
"Nobody wants to live in a foreign land far from everything we know," said Mohammad Iyer, who fled four years ago with his five children and wife after he was attacked.
Rohingya in India face an uncertain future, with the Hindu-nationalist government threatening to deport them back to Myanmar.
There are some 40,000 Rohingya living in clusters around the country, including in the northern Jammu region in Kashmir, the capital of New Delhi and the southern city of Hyderabad. But only 16,500 have been registered with the UN refugee agency.
Analysts say prime minister Narendra Modi is walking a tightrope between Bangladesh, an ally now besieged by hundreds of thousands of new Rohingya arrivals, and his Hindu-nationalist power base at home.
Mr Modi made no mention of the Rohingya crisis during a visit last week to Myanmar, but later said through the foreign affairs ministry that India was concerned about the violence and wanted Myanmar to show restraint.
That delayed response followed pointed appeals from Bangladlesh for help.
The Indian government is also facing a backlash over its order last month for states to prepare to deport illegal immigrants, including Rohingya. The Supreme Court is expected to hear the government's arguments for the order at a court hearing on Monday.
Even if Rohingya are allowed to stay in India, their lives are far from secure.
In Jammu, where more than 6,000 Rohingya live in squalid temporary shelters, the city's business community recently announced a campaign to "identify and kill" Rohingya, but then called it off after the government announced its deportation plans.
"They have no right to be in the region," said Rakesh Gupta, president of the Jammu Chamber of Commerce and Industry.
In Hyderabad, another 4,000 Rohingya live in constant fear of being evicted from their makeshift shelters of tarp stretched across bamboo poles and sent back to Myanmar.
"The talk of government sending us back is very frightening," said Rohingya refugee Hameed-ul-haque.
"I want to tell the government: Instead of sending us back to Myanmar to die, please kill us. At least we will get a proper burial here."
Hyderabad's Muslim population and some of its leaders have rallied to their cause and demanded they be allowed to stay. Aid groups are helping the new arrivals to secure identity cards from the UNHCR, a process which takes about three months.
"There is no question of sending the refugees back without ensuring their safety," Telangana state's deputy chief minister Mohammed Mahmood Ali said at a rally in Hyderabad. "This is not an issue of Muslims alone. This is a humanitarian problem."
The Rohingya who have made it as refugees to the United States find a warmer welcome and a more stable life.
Only 54 arrived in 2010 and were resettled. By 2016, that number reached 2,276, according to the State Department, though so far this year it was just 1,027.
Hitay Lwin Oo, a Rohingya man who arrived in 2004, helps others as they come in to Utica, New York, where he owns the Golden Burma grocery store. While Rohingya can be ostracised by other groups in their home country, Mr Lwin Oo said people from the many different tribes of Myanmar get along once they immigrate to the US.
"They are happy here, they have no danger in their lives, no more trouble," he said. His own son is a Marine, his eldest daughter is studying to be a nurse, and his other two daughters are still in school.
Beyond the headlines podcast:
Starting from scratch can be hard, but nonprofit agencies help families get apartments to rent. They usually can find minimum-wage jobs cleaning offices, cutting grass at golf courses, manufacturing windows or doing other work. Their children start school, and quickly learn English.
"Arrivals in the United States have a much, much better situation than any other part of the world," Penn State professor Wakar Uddin, a Rohingya advocate who arrived decades ago as a student.
"These people have suffered so much in their life ... they have never dreamed of this kind of life," he said, noting that those resettled in Springfield, Colorado, are happy to work physically challenging 12-hour shifts in meat factories, earning low wages. "They worked much harder in their country and didn't even have one meal a day."
In total, the U.S. has resettled 7,362 Rohingya since 2010, with the largest group of about 1,000 in Chicago and others are in California, Indiana, Georgia and other states.
Simon Billenness at the nonprofit International Campaign for the Rohingya said he wished the US would take in more.
"You're talking about a group of people who are being ethnically cleansed, pushed out of their homes and villages and put into what can only be called concentration camps" in Myanmar, Billenness said.
Even if the new arrivals struggle and need help, "they're glad to be in a safe place," said human rights advocate Adem Carroll at the Burma Task Force USA.
"Their kids become Americanized so quickly," he said. "The parents try to spare their children and not tell them a lot about what they went through."