Saffron flags are flying in the majority Hindu town of Ayodhya as excited locals prepare to host Indian Prime Minister Narendra Modi for the inauguration of a new multimillion-dollar temple.

But like many of the town’s 500,000 Muslims, 65-year-old Maulana Badshah Khan says he’ll be staying at home.

He fears a repeat of the religious violence that erupted more than 30 years ago, when Hindu nationalists destroyed the Babri Masjid, a 16th century mosque, triggering riots across the country.

On Monday, Modi will officially open the Ram Janmabhoomi Mandir, a lavish temple built on the same site that analysts say is a monument to Hindu nationalist ambition.

Khan says he believes the celebration is a clear sign of how Muslims are becoming marginalized under the leadership of Modi’s Bharatiya Janata Party (BJP).