City planners and advocates are seeing “accessibility used as a political football.”