What would i do?
I always will look carefully to assess the pmd rider. Many of them are barbarians, both the real handicap and the fake handicap.
If I think they are the real ones, I will not give way.
Whereas if I think they are fake one, I will humbly give way to prevent unwanted scene. I don't want to get into fight over such minor matter.