In the USA we elected as president a politician who openly mocked a reporter with a physical disability. It doesn't seem like that much of a stretch to imagine someone carrying exactly that flag.
It would be simple for a bill to carve out exception for veterans. An example of this type of thing is that many laws against government employees forming a union exempt firefighters and police officers.
I'm not worried. No politician will carry the flag of denying rights for people with disabilities.