Why am I being shot on sight in Byzantium?

I finally just got to Byzantium after taking care of mostly everything everywhere else. I'm on the first main mission on Byzantium. But as soon as I got there, all of the guards were automatically hostile, making it essentially impossible to walk around the town. Is there something I don't know?