Can I complete Bring It On: Flotsam after beating the kayran?

I defeated the Kayran and now I’m at the point when I have to decide between working with either Roche or Iorveth. I’m trying to do Bring It On: Flotsam and I’ve arm wrestled 1/4 and am looking for Wiry Wilks next but it seems like the town has almost entirely depopulated and the bar/inn is completely empty upstairs which is where my quest marker is telling me to go to find Wilks.

Is it too late to finish this quest? And if I don’t complete this quest before moving on past Flotsam, will I be able to do what I assume will be the similar quests in the subsequent locations?