How do I share a header among many HTML files?

I'm looking for various options on how to do this. Ideally something lightweight development-wise, and hopefully avoiding PHP.

I hear it's doable with angular, but I feel like I'd be more comfortable with a server-side solution, or even a compiled solution.