ELI5 What fundamentally determines the color of an element?

I understand that electron placement matters and light scatters a certain way but why is that? Why does light scatter in that way and why does the size of something determine a perceivable color?