Magic Keyboard backlight stops working intermittently

Has anyone else dealt with this issue? It wouldn’t work for a day then randomly started working again. It only seems to happen when I have the charger plugged into the keyboard directly.