ZEN35 out of sync with relay state

Quite possibly a noobie issue here.

I have recently added multiple lighting loads in my kitchen (under cabinet, in cabinet, ceiling) and wanted to control them from 1 smart switch as well as Home Assistant.

After much deliberation I went with ZEN35 Scene Controller + ZEN54 & ZEN56 relays.

I configured via Direct Association as I want the basic controls at least to work even if HA is down.

It is mostly up and running but I’ve run into an issue where I often have to press the ZEN35 buttons twice to toggle the lights. It seems rather than send a “toggle” command, it is sending “ON” when it thinks the lights are “OFF” and vice versa.

Essentially it does not know the current light state if they changed from somewhere other than the switch.

Surely there is a work around for this?