is there a simple way to mask out box colliders so they cant be clicked when not visible?

I have a masked UI window that holds card that the player can scroll through and click, but the box colliders can be clicked when the cards are outside the mask. is there a way to make the box colliders not work when outside the mask? I think I could probably get the corner points then shrink the box collider around different pivot points depending on where its moving to, but that seams like over engineering for something that may already exist. I've been trying to find a simple way to do it and cant turn up anything. it would be appreciated if before I spend the time someone could let me know if there is an easy fix