I remapped caps lock to control many years ago in Tweaks, Keyboard & Mouse, Additional Layout Options, Caps Lock Behavior. I can enable caps lock by pressing both shift keys and disable it by pressing any shift.
Remapping a combination of the windows key + another key like a backspace to Caplock gets the job done for me. Even shift + caplock would also solve the problem