Crusie control work only when steering wheel is turned

Hi folks, on my 2011 corolla the cruise control light turns on only when I press the switch after turning the steering wheel left or right. After that if I try to set it I can't. I can't even turn off the light. For that I have to twist the steering again and press the switch. I tried putting in a new switch but same problem exists. Any help would be appreciated