Car wont turn over if it stalls

If i stall my 04 corolla le which luckily doesnt happen often, it tends to not turn over. I have to click the key over like 50 times until it tries to start. Thought maybe it was the clutch switch or something.