I can't imagine getting into an accident because of your contact lenses. It's probably a good idea to wear sunglasses along with the contacts, but I don't see any reason why wearing contact lenses should make biking more difficult.

Essentially I agree with everyone else. So yeah, what they said.