I really like cheap point and shoot cameras for these purposes. If they break, just by another but they generally don't. The batteries last forever and the results are surprisingly good now.
On the other end of the scale is the GoPro. This is a tiny HD camera which can be suction mounted to you, the bike, anywhere. There are loads of options for angles on the go as well as stationary and I have seen videos of them falling from planes at thousands of feet and working fine when they hit the floor. Also, 100% waterproof. Not cheap, but my god they're good.