Nothing is more stable than using your neck to disconnect the camera from the bike's vibrations!
What kind of camera do you use?
My GoPros have a really good suction mount that will stick just about anywhere. The tripod mount is also a winner. You can do so much with these little cameras because they weigh nothing.
I've been meaning to do some decent filming for a while but haven't quite got there yet.