video tag is html5, so it won't work in non-html5 browsers. you'll need to have some sort of fallback for those.
some little flashplayer or something.
if you're lazy (like me), you can use jPlayer. it has fallback and all that good stuff
http://www.jplayer.org/