That's done with background images. You should be able to do the same thing with FrontPage.
Here is the one that is repeated on the y-axis -
And here is the top image -
There is a bottom image too but you get the idea so I won't post that.
Look at the source code of the page you linked to see how they did it.
Check out these examples too -
Shadow with images
CSS only shadow