I've figured it out.
The problem was that I included a "/" before the name of the "fake" directory.
Here's the solution :
RewriteRule ^contact/?$ frontEnd/contact.php
RewriteRule ^about/?$ frontEnd/about.php
This is really useful if you want to keep your website directory structure well organized!