jQuery fadein fadeout gets stuck

[jaapoost]

I've got the following code to fade in a div, and fade it out when the mouse leaves:

    $(".portfolio_href").hover(
		function () {
		$(this).children(".image_holder").stop().fadeIn(500);
		}, 
		function () {
		$(this).children(".image_holder").stop().fadeOut(500);
		}

I added the stop(); so it won't continue fading in and out if you ran over it twice in a short period. But the thing is, whenever I leave the element to early, the next time it will not fade to the full 100%, but to the point where I left the element before....

I hope this explains the problem :s

Regards,

Jaap