I got around to some tests today, both
ErrorDocument /error.php and
ErrorDocument * /error.php cause internal server errors. I don't know if there is a syntax I'm not using — I just guessed at those two — or if it's plain not supported. That's all I got, for curiosities' sake.