1. Can't access using /elmah.axd, 403 forbidden
Add
....
Thanks to this post
http://code.google.com/p/elmah/wiki/SecuringErrorLogPages
2. Elmah doesn't log in Plesk
Check permission Elmah logging folder, it is ~/Logs in my case. Make sure IIS user and IIS WP user has write permission