As a follow-up to my previous post..
Eventually a colleague of mine pointed me in the right direction. The System.Runtime.Remoting part of a configfile can also contain a <customErrors> tag. Setting it to "Off" made that I got the expected exception. Thanks Jasper!