I think I've tried every possible combination now: It only happens when UR is set to startup with Windows (it doesn't matter if Outlook is started or not). If I start UR manually it works as expected.
I tried it on another PC which doesn't have Outlook installed and it works perfect there (hence my idea it could be something with Outlook).