I am speechless now: what a "stupid" bug MS has in Outlook configuration wizard! I blamed myself too without looking into the log files earlier on the client side.
The stupid problem is: I already have an online CRM instance. When you added an on-premise instance, the wizard actually never tries to go to the on-premise instance but the online one.
What a joke here!