After successfully applying KB2977320 security update to a passive node in the cluster then subsequently moving an instance to the node, I'm getting stuck in a condition where I can no longer connect to the instance. The error message is "Login failed for user 'mydomain\myusername' Reason: Server is in script upgrade mode. Only administrator can connect at this time.
After reviewing the ERRORLOG for this instance, I have found "Database 'master' is upgrading script 'sqlagent100_msdb_upgrade.sql' from level 0 to level 2."
The next related error is "Failed to initialize Distributed COM (CoInitializeEx returned 80010119). Heterogeneous queries and remote procedure calls are disabled. Check the DCOM configuration using Component Services in Control Panel."
And finally:
Creating view sysalerts_performance_counters_view...
Error: 7404, Severity: 16, State: 2.
The server could not load DCOM.
Error: 912, Severity: 21, State: 2.
Script level upgrade for database 'master' failed because upgrade step 'sqlagent100_msdb_upgrade.sql' encountered error 7404, state 2, severity 25. This is a serious error condition which might interfere with regular operation and the database will be taken
offline. If the error happened during upgrade of the 'master' database, it will prevent the entire SQL Server instance from starting. Examine the previous errorlog entries for errors, take the appropriate corrective actions and re-start the database so that
the script upgrade steps run to completion.
Error: 3417, Severity: 21, State: 3.
Cannot recover the master database. SQL Server is unable to run. Restore master from a full backup, repair it, or rebuild it. For more information about how to rebuild the master database, see SQL Server Books Online.
Things I tried so far:
The steps in http://support.microsoft.com/kb/2163980 did not resolve the issue, although I can connect while having the -T902 flag on.
Tried uninstall / reinstall of patch, same behavior.
Tried install / startup with AV disabled.
Also found that running "select * from sys.dm_os_performance_counters" will reproduce the DCOM issue while the instance is started with -T902.
At this point in time the Application event log says this, "Failed to initialize Distributed COM (CoInitializeEx returned 80010119). Heterogeneous queries and remote procedure calls are disabled. Check the DCOM configuration using Component Services in Control Panel."
This is SQL Server 2008 R2 Enterprise SP2 x64 on Windows Server 2008 R2 Sp1, Multi-node, multi-instance Failover Cluster setup. Can recreate the issue on multiple similar setups.
Can anyone offer some help on next steps for troubleshooting?
Thanks!