Does it still take minutes to load, though? My problem has never been the difficulty in launching Task Manager, it's been with getting task manager to respond in any amount of hurry.
I just hit CTL+SHIFT+ESC and Task Manager was there instantaneously. If things have gone so screwy that you really need Task Manager, then yeah, it will probably be slow.