Vista Tutorial - Vista File Explorer

This has probably been answered before, but I can not find it.

I have shortcuts to folders on my desktop, to netowrk shared folders and
local folders. When I use the shortcut on a Network Shared Folder, it comes
up and is ready to use very quickly.

Yet when I use the Shortcut on a Local Folder it will and often does take
upto 15 to 20 seconds for me to browse, scroll or interact with the window,
if I try sooner, it will often go transparent and say not responding for
longer.

Now I thought it was the Windows Search, so I disabled it. I know where I
keep everything so I dont think I need it. But I am not 100% sure, but it
appears to be taking longer! What gives? Is there an option I am missing?
I could understand a Network Share, but not a Local share. I even
uninstalled my Anti-Virus to see if that made a difference and it has made no
difference.