So now I am thoroughly confused. All of the services appear to drop all of their memory in favor of a service that is not showing up in Task Manager. My primary question is this: how can a service that is not listed in Task Manager be using up all of the memory on a computer? I have made doubly sure that all processes from all uses are shown, so I know I am not missing one that should be appearing in Task Manager.
Any chance you could zip up that Perfmon log from the failing Vista file copy target and upload it either here or at rapidshare or somewhere? I'd like to take a look at it.
Overall memory utilisation is not a simple sum total of all the working sets of all processes. There are memory structures in kernel-mode, in particular the "pools", which are not necessarily tagged against any process. Having said that, since you previously observed a SVCHOST instance to have a very large working set by the onset of the symptom, would have expected at least one of the breakout services which you configured to run in their own SVCHOST instance (process) to show equivalent growth - and from what I understand of your latest post that was not the case - the abnormally high utilisation by a SVCHOST instance disappeared once the services were all spilt up?
What backup app are you using on the Win2K3 box? Sorry, it's been a while so I'm starting to forget whether we've already covered this ground, but it would be good if you could confirm whether:
a) Using NTBACKUP on the win2k3 end causes the same symptom on Vista. (I'm still looking for the reason why your Win2K3 server does not attempt to set up an SMB session via TCP445.)
b) Copying insanely large amounts of data (>40GB) to the Vista machine causes the same symptom, as opposed to using a backup utility to do it.