Debugging through some socket code and suddenly the debugger came up with the above when I tried to step into the .NET code.
It was asking for NetworkStream.cs , Socket.cs etc.
Trying to browse to the file wasn't helping.
So Mr. Google to the rescue.
The solution is:
Visual Studio / Tools / Options / Debugging / General / Enable source server support