Returning large amount of artifacts from remote agent results in agent being offline on server

Our normal build returns about 174 MB of artifacts in over 8000 files (the wisdom of this is another issue). When we run this build remotely, we've consistently gotten an error on the server about the remote agent going offline as the artifacts are being copied. Reducing the number of artifacts alleviates the problem. My guess is that while the artifacts are being transferred, the heartbeat isn't maintained.