The download servlet should send back Last-Modified and Etag headers based on the attachment's last-modified date, then check correctly for If-Modified-Since: and so on on the way back in.
See if we can do the same thing for the other download strategies.