It's annoying having to uncheck this option everytime I want to fetch.

I don't want to fetch from all remotes by default because some of them are very slow, like my colleagues' git repos accessed through windows shares.