I think the problem is the use of the word Rematch in this situation.
Many people who do not click rematch do not do so for a few different reasons:
Most common is they don't give a damn about who they are with or against, this is the bulk of pubs.
Then the guys who don't vote because they want to avoid another 5-0 stomp, not realising team.scramble happens. This is a bigger and more common issue than it seems.
Then the guys who want to go back to crew form so they can reform their two ships. However some of these guys vote rematch if people request it, knowing its no extra time to leave the lobby and goto crew form than it is to leave individual crew form and goto crew form.
So I think if rematch was reworded to something with emphasis on team scramble, then rematches would happen more often.
One thing I try to do is advertise the fact that rematch voting means less queue time in match maker (when busy) thus faster.