the reason why your dream of realizing referees in party chat with captains will never work is simple:
referees do other things while the matches are running.
They sometimes tab out, they sometimes chat with other people, they watch things on their other screen, listen to the commentary or music etc.
You cant honestly expect a referee to be focused constantly for 2-4 hours during the event.
There are already enough for a ref to keep focus on, gameplay, lobbies, password, invites, time, loadouts etc. etc.
adding to that list will lead to more confusion, especially when someone talks to you while you are reffing.
The referee party chat is used to talk about scores, lobbies etc.
and tbh, if the ref isnt responding to chat, then he probaly left his pc for a min to do something, so talking wont help
I know its tough luck, but referees are just players who spend their valuable time helping to run the event. They arent professionals paid to do all sorts of things, and more than often referees are new and pulled in 5 mins before the event.