Are you mainly aiming to use this to rename audio files, for which a number of X11 applications exist for? Like Quod Libet/Beets/EasyTag? Or for video files+audio, FileBot?
If so, you can install those on your server, and use them over ssh with X11 forwarding, because X11 is great. There's a stack overflow answer that covers the main problems here:
Basically, as long as you already have SSH on your server, the only thing you should need to do is set 'X11Forwarding yes' in your sshd config, restart sshd on there, and connect to the server with the '-X' flag.
Please don't expose your sshd server to the internet or at least use certificate authentication if you must do so.