you're safe as long as youdownload your files from seedbox to local via secure protocols, like sftp, https. if you use ftp or http, then you need vpn.

also, general idea is private trackers are safe without vpn. but again, instead to pay for vpn, it is a better idea to get 5€ seedbox with plenty of space (seedhost 1tb) which also provides vpn.

we can discuss it further if you wish.