I have a minecraft server that’s updating a Tectonicus map every day. Unfortunately the server doesn’t have a huge amount of upstream bandwidth, so viewing the map is quite slow. I’d like to automatically move the map (via FTP) to some regular web hosting where it’ll be quicker to view.
The map is about 6Gb, in lots of tiny files (100k+) each about 200k, scattered over about 10 directories. On average maybe about 5% of those are re-rendered, and of those a portion will actually produce an identical file.
So how do I efficiently sync the local dir to the remote dir? Ideally I’d just run rsync, but that needs both a client and a server running, and I can’t run rsync on the web hosting. I do have a java client running on the minecraft server, so I can write something (or use a library) there. I guess something like csync would be good, but that doesn’t have a java api.
Suggestions?