I want to write my own pak file creator, i’ve searched the internet for virtual file systems and found truezip, while truezip will fullfill my needs there is one big drawback, it stores zip files up to 4 GB whereas my files tend to be a factor 10 larger. But since these files are stored in a way like this /textures/…,/pointclouds/… etcetc.
I’m wondering how difficult it can be to wrap this files in a nice pak file and browse inside this file as if it were a normal file.
any pointers?
Paul
Whats the need to create a pak file? The reason C/C++ people make them is because they dont have jars…
Who the hell would store ~40GB of data in ONE file?
Beside polygons, models, textures, i’m also storing point clouds, where a single point of such an cloud consist of an
(x, y z ) (r, g, b) ( u,v ) and (normal.x, normal.y, normal.z) since this data is coming from a laser scanner it are billions of points(which are then divided in an octree)
so 40 gig is not that much
Wouldn’t it better to split the data? I assume you don’t need all the data at once or all the time.
Beside the fact only linux/unix with newest fileformats support such big files. NTFS for windows only allows 4GB? files.
And if compressing your data, if not allready done, will decrease the overall size.
But for the topic, if your not happy with truezip or any other zip format, use your own.
You could use the Zip/GZip Out/In Streams of the java zip package to compress individual files and store them in the fileformat of your choice. Just build a filetable 
Perhaps it would make sense in this case to use a database instead of a file-structure?
i already store the leafnodes as individual files, so they would never reach the 4 gig limit
How should i achieve this, right now the algorithm to load files goes like this -> determine visible nodes -> load files -> memory map them -> render
but i have no idea how to do it in say SQL or with other databases
Thx, but haven’t you seen my questionmark behind the 4GB ? I was’t that sure about it if it really ends with 4GB. Non the less, 4GB is quite big for one file on a personal computer …
Oh in that case please accept my sincerest apologies, I misinterpreted your posting as a statement!
