Very good work! Results like these can be expected from using protobuf as it's machine-readable only. I consider msgpack to be "almost" human-readable :D
You are viewing a single comment's thread from:
Very good work! Results like these can be expected from using protobuf as it's machine-readable only. I consider msgpack to be "almost" human-readable :D
Yeah, if you open the msgpack file you can clearly interpret CPIDs in the compressed text, where at the protobuffer text contents look like garbage.
Interestingly enough, if you compress each file type in a GZ file they come out to be approximately the same file size.
Given protobuffer read speeds, you could avoid storing data in memory & rather request it directly from disk for each query, lol.