id	summary	reporter	owner	description	type	status	priority	milestone	component	version	resolution	keywords	cc
40	compress flog pickles	Zooko		"Running the tahoe test suite with {{{FLOGFILE=flog.pickle}}} and {{{FLOGTWISTED=1}}} generates:

{{{
flog.pickle size: 71221968
time to bzip2 it: real    0m42.529s
bzipped filesize:  3785336
}}}

Running the tahoe test suite after patching foolscap to use HIGHEST_PROTOCOL generates:
{{{
flog.pickle size: 59686279
time to bzip2 it: real    0m37.614s
bzipped filesize:  3039383
}}}

So it might be nice to use use protocol=2 (which I guess is better than HIGHEST_PROTOCOL, so that if a new version of Python comes out with a newer protocol, and someone uses foolscap on that version of Python, then they wouldn't be able to read the resulting pickles with Python 2.5/2.6/3.0).  It might also be nice to add a bzip2 filter.
}}}"	enhancement	closed	minor	0.2.3	logging	0.2.2	fixed