158eb2381e
We would like to have separate process/command to collect bloom filters from source different than production DBs. Such process will use segment loop to build bloom filters for all storage nodes and will send it to Storj bucket. This change add main logic to new service. After collecting all bloom filters with segment loop and piece tracker all filters are marshaled and packed into zip files. Each zip contains up to "ZipBatchSize" bloom filters and it's uploaded to specified in configuration bucket. All uploaded objects have specified expiration time to not delete them manually. Updates https://github.com/storj/team-metainfo/issues/120 Change-Id: I2b6bc02a7dd7c3a639e75810fd013ae4afdc80a2 |
||
---|---|---|
.. | ||
bloomfilter | ||
doc.go | ||
gc_test.go | ||
piecetracker.go | ||
service.go |