storj/satellite/metainfo
Egon Elbre 3d6518081a satellite/metainfo/piecedeletion: add Combiner
To handle concurrent deletion requests we need to combine them into a
single request.

To implement this we introduces few concurrency ideas:

* Combiner, which takes a node id and a Job and handles combining
  multiple requests to a single batch.

* Job, which represents deleting of multiple piece ids with a
  notification mechanism to the caller.

* Queue, which provides communication from Combiner to Handler.
  It can limit the number of requests per work queue.

* Handler, which takes an active Queue and processes it until it has
  consumed all the jobs.
  It can provide limits to handling concurrency.

Change-Id: I3299325534abad4bae66969ffa16c6ed95d5574f
2020-03-16 17:13:26 +00:00
..
piecedeletion satellite/metainfo/piecedeletion: add Combiner 2020-03-16 17:13:26 +00:00
batch.go satellite/metainfo: combine CommitSegment and CommitObject in batch v2 2020-02-28 07:40:36 +00:00
config.go satellite/metainfo: add timeout for delete request 2020-02-20 09:10:16 +00:00
db_test.go satellite/satellitedb/satellitedbtest: pass ctx as an argument 2020-01-20 16:35:42 +02:00
db.go common: separate repository 2019-12-27 14:11:15 +02:00
delete_pieces_service_test.go satellite/metainfo: fix data race in test 2020-03-09 14:59:44 +00:00
delete_pieces_service.go satellite/metainfo: remove DeletePieces_node_id metric 2020-02-21 20:33:33 +00:00
endpoint_test.go cmd/uplink: remove unused flag 2020-03-09 13:44:46 +00:00
loop_test.go common: separate repository 2019-12-27 14:11:15 +02:00
loop.go satellite/metainfo: track observer timing 2020-02-26 17:42:56 +00:00
loopstats.go satellite/metainfo: track observer timing 2020-02-26 17:42:56 +00:00
metainfo_old_test.go satellite/metainfo: stops hiding real validateAuth 2020-03-10 11:53:00 +00:00
metainfo_test.go satellite: remove some unnecessary UTC() calls 2020-03-13 13:49:44 +00:00
metainfo.go metainfo: delete methods return the deleted item 2020-03-16 16:26:16 +02:00
service_test.go satellite/metainfo: move RS configuration to satellite 2020-01-22 09:33:53 +00:00
service.go go.mod: update uplink 2020-02-21 16:08:12 +02:00
validation.go satellite/metainfo: stops hiding real validateAuth 2020-03-10 11:53:00 +00:00