JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,044 Commits 5 Branches 0 Tags 94 MiB
c256da5eca
Commit Graph

18 Commits

Author SHA1 Message Date
Egon Elbre
dd60318147 cmd/tools/segment-verify: use resolved ip 
Change-Id: I3662aaea3ff8721c415c038b2b5324d165b60975
 2022-10-12 12:43:11 +00:00
Egon Elbre
ff22fc7ddd all: fix deprecated ioutil commands 
Change-Id: I59db35116ec7215a1b8e2ae7dbd319fa099adfac
 2022-10-11 15:27:29 +00:00
Egon Elbre
8916f2ee92 cmd/tools/segment-verify: allow ignoring specific nodes 
This adds a new flag that allows to ignore some nodes completely.

Change-Id: I203d25f931262c809037e25e9c37e9a89bf47026
 2022-10-10 20:14:38 +03:00
Egon Elbre
5f01dad3a3 cmd/tools/segment-verify: add total progress indicator 
Change-Id: Ib729abf6adbeba8d94e08c7e11497c6d5ddd5ec2
 2022-10-10 20:02:30 +03:00
Egon Elbre
ea4b3023d9 cmd/tools/segment-verify: fix piece id derivation 
Change-Id: Ib27fd8630e1e5a90060dff2a09c51f488960177f
 2022-10-06 13:43:08 +00:00
Egon Elbre
c8506cdda3 satellite/metabase,cmd/tools/segment-verify: simplify interface 
Change-Id: Icdd445b1713bc26cee3b3a125b68b0cde0739837
 2022-10-06 13:42:00 +00:00
Egon Elbre
c1817ab743 cmd/tools/segment-verify: a few fixes 
The flags weren't properly loading from config.

The code assumed that every node that's online for downloading also have
data uploaded to them -- which is not true.

Change-Id: Ifd65a47b9eca5b4841231928244fab17acbde6fb
 2022-10-05 15:51:38 +00:00
Egon Elbre
f98d551c9b cmd/tools/segment-verify: test service 
Change-Id: Ibd83960c18123e8f29e22089007dc32c8d532240
 2022-09-22 17:23:02 +00:00
Egon Elbre
0e99f7a8cf cmd/tools/segment-verify: add loading of priority nodes 
Change-Id: Idcc41469ea5f71eab1b9dccbe0f14da537386a17
 2022-09-21 14:56:13 +00:00
Egon Elbre
8b527f2d12 cmd/tools/segment-verify: add throttling 
Change-Id: Ia0b4ec255adc90d874f4366b80799414a1a94700
 2022-09-21 14:52:51 +00:00
Egon Elbre
cf50696745 cmd/tools/segment-verify: wire up overlay logic 
Change-Id: I0a4c737a8b0995a1c3e3adeac728fe833d0ce684
 2022-09-19 11:32:18 +03:00
Egon Elbre
0809ae73cf cmd/tools/segment-verify: add main 
Change-Id: Ib7161a0f44d447f9ddb9be83f6673587a0bd7712
 2022-09-19 10:36:57 +03:00
Jennifer Johnson
8529a169ee cmd/tools/segment-verify: add verifier 
Change-Id: I4cc1fbcf964c4a9a37cf80322f6f99dd956f3d7b
 2022-09-19 10:36:57 +03:00
Egon Elbre
9b520b2114 satellite/metabase: expose ConvertNodesToAliases and ConvertAliasesToNodes 
They are needed for segment-verify tool.

Also rename some of the conversion methods to make clear,
which of them have side-effects.

Change-Id: Ie9a0952548e9ed5068c7a30c2fd2134b07139bca
 2022-09-15 13:56:10 +00:00
Egon Elbre
507b099d44 cmd/tools/segment-verify: add monitoring / error 
Change-Id: I6fd0369719ddf176a98208348560004a4134f810
 2022-09-14 18:20:48 +00:00
Egon Elbre
6127f465dc cmd/tools/segment-verify: add logic for iterating over segments 
This adds parts for:
1. iterating over the segments
2. using an interface for writing the segments
3. stubs for handling deleted segments

Change-Id: I76a17cac6deb0b6c042a8ab7c4155a890db9da84
 2022-09-14 18:20:31 +00:00
Egon Elbre
8459a3faa2 cmd/tools/segment-verify: add processing of a collection of segments 
This adds logic to put segments into batches and retry them.

Change-Id: I86450e2f5ab13edb3ae9a5d5b9417e0cced2892b
 2022-09-12 18:29:04 +03:00
Egon Elbre
3467fd4b7f cmd/tools/segment-verify: implement batch creation 
Implements creating roughly load-balanced set of batched
that can be used to make multiple requests.

Change-Id: I349b276176dcb8ba9163e7e06a94509d73fa5ddc
 2022-09-12 18:29:01 +03:00