aligeti
934ebf9cbf
Added the irreparable repair functionality ( #1955 )
...
* Added the irreparable repair functionality
2019-05-30 11:18:20 -04:00
Maximillian von Briesen
da91d22376
properly check last iteration of checker ( #2040 )
2019-05-23 18:14:08 +02:00
Maximillian von Briesen
b4f18226db
Send number of files as part of durability stats ( #2030 )
2019-05-22 18:50:43 -04:00
Maximillian von Briesen
45a2253628
Send durability stats after iterating over all segments ( #2028 )
2019-05-22 17:17:52 -04:00
Bill Thorp
6522579ecb
better repairer logging ( #2006 )
...
* logging and delete only repairs with no errors
* removing delete logi~c
2019-05-21 00:05:28 +02:00
Bill Thorp
91721f63ba
Bt/repair no nodes ( #1974 )
...
* handle cases where repair is equal to total
2019-05-17 15:02:40 -04:00
aligeti
60cf1dafb0
repair segment reassess it missing pieces just before repair ( #1939 )
...
* repair segment reaccess it missing pieces just before repair to see if it actually needs repair
2019-05-16 09:49:10 -04:00
Bill Thorp
4002ed4463
unskip TestIdentifyIrreparableSegments ( #1927 )
2019-05-09 15:55:34 +03:00
Natalie Villasana
b48f584cea
repair checker resumes iterating where left off ( #1879 )
2019-05-08 13:59:50 -04:00
Bill Thorp
ea978dd674
hopefully sensible satellite defaults ( #1888 )
...
* hopefully sensible satellite defaults
2019-05-07 10:44:47 -04:00
Bill Thorp
6ece4f11ad
moved invalid/offline back into SQL ( #1838 )
...
* moved invalid/offline back into SQL, removed GetAll()
2019-05-01 09:45:52 -04:00
Bill Thorp
2c9ef5b107
longer repair window ( #1866 )
2019-04-30 11:20:18 -04:00
Egon Elbre
db939d37ec
cover all the things ( #1818 )
2019-04-26 16:39:11 +03:00
Michal Niewrzal
fe3dfc1587
Move pointerdb.Service to satellite ( #1826 )
2019-04-25 10:46:32 +02:00
Egon Elbre
c284cfde30
ensure TestParallel doesn't deadlock on error ( #1808 )
2019-04-24 13:15:46 +03:00
Bill Thorp
cd4a3e06d8
wired up IsHealthy to config ( #1820 )
...
* wired up IsHealthy to config
2019-04-23 18:45:50 -04:00
Fadila
8ddf481b33
Checker: invalid and offline nodes search update ( #1812 )
...
* simplified invalid and offline login into getMissingPieces
2019-04-23 16:54:39 -04:00
Egon Elbre
bdd0d778eb
interface tests belong to the interface, not the implementation ( #1794 )
2019-04-23 11:47:16 +03:00
Egon Elbre
f49b0acc5b
repair until queue is empty ( #1716 )
...
* repair until queue is empty
2019-04-22 11:16:21 -04:00
Natalie Villasana
8d1f614662
removes unused queue code, moves queue_test.go to repairqueue_test.go in satellitedb dir ( #1783 )
2019-04-22 13:35:52 +03:00
Bill Thorp
9dc4e82437
removed commented code, removed unnecessary pointer ( #1766 )
...
* removed commented code
2019-04-16 15:55:28 -04:00
Bill Thorp
17a227e6e9
refactor injuredsegments db so that we can't have duplicates ( #1717 )
...
made repairqueue not use a true queue, forbid duplicates
2019-04-16 14:14:09 -04:00
JT Olio
ffdb2e7728
actually skip the data repair test ( #1728 )
...
Change-Id: I76286fc6cc5129d8be50d45a684a3e0dce9c0cc6
2019-04-09 23:29:05 -06:00
JT Olio
61ec92f2e8
disable datarepair test for now ( #1727 )
...
Change-Id: I1854817ea051ab621936f587b198de2da07c9960
2019-04-09 22:31:55 -06:00
Maximillian von Briesen
3fb4813227
Fix data repair checker missing pieces list ( #1705 )
2019-04-08 15:46:23 -04:00
Maximillian von Briesen
bb3b4e4816
Data repair integration test ( #1582 )
2019-04-08 13:33:47 -04:00
littleskunk
43ef0eb4c3
Don't crash on audit and repair failures ( #1622 )
...
* Fix satellite crash on repair
(cherry picked from commit cabf6c9f97780f900d76e2388ffa54b916f14528)
* Fix satellite crash on audit
(cherry picked from commit 9da67488c4b36a378f346fbb27651316284b0f36)
2019-04-01 11:16:17 +02:00
Egon Elbre
be06fdfd6c
Create orders.Service ( #1593 )
2019-03-28 22:09:23 +02:00
Kaloyan Raev
d1639c4157
Merge statdb pkg into overlay pkg ( #1570 )
2019-03-25 18:25:09 -04:00
Egon Elbre
94e79eda6d
remove overlay endpoint ( #1521 )
2019-03-23 10:06:11 +02:00
Kaloyan Raev
d057efb05e
Add Repair method to ECClient ( #1509 )
2019-03-19 15:14:59 +02:00
Egon Elbre
05d148aeb5
Storage node and upload/download protocol refactor ( #1422 )
...
refactor storage node server
refactor upload and download protocol
2019-03-18 12:55:06 +02:00
Cameron
c7ffbe1c28
Add ability to view irreparable segments on satellite ( #1448 )
...
* define irreparable inspector protobuf
* add IrreparableDB method GetLimited
* fill out irreparable inspector API
* add IrreparableInspector server to satellite, fix small error
* refactor IrreparableDB to use pb.IrreparableSegment instead of irreparable.RemoteSegmentInfo
2019-03-15 16:21:52 -04:00
Bill Thorp
665fd33e3c
Repair queue isolation level fix ( #1466 )
...
Implemented custom SQLite and Postgres Repairqueue Dequeue handlers
2019-03-14 17:12:47 -04:00
aligeti
c6ad7644d2
Total file count through Monkit ( #1351 )
...
* segment, file, byte stats, total and per-bucket; checker: report segment health stats; reports the total num of lost files
* code review updates
2019-02-26 10:17:51 -05:00
Bill Thorp
9b580c5fb6
Repair checker is checking the same 1000 elements all the time ( #1297 )
...
* removed limit on repair, now using cycle
* added BatchIteratorOptions
* consolidated boltdb common.go
* PR feedback cleanup
2019-02-14 13:33:41 +01:00
Michal Niewrzal
b2f9453184
Disable Checker subsystem in tests ( #1279 )
...
* Disable Checker subsystem in tests
* rename field
* remove sleeps and errgroup.Group
2019-02-11 22:06:39 +01:00
JT Olio
2a59679766
pkg/transport: require tls configuration for dialing ( #1286 )
...
* separate TLS options from server options (because we need them for dialing too)
* stop creating transports in multiple places
* ensure that we actually check revocation, whitelists, certificate signing, etc, for all connections.
2019-02-11 13:17:32 +02:00
Egon Elbre
bb11d83ed0
Proper planet shutdown ( #1249 )
2019-02-06 15:19:14 +02:00
Michal Niewrzal
aa3836c06a
Add checker irreparable test ( #1246 )
...
* Add checker irreparable test
* use RepairUnixSec
* wait for second check
* use storagenode.ID()
* Update comments
2019-02-06 14:03:38 +01:00
Egon Elbre
39c1e5ccec
Ensure checker tests run against postgres ( #1229 )
2019-02-05 18:00:52 +02:00
Egon Elbre
5a63c00442
Fix issues with blocking during startup ( #1212 )
2019-02-01 19:28:40 +02:00
Egon Elbre
d5346982c2
Delete provider package ( #1177 )
2019-01-30 22:47:21 +02:00
Michal Niewrzal
14434594c4
Re-enable repair checker tests ( #1172 )
...
* Re-enable repair checker tests
* simpler NodeID construction
* adjust benchmark
2019-01-30 19:34:44 +01:00
Bill Thorp
60946c2024
make bandwidth agreements sensible: without []byte's ( #1152 )
...
removed []byte's from bandwidth agreement protocol buffers
2019-01-28 14:45:25 -05:00
Jennifer Li Johnson
856b98997c
updates copyright 2018 to 2019 ( #1133 )
2019-01-24 15:15:10 -05:00
Egon Elbre
5de7f8af7f
Satellite Peer ( #1119 )
2019-01-23 21:58:44 +02:00
Michal Niewrzal
eb2d858ffc
Use pointerdb.Service instead of pointerdb.Server ( #1099 )
2019-01-19 13:58:53 -05:00
Egon Elbre
78dc02b758
Satellite Peer ( #1034 )
...
* add satellite peer
* Add overlay
* reorganize kademlia
* add RunRefresh
* add refresh to storagenode.Peer
* add discovery
* add agreements and metainfo
* rename
* add datarepair checker
* add repair
* add todo notes for audit
* add testing interface
* add into testplanet
* fixes
* fix compilation errors
* fix compilation errors
* make testplanet run
* remove audit refrences
* ensure that audit tests run
* dev
* checker tests compilable
* fix discovery
* fix compilation
* fix
* fix
* dev
* fix
* disable auth
* fixes
* revert go.mod/sum
* fix linter errors
* fix
* fix copyright
* Add address param for SN dashboard (#1076 )
* Rename storj-sdk to storj-sim (#1078 )
* Storagenode logs and config improvements (#1075 )
* Add more info to SN logs
* remove config-dir from user config
* add output where config was stored
* add message for successful connection
* fix linter
* remove storage.path from user config
* resolve config path
* move success message to info
* log improvements
* Remove captplanet (#1070 )
* pkg/server: include production cert (#1082 )
Change-Id: Ie8e6fe78550be83c3bd797db7a1e58d37c684792
* Generate Payments Report (#1079 )
* memory.Size: autoformat sizes based on value entropy (#1081 )
* Jj/bytes (#1085 )
* run tally and rollup
* sets dev default tally and rollup intervals
* nonessential storj-sim edits (#1086 )
* Closing context doesn't stop storage node (#1084 )
* Print when cancelled
* Close properly
* Don't log nil
* Don't print error when closing dashboard
* Fix panic in inspector if ping fails (#1088 )
* Consolidate identity management to identity cli commands (#1083 )
* Consolidate identity management:
Move identity cretaion/signing out of storagenode setup command.
* fixes
* linters
* Consolidate identity management:
Move identity cretaion/signing out of storagenode setup command.
* fixes
* sava backups before saving signed certs
* add "-prebuilt-test-cmds" test flag
* linters
* prepare cli tests for travis
* linter fixes
* more fixes
* linter gods
* sp/sdk/sim
* remove ca.difficulty
* remove unused difficulty
* return setup to its rightful place
* wip travis
* Revert "wip travis"
This reverts commit 56834849dcf066d3cc0a4f139033fc3f6d7188ca.
* typo in travis.yaml
* remove tests
* remove more
* make it only create one identity at a time for consistency
* add config-dir for consitency
* add identity creation to storj-sim
* add flags
* simplify
* fix nolint and compile
* prevent overwrite and pass difficulty, concurrency, and parent creds
* goimports
2019-01-18 08:54:08 -05:00
Bill Thorp
342dc857f5
rollup query ( #1056 )
...
* implemention notes
* more notes
* starting rollup query
* not working yet
* fixed build
* fixed cfg bug
* change context cancelled errs to debugs
* using byte hours for at rest tally
* revert changes to go.mod
* comment fixes
* prevent double recording tallies in rollup
* linting
* stop leaking dbx
* nodeid changes
* fix build
2019-01-16 14:30:33 -05:00
