Natalie Villasana
e2a43c3fb6
adds defer close for node conn in audit verifier ( #1634 )
2019-04-03 09:42:24 -04:00
JT Olio
9af4f26d43
libuplink changes for public usage ( #1568 )
...
Co-authored-by: paul cannon <thepaul@users.noreply.github.com>
Co-authored-by: Kaloyan Raev <kaloyan-raev@users.noreply.github.com>
2019-04-03 11:46:21 +03:00
Cameron
34a439a99c
Delete accounting raws after rollup ( #1646 )
...
* enable deletion of raws
* assert deletion of raws during TestRollupRaws
* add some unit tests for DeleteRawBefore
2019-04-02 23:55:24 -04:00
paul cannon
e4a70e3fac
plumb EncryptionScheme, RedundancyScheme through to buckets ( #1638 )
...
We want to use those fields in the bucket-level Pointer objects as
bucket defaults, but we need to be able to get at them first.
I don't see any strong reason not to make these available, except
that it was kind of a pain.
2019-04-02 15:15:31 -06:00
Jess G
d51bdf14df
project usage limiting ( #1561 )
...
* reorg uplink cmd files for consistency
* init implementation of usage limiting
* Revert "reorg uplink cmd files for consistency"
This reverts commit 91ced7639bf36fc8af1db237b01e233ca92f1890.
* add changes per CR comments
* fix custom query to use rebind
* updates per convo about what to limit on
* changes per comments
* fix syntax and comments
* add integration test, add db methods for test
* update migration, add rebind to query
* update testdata for psql
* remove unneeded drop index statement
* fix migrations, fix calculate usage limit
* fix comment
* add audit test back
* change methods to use bucketName/projectID, fix tests
* add changes per CR comments
* add test for uplink upload and err ssg
* changes per CR comments
* check get/put limit separately
2019-04-02 11:21:18 -07:00
Natalie Villasana
2aeab10d50
skips flaky audit verifier test ( #1645 )
2019-04-02 13:44:33 -04:00
Alexander Leitner
59b3eb190e
API endpoint checking object and segment health from the satellite ( #1546 )
...
* Generate protobuf for checking object and segment health
* Initial cmd client for health check
* Register the health inspector on the satellite peer
2019-04-02 10:55:58 -04:00
Natalie Villasana
c7c6d3d597
skips flaky TestGetShareTimeout ( #1635 )
2019-04-02 09:16:13 -04:00
Natalie Villasana
42a141965d
fixes infinite loop in audit TestVerifierHappyPath ( #1617 )
2019-04-01 17:27:07 -04:00
Michal Niewrzal
f80750693c
Store bandwidth from orders on satellite ( #1586 )
2019-04-01 16:14:58 -04:00
Cameron
6d43832c4f
record bucket data into bucket_storage_tally table ( #1595 )
...
* add MetadataSize to stats
* add logic for accumulating bucket stats in calculateAtRestData
* rename stats to BucketTally, move to accounting package
* define method on accountingDB for inserting bucketTallies
* insert bucketTallies into bucket_storage_tally table
2019-04-01 09:42:17 -04:00
littleskunk
43ef0eb4c3
Don't crash on audit and repair failures ( #1622 )
...
* Fix satellite crash on repair
(cherry picked from commit cabf6c9f97780f900d76e2388ffa54b916f14528)
* Fix satellite crash on audit
(cherry picked from commit 9da67488c4b36a378f346fbb27651316284b0f36)
2019-04-01 11:16:17 +02:00
Egon Elbre
872bd5d7c1
Remove pointerdb.Server ( #1609 )
2019-03-30 13:21:49 +02:00
paul cannon
857edee485
assert.NoError() -> require.NoError() in kademlia tests ( #1608 )
2019-03-29 20:16:59 +02:00
Egon Elbre
63737e350f
Delete psserver and unused mocks ( #1605 )
2019-03-29 16:40:06 +02:00
aligeti
ea22411cac
overlaycache's DB access modified to use transaction ( #1596 )
2019-03-29 09:46:17 -04:00
Egon Elbre
9dbc7c719e
fix error handling in GetByProjectID ( #1604 )
2019-03-29 14:55:05 +02:00
Egon Elbre
de15a4fdcf
remove utils.CombineErrors and utils.ErrorGroup ( #1603 )
2019-03-29 14:30:23 +02:00
Kaloyan Raev
ddce5a4bf8
Fix incorrect usage of NodeID and ErrNodeID in PieceID impl ( #1601 )
2019-03-29 13:13:03 +02:00
Kaloyan Raev
f9ba935286
Merge overlay_cache_nodes into nodes table ( #1581 )
2019-03-29 10:53:43 +02:00
Egon Elbre
be06fdfd6c
Create orders.Service ( #1593 )
2019-03-28 22:09:23 +02:00
Bill Thorp
40e7fae564
not overflow int32 ( #1594 )
2019-03-28 13:08:32 +02:00
Stefan Benten
7336e87e1c
Fixing Check for a writable folder of the identity tool ( #1587 )
...
* Fixing Check for a writable folder
* Removing fmt statements
* Check the folder not the file
2019-03-27 23:20:10 +01:00
Cameron
cac55a29e4
Add used egress/ingress to storage node dashboard ( #1565 )
...
* add egress and ingress to StatSummaryResponse
* print egress and ingress to storagenode dashboard
2019-03-27 15:44:18 -04:00
Michal Niewrzal
bfdfebbde2
Satellite orders receiving ( #1564 )
...
This change adds satellite endpoint for receiving OrderLimits sent by storage node.
Change includes:
* wire up orders sender in storage node (also in testplanet)
* saving serial number for OrderLimit in serial_numbers table
* satellite endpoint for receiving, verifying and storing OrderLimit and Order serial number
* initial implementation for Orders DB
* basic test for sending orders to satellite
2019-03-27 11:24:35 +01:00
Natalie Villasana
5b48a48a79
adds test for correct download with non-critical amount of nodes offline ( #1574 )
2019-03-26 14:09:44 -04:00
JT Olio
d7ac48ead7
pkg/process: indicate if an error is causing program death ( #1573 )
...
Change-Id: I4f97cbd1004bcbda8b25a238a6c30ca88a20ac43
2019-03-26 07:47:55 -06:00
Kaloyan Raev
d1639c4157
Merge statdb pkg into overlay pkg ( #1570 )
2019-03-25 18:25:09 -04:00
Bryan White
ef99c1657f
TLS extension handling overhaul ( #1458 )
2019-03-25 22:52:12 +01:00
Bill Thorp
dbd97aaaf9
SNs should NOT be audited for expired segments ( #1559 )
...
delete expired pointers during audit
2019-03-23 06:52:51 -04:00
Egon Elbre
94e79eda6d
remove overlay endpoint ( #1521 )
2019-03-23 10:06:11 +02:00
Dylan Lott
c6d5ff5dc2
remove unused bootstrap function from discovery/service.go ( #1558 )
...
* remove unused bootstrap function from discovery/service.go
* Linter fix missing semicolon
2019-03-22 15:00:38 -06:00
Natalie Villasana
0fa1d536e7
removes pingbackTimeout ( #1556 )
2019-03-22 16:06:57 -04:00
Natalie Villasana
ea4a61f0c0
adds slow kad dialer tests, adds timeout interceptor to transport ( #1545 )
2019-03-22 13:09:37 -04:00
Jess G
9236ac4bdf
change default to true to enforce sa whitelist ( #1549 )
...
* change default to true to enable whitelist
* add devDefault
2019-03-22 07:21:16 -07:00
Egon Elbre
1d96d25f3f
kademlia ping tracking ( #1538 )
2019-03-22 15:27:59 +02:00
Egon Elbre
694b6dc1da
make tests run faster ( #1553 )
2019-03-22 15:14:17 +02:00
Kaloyan Raev
30dfc2b20c
Remove PointerDB client ( #1520 )
2019-03-22 11:01:49 +02:00
Maximillian von Briesen
db64d6590b
Add repairer tests ( #1494 )
2019-03-21 16:26:56 +02:00
Kaloyan Raev
2c410f51bb
Fix CalcEncryptedSize and CalcPieceSize ( #1525 )
2019-03-21 15:47:48 +02:00
Egon Elbre
2c5c2c29da
storage node order sending ( #1535 )
2019-03-21 15:24:26 +02:00
Kaloyan Raev
b66b49d824
Print Satellite ID in logs when SettleAgreement fails ( #1542 )
2019-03-21 12:59:22 +02:00
Michal Niewrzal
d7feafe56b
Move psserver tests ( #1522 )
2019-03-20 23:12:00 +02:00
Natalie Villasana
e390605b81
rearranges code in verifier.go ( #1529 )
2019-03-20 11:54:37 +01:00
Natalie Villasana
b4b99fa979
adds context timeout to transport.DialAddress ( #1528 )
2019-03-20 12:11:07 +02:00
Bryan White
724aaab78d
fix kademlia bootstrap and getting peer identity from context ( #1434 )
2019-03-20 10:30:42 +02:00
Natalie Villasana
61ee04d363
adds pingbackTimeout to kademlia endpoint ( #1518 )
2019-03-19 14:30:27 -04:00
Natalie Villasana
a09f568fdb
audit service won't hang on bad storage node conns ( #1503 )
2019-03-19 13:37:26 -04:00
Kaloyan Raev
d057efb05e
Add Repair method to ECClient ( #1509 )
2019-03-19 15:14:59 +02:00
Egon Elbre
26497df0e2
Faster agreement sender ( #1507 )
2019-03-19 14:56:59 +02:00
