JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4,576 Commits 5 Branches 0 Tags 94 MiB
dc67ce74c9
Commit Graph

254 Commits

Author SHA1 Message Date
Egon Elbre
9674ce40e6 mod: bump dependencies 
Change-Id: I61beaf9793609f7614478cfa604b2721d9010b52
 2020-10-30 16:17:55 +02:00
Caleb Case
be84616e69
Update to uplink v1.3.1 
Change-Id: Iae1e6a63c00d07fee9047638ddc9a414780ce0e9
 2020-10-14 09:39:29 -04:00
Egon Elbre
2f4bb114d4 go.mod: bump common to remove sha256-simd 
Change-Id: I77aeb3b4bea87e8d5bb83b05e86b61a80a695f2a
 2020-10-14 12:47:37 +03:00
Caleb Case
cf1748158a
Bump Dependencies 
Change-Id: I4c8a4438e74379a490a19f1f88ea9dac7715dbbd
 2020-10-09 09:33:49 -04:00
Yingrong Zhao
f13084983d bump common to latest 
Change-Id: I55ca40a7b2c58d70225da07b7a62d5ad60451881
 2020-10-01 15:39:09 -04:00
Yingrong Zhao
c085a17a52 bump common and uplink to latest 
Change-Id: I717f0214dd9973acd51b7732c5d64587f610c805
 2020-10-01 15:38:58 +00:00
Egon Elbre
139ff3427b go.mod: bump dependencies 
Change-Id: I2b1bf014a60ef6ddc4b1b546f58393c34ffe22fc
 2020-09-30 11:28:37 +03:00
Egon Elbre
c23a8e3b81 go.mod: update pgx to v4.9.0 
Fix query to use TextArray instead of VarcharArray.
Fix queries to use the correct type.

Change-Id: Ibb7e55adba277d05778118d81ca697470e72c374
 2020-09-29 19:03:08 +00:00
Kaloyan Raev
b409b53f7f cmd/satellite: command for verifying piece hashes 
Jira: https://storjlabs.atlassian.net/browse/PG-69

There are a number of segments with piece_hashes_verified = false in
their metadata) on US-Central-1, Europe-West-1, and Asia-East-1
satellites. Most probably, this happened due to a bug we had in the
past. We want to verify them before executing the main migration to
metabase. This would simplify the main migration to metabase with one
less issue to think about.

Change-Id: I8831af1a254c560d45bb87d7104e49abd8242236
 2020-09-29 10:58:24 +00:00
Egon Elbre
888bfaae4b cmd/satellite: only add google profiler to satellite 
Previously uplink, storagenode etc. included google cloud profiler,
however they don't need it.

Change-Id: Ibc95cb03d667a3844672eecd49fa455a6acc3866
 2020-09-25 18:56:59 +03:00
JT Olio
1a094fd6da storj: bump storj.io/private 
Change-Id: Ia2927010332bb2e1d140603299341a8549093233
 2020-09-10 16:21:12 -06:00
Egon Elbre
b45cad5eed bump common to latest 
This makes tests pass on Go 1.15.

Change-Id: I8407f16dcfc0b306aa685da30dcfedea6d3b515d
 2020-09-05 10:51:58 +03:00
Yingrong Zhao
cccd62fff9 bump uplink version to v1.3.0 
Change-Id: I9e7833713ca00f19bfb662eeaf61ef57bdc3bbbd
 2020-09-04 09:57:35 -04:00
Yingrong Zhao
af773ec8a6 cmd/uplink: use DeleteBucketWithObjects for bucket force deletion 
This PR updates `uplink rb --force` command to use the new libuplink API
`DeleteBucketWithObjects`.
It also updates `DeleteBucket` endpoint to return a specific error
message when a given bucket has concurrent writes while being deleted.

Change-Id: Ic9593d55b0c27b26cd8966dd1bc8cd1e02a6666e
 2020-09-02 16:39:20 +00:00
Qweder93
36d752e92d storagenode/reputation: offline_under_review_at added 
Change-Id: Ia7ec79b2d6f20fe29de0c36223f9485380d2845c
 2020-09-02 18:48:28 +03:00
Qweder93
7d9897b7af storagenode/nodestats: online_score added 
Change-Id: I84b50a6cace306e5f10d53a2073fe8810d4d2960
 2020-09-02 17:45:01 +03:00
Isaac Hess
ba1a113e2e satellite/metainfo: Add test for GetObjectIPs 
This PR adds the integration test for GetObjectIPs, testing all repos.

Change-Id: Id4d4f19c427a2e320b2a82efa68150fa7f5f86fb
 2020-08-31 10:27:56 -06:00
Cameron Ayer
3e343b683b cmd/segment-reaper: add metrics for zombie segments count 
Change-Id: I106c6795946283165ba3de8465e5898346da1a3f
 2020-08-26 18:42:59 +00:00
Yingrong Zhao
bd5213f68b satellite/metainfo: implement batch delete for DeleteBucket 
This PR changes DeleteBucket to be able to delete all objects within a
bucket if `DeleteAll` is set in `BucketDeleteRequest`.
It also changes `DeleteBucket` API to treat `ErrBucketNotFound` as a
successful delete operation instead of returning an error back to the
client.

Change-Id: I3a22c16224c7894f2d0c2a40ba1ae8717fa1005f
 2020-08-24 13:28:09 +00:00
Isaac Hess
a14887e20b satellite/metainfo: Add GetObjectIPs method 
This adds the unimplemented GetObjectIPs method to metainfo endpoint so
we can import new common protobuf definitions.

Change-Id: I154f26baccb6bb3c66de3eb25611930545c9754b
 2020-08-11 11:39:15 -06:00
Caleb Case
00f9882ad5 bump to uplink v1.2.0 
Also fixup config and related tests for storj.io/common
bee93690ab909580993f402b594ad5a14760c39f

Change-Id: I6897d925cd28b139c1fc2b43e63b08c0cc3fb688
 2020-08-10 17:11:09 +00:00
Qweder93
4ee1b2d45a storagenode/console: added list of all audits per satellite to sno dashboard/satellites 
Change-Id: I52e58748d6467f372d9a308347fc77e400d137e2
 2020-08-10 12:55:07 +00:00
Caleb Case
7735b797c0
Bump dependencies for various fixes. 
Change-Id: I79e4a985aef38f48ef49683eb19ce9dc0b3a2f85
 2020-07-29 11:27:35 -04:00
Jeff Wendling
bdb3a10d39 mod: bump drpc 
Change-Id: I584a2f55a391ce26e9fb1675e9f8a678febe649f
 2020-07-29 14:24:07 +00:00
JT Olio
c89746a383 storagenode: use hardcoded metric application name 
Change-Id: If11f226d03bc4bf70e2465569f8d578750718ae7
 2020-07-28 16:24:15 +00:00
Egon Elbre
1f9ee4a536 mod: bump common 
Update testrand.Metadata to prevent flaky test.

Change-Id: I8085f694403e738e3c6cbd8370945cf2c7dc17d3
 2020-07-23 12:51:16 +00:00
Michal Niewrzal
18b3495248 satellite/metainfo: restore tests disabled to remove StreamID from 
BeginDeleteObject method on uplink side

Change-Id: Id10cdeb367759f9949dc557b291726fd331d38ba
 2020-07-22 13:54:39 +00:00
Jessica Grebenschikov
8abb907010 satellite/orders: add settle orders with window 
Why: We need a way to cut down on database traffic due to bandwidth
measurement and tracking.

What: This changeset is the Satellite side of settling orders in 1 hr windows.
See design doc for more details: https://review.dev.storj.io/c/storj/storj/+/1732

Change-Id: I2e1c151e2e65516ebe1b7f47b7c5f83a3a220b31
 2020-07-13 15:41:29 -07:00
paul cannon
bbdb351e5e all: use jackc/pgx in place of lib/pq 
What:

Use the github.com/jackc/pgx postgresql driver in place of
github.com/lib/pq.

Why:

github.com/lib/pq has some problems with error handling and context
cancellations (i.e. it might even issue queries or DML statements more
than once! see https://github.com/lib/pq/issues/939). The
github.com/jackx/pgx library appears not to have these problems, and
also appears to be better engineered and implemented (in particular, it
doesn't use "exceptions by panic"). It should also give us some
performance improvements in some cases, and even more so if we can use
it directly instead of going through the database/sql layer.

Change-Id: Ia696d220f340a097dee9550a312d37de14ed2044
 2020-07-13 15:54:41 +00:00
Egon Elbre
29ccda5d47 cmd/uplink/cmd: remove spf13/cast dependency 
Change-Id: I8013014b0b37966128e673155d851705ee1d43db
 2020-07-13 11:10:48 +00:00
Qweder93
b639ec08d4 satellite/heldamount: payments added, endpoind for payments added 
Change-Id: Ia2b9580bc353ef614680230c6f82c5bf6ded49c4
 2020-07-01 18:15:01 +03:00
Isaac Hess
4ce1c099b1 satellite/metainfo: Add RevokeAPIKey to batch 
Change-Id: I53b233a5f9f1c8ce7d0bd30e88998f2cdee37762
 2020-06-22 13:50:07 -06:00
Isaac Hess
34b019d16a satellite/metainfo: Handle revocation request 
Logic to handle a request to revoke a macaroon.

Change-Id: I5d5c93fcc2e026b0aaf82bfdfacc822185b10f9f
 2020-06-22 13:50:07 -06:00
Isaac Hess
2d727bb14e satellite: Check macaroon revocation 
When a request comes in on the satellite api and we validate the
macaroon, we now also check if any of the macaroon's tails have been
revoked.

Change-Id: I80ce4312602baf431cfa1b1285f79bed88bb4497
 2020-06-22 13:50:07 -06:00
Egon Elbre
6cc7fd5f31 satellite/metainfo: remove old endpoints 
Change-Id: Ic85c27caeea08879714e8303b285b6136f9a7fd1
 2020-06-16 16:12:14 +03:00
Isaac Hess
05a981bc13 satellite/metainfo: Add RevokeAPIKey stub endpoint 
Change-Id: I07fb997dda48ea204aab11f656a1a37762684339
 2020-06-16 07:03:02 -06:00
Michal Niewrzal
d414f98250 storj: update to uplink v1.1.1 
Change-Id: Ia62f3a84cbca89320714e819fc445606365f0647
 2020-06-16 10:55:07 +00:00
Qweder93
0826c8d87f satellite/heldamount: fix dimension of usage_at_rest 
Change-Id: If1518ad41736912d15fb2c882c9e236c16f85a51
 2020-06-11 13:07:51 +00:00
stefanbenten
dfeb4dc9c2 satellite/payments: add finalize invoice command 
Change-Id: Ib74dc8fd352e9576a302f5923439f5e50f69c9f0
 2020-06-10 14:48:05 +00:00
Qweder93
e52809d53e cmd/storagenode: add check if satellites available to gracefulexit 
Change-Id: I8747507593d810bbdec0d140de0600ee147011c3
 2020-06-10 13:38:36 +00:00
JT Olio
d9b1c4520e storagenode-updater: fix logic to use minimum version correctly 
See:
  https://review.dev.storj.io/c/storj/storj/+/2052
  https://review.dev.storj.io/c/storj/private/+/2053

Change-Id: I30952c6e3893194ca876c12ecb7e53944e66aa2e
 2020-06-08 17:43:10 +00:00
Egon Elbre
0de1b5fa9f ci: fix golangci-lint failures 
Change-Id: Ia8c4dd03439ce4e3f85890d45255b8ea1c94b50a
 2020-06-05 12:55:35 +00:00
Caleb Case
34ee3ef970
bump uplink to v1.0.7 
Change-Id: Iab4ebded301b00bcf53c6dea012c35ce68eee8ba
 2020-06-04 09:35:55 -04:00
Yingrong Zhao
9d7713cdd0 script/testdata: update tracing agent default address 
Change-Id: I730994f16f135c4b8643a52f4cf499487e4af326
 2020-06-03 23:46:18 +00:00
Egon Elbre
d6c90b7ab5 pkg/macaroon: remove aliased package 
Change-Id: I8b06e9a794d00752948f190623006e1afffdb031
 2020-05-29 13:34:20 +00:00
Caleb Case
2cf4f4d1a1 bump uplink to v1.0.6 
Change-Id: Idcabd742c2bb6394b27466a5244915a6675dbf15
 2020-05-29 13:11:36 +00:00
Michal Niewrzal
84892631c8 private/testplanet: remove old libuplink from testplanet 
Change-Id: Ib1553f84d0b3ae12a5b00382f0f53357b6a273e2
 2020-05-28 13:50:23 +00:00
Egon Elbre
bef84a5f9d storagenode: remove dependency to overlay.NodeDossier 
This is the last dependency from storage node to satellite.

Change-Id: I12f7abb91e84f823ba5af126c6e2979519838612
 2020-05-21 08:37:13 +03:00
Qweder93
49ad90dcd8 storagenode/reputation: unknown_score (unknown_alpha / unknown_alpha+unknown_beta) added to reputation stats, https://storjlabs.atlassian.net/browse/SG-326 
Change-Id: I0b29ad736f7a11c7e57a846b6891f4b40755aa48
 2020-05-20 11:25:14 +00:00
Egon Elbre
ed627144ed all: use DialNodeURL throughout the codebase 
Change-Id: Iaf9ae3aeef7305c937f2660c929744db2d88776c
 2020-05-20 10:36:30 +00:00