JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,779 Commits 5 Branches 0 Tags 94 MiB
68946c86b4
Commit Graph

3779 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jeff Wendling
7baa59753a satellite/orders: add tests for double sending the same order 
Change-Id: If2fa7f035257df3b04f506f81aa8b2e0916f5033
 2020-03-17 14:18:03 +00:00
VitaliiShpital
2cd5eb7dac web/satellite: navigation side bar reworked 
Change-Id: I72af3d825febf172d5a4a32a1d71b52dae152e59
 2020-03-17 13:47:18 +00:00
Egon Elbre
ad9cac3084 satellite/metainfo: reduce test flakiness 
Change-Id: I6be930f6dce2186b1575ca470cb893cc0dc5e4ce
 2020-03-17 11:54:34 +02:00
Egon Elbre
22ea0c7c1a satellite/metainfo/piecedeletion: add Dialer 
This adds a piece deletion handler that has debounce for failed dialing
and batching multiple jobs into a single request.

Change-Id: If64021bebb2faae7f3e6bdcceef705aed41e7d7b
 2020-03-16 23:36:01 +00:00
Ethan
bdbf764b86 satellite/orders;overlay: Consolidate order limit storage node lookups into 1 query. 
https: //storjlabs.atlassian.net/browse/SM-449
Change-Id: Idc62cc2978fba67cf48f7c98b27b0f996f9c58ac
 2020-03-16 23:15:47 +00:00
Stefan Benten
49a30ce4a7
satellite/payments: Set proper defaults for the release (#3806) 
* Slight adjustments to the migration

Change-Id: I68ae81c010c3414fde2845df16ab124f8d17834b

* Change Coupon Value

Change-Id: I0f241d09e5f716f1d1b3f0688643ba7f614d83c4

* Change AlphaUsage to 5GB

Change-Id: I5d25c6b5750684510cda8b14a27f38d5b2b07408

* change config lock

Change-Id: Ib7c7a54555ba2387c9aa8dd60a0501b0ee6491dd

* Use Scan properly

Change-Id: Ie39cf4644e3ddd703a254e2f5e616763dd805235

* Fix Config Lock

Change-Id: I558ecc1c1becfaaefc7aea5ad2fe83fd6bf6b561
 2020-03-16 22:53:12 +01:00
Moby von Briesen
8b72181a1f satellite/{audit,overlay,satellitedb}: implement unknown audit reputation and suspension 
* change overlay.UpdateStats to allow a third audit outcome. Now it can
handle successful, failed, and unknown audits.
* when "unknown audit reputation"
(unknownAuditAlpha/(unknownAuditAlpha+unknownAuditBeta)) falls below the
DQ threshold, put node into suspension.
* when unknown audit reputation goes above the DQ threshold, remove node
from suspension.
* record unknown audits from audit reporter.
* add basic tests around unknown audits and suspension.

Change-Id: I125f06f3af52e8a29ba48dc19361821a9ff1daa1
 2020-03-16 20:29:26 +00:00
Stefan Benten
52590197c2
satellite/payments: More Cleanup and Satellite command to ensure we have stripe customers (#3805) 2020-03-16 20:34:15 +01:00
Egon Elbre
3d6518081a satellite/metainfo/piecedeletion: add Combiner 
To handle concurrent deletion requests we need to combine them into a
single request.

To implement this we introduces few concurrency ideas:

* Combiner, which takes a node id and a Job and handles combining
  multiple requests to a single batch.

* Job, which represents deleting of multiple piece ids with a
  notification mechanism to the caller.

* Queue, which provides communication from Combiner to Handler.
  It can limit the number of requests per work queue.

* Handler, which takes an active Queue and processes it until it has
  consumed all the jobs.
  It can provide limits to handling concurrency.

Change-Id: I3299325534abad4bae66969ffa16c6ed95d5574f
 2020-03-16 17:13:26 +00:00
VitaliiShpital
97df9b5704 web/satellite: new project popup reworked 
Change-Id: I90c14bed222824231a5f41bc7029d38cb405863e
 2020-03-16 16:06:10 +00:00
VitaliiShpital
dedb87a6dd web/satellite: billing periods logic implemented on billing page 
Change-Id: Ia762f50e0b700fe17258efcd255c16d635edd003
 2020-03-16 15:46:44 +00:00
Qweder93
5dc1b7db90 storagenode/cache heldamount disabled 
Change-Id: If81a19ba196b10d2bcac6e2850c8d07edb9a85b5
 2020-03-16 15:20:56 +00:00
VitaliiShpital
54dbc5173d web/satellite: limits info bar added to billing page, free credit amount changed 
Change-Id: I08f52e5dab16f5d176a909b29952718891f406d5
 2020-03-16 14:54:46 +00:00
Kaloyan Raev
27f811a9e1 metainfo: delete methods return the deleted item 
This only happens if Read or List permission is granted together with
the Delete permission

Change-Id: I68b5f04a476bddabe499809ac98097aac75732a8
 2020-03-16 16:26:16 +02:00
Kaloyan Raev
4f0bf3fe1d
build: cleanup more gateway targets from Makefile (#3802) 
Change-Id: Ia95caa2187b3e9e056a83cbea4230788ed4e8abd

Co-authored-by: Michal Niewrzal <michal@storj.io>
 2020-03-16 15:07:52 +01:00
Matt Robinson
44ade00e8a
Add inspector to satellite image (#3801) 
Change-Id: I77f0a5397bc4073d3e46d759e2e99eb908b175c6

Co-authored-by: Stefan Benten <mail@stefan-benten.de>
Co-authored-by: littleskunk <jens.heimbuerge@googlemail.com>
 2020-03-16 09:05:59 -04:00
NickolaiYurchenko
135fa7500e web/storagenode: pages align fix 
Change-Id: Ic32f22560d3dc18262701db11e25e270b65bd0bd
 2020-03-16 05:02:58 +02:00
crawter
f12b6dc27e storagenode/console/api: monthly payStub api extended 
Change-Id: I816aeb01ea1338372e3a5f07a11dfdc0ffe20393
 2020-03-16 03:39:08 +02:00
crawter
89374e260d storagenode/console/consoleapi: using cached data in heldamount api 
Change-Id: I0efca320eaf722ade1146100bbb0e70d75a5dca3
 2020-03-16 01:39:11 +02:00
Qweder93
9f84261c36 storagenode/cache heldamount added 
Change-Id: I7fc807789de63e8a9b8ca2018fd73bdb9e01ad0d
 2020-03-16 00:28:35 +02:00
NickolaiYurchenko
3a1b71a757 web/storagenode: payout info month range selection logic 
Change-Id: Ibb8ab24475212bed5fe8790a317f2d9f4e4105dd
 2020-03-15 22:24:14 +02:00
crawter
0c18ecf32e storagenode/api refactored 
Change-Id: Icfd6ded7a21b3803411688a0a34b0c80b44e756f
 2020-03-15 20:30:23 +02:00
crawter
45507d285b storagenode/storagenodedb: heldamount tests added 
Change-Id: I862b0b38349a11254426855ffafb1f2f0845cb4c
 2020-03-15 14:55:11 +00:00
Qweder93
94c4d1e737 satellite/satellitedb/heldamount added, endpoint added 
Change-Id: Ife8402b89f631f65ebb5cdf5ca02e99aa9b0b3ff
 2020-03-13 18:15:52 +00:00
Qweder93
988bb52855 storagenode/heldamount GetPayment added, console/server updated 
Change-Id: I51ebe69f9dc7920e59e91d7ba26617ee61889f78
 2020-03-13 17:37:44 +00:00
Qweder93
7b0371e9e2 storagenode/heldamount/service added, console/heldamountapi added, console/server updated 
Change-Id: I6290a6ea1b07b222908440defbbd7aec5f2a4cdf
 2020-03-13 19:18:03 +02:00
Qweder93
5ccce04338 storagenode/storagenodedb: heldamount added 
Change-Id: I213e3abffd7356bbfccb3f33bcbafa558674b8d9
 2020-03-13 16:23:59 +00:00
Stefan Benten
bd603c0751
satellite/payments: Improve Invoice Generation (#3800) 2020-03-13 17:07:39 +01:00
Bill Thorp
94c11c5212 satellite: remove some unnecessary UTC() calls 
Fixes some easy cases of extraneous UTC() calls

Change-Id: I3f4c287ae622a455b9a492a8892a699e0710ca9a
 2020-03-13 13:49:44 +00:00
NickolaiYurchenko
6e79d1c206 web/storagenode: charts swap due to bandwidth bar info deletion 
Change-Id: I91593de272066bce6c9739fff666766e3466b079
 2020-03-13 12:01:40 +00:00
Jeff Wendling
41887883f3 satellite/satellitedb: check indexes on migration 
Change-Id: I5ba7ae2b512d77c70405ce332158f12128e27eed
 2020-03-13 10:45:22 +00:00
Isaac Hess
85b6316ce8 statreceiver: Update to filter on packet headers 
The admission/v3 protocol now supports arbitrary key/value headers to be
included in each packet of metrics. This commit creates support for
this, so the lua config file can declare a filter taking into account
the key/value headers.

Change-Id: I41de8c018d33304ccf46ec221ae689d55c5fb1ee
 2020-03-12 13:57:07 -06:00
Jess G
39cb821196
satellite/overlay: rm combinedcache, fix IP naming to be network (#3798) 
* rn combinedcache, rm dns node lookup

Change-Id: I239f07211764b097d851230d8c81900a47756e9e

* excludeIPs -> excludedNetworks

Change-Id: Ifa6f44ab17457cdd5aff4cd5694296867c18b179

* use lowercase var name

Change-Id: I825aad2b718c71f455e747be18f8cabd02aabe55

* update Getnetwork name

Change-Id: I002a1b7bc6b4ef40159c0cd2b0ef209f80a9c503

* fix comments

Change-Id: Ibddf5b9ffa9d685af6c392d893db063ef18e45fa

* update comments with ipv6

Change-Id: I31758b7d4979e7c27d014668f4fb532ad838cda2

Co-authored-by: Stefan Benten <mail@stefan-benten.de>
 2020-03-12 11:37:57 -07:00
Yingrong Zhao
3cf05b24d8 scripts: add benchmark test for delete operation 
Change-Id: I448cc50375c1c712d704d8cf93f5b8481372b0c8
 2020-03-12 17:03:19 +00:00
NickolaiYurchenko
176d643360 web/storagenode: payments markup 
Change-Id: Ifb65f126408e9593febff153f88abf0aa3644b79
 2020-03-12 16:16:41 +00:00
VitaliiShpital
7f0a6c9eef web/satellite: project creation tests extended 
Change-Id: Ib73b2d556952a6690d3e783e0f15dc16aa51caf7
 2020-03-12 15:14:34 +00:00
Isaac Hess
8e274a5ce4 cmd/uplink: Enable telemetry on ctx 
Change-Id: I26ffbbb72b9f2ca71b629ba12637c74c2aa072c3
 2020-03-12 14:52:40 +00:00
NickolaiYurchenko
202b12d210 web/storagenode: dashboard styles adaptation 
Change-Id: I9ffe8bbb210b5369143e9224aae9f9e485f2a342
 2020-03-12 15:28:38 +02:00
littleskunk
02aee17cd9
accounting/projectlimit: reset at the beginning of the month (#3796) 
Co-authored-by: Stefan Benten <mail@stefan-benten.de>
 2020-03-11 23:00:58 +01:00
Kaloyan Raev
ce1ae134a0 build: don't push gateway docker images 
This is now done from the new storj/gateway repo by another Jenkins job.
Ideally, we should remove everything related to the gateway from this
Makefile, but we cannot do it at the moment due to an all-on-one test
that depends on the gateway.

Change-Id: Ibc722bcee20c9f58b4864583ee3245455b45c7ba
 2020-03-11 18:41:19 +00:00
VitaliiShpital
1b5b153fb7 web/satellite: adding payment method flow reworked, animations added 
Change-Id: I57433cf17fa12442c8ddcc74a9854a3d5dd24ea9
 2020-03-11 18:12:32 +00:00
JT Olio
051569c69f
satellite: enable open registration (and add flag that disables it) SM-441 
Change-Id: I47bfedb312089f6d2bfbab013bd74ad4b8aa5f5e
 2020-03-11 03:53:34 +01:00
Jessica Grebenschikov
803e2930f4 satellite: use IP for all uplink operations, use hostname for audit and repairs 
My understanding is that the nodes table has the following fields:
- `address` field which can be a hostname or an IP
- `last_net` field that is the /24 subnet of the IP resolved from the address

This PR does the following:
1) add back the `last_ip` field to the nodes table
2) for uplink operations remove the calls that the satellite makes to `lookupNodeAddress` (which makes the DNS calls to resolve the IP from the hostname) and instead use the data stored in the nodes table `last_ip` field. This means that the IP that the satellite sends to the uplink for the storage nodes could be approx 1 hr stale. In the short term this is fine, next we will be adding changes so that the storage node pushes any IP changes to the satellite in real time.
3) use the address field for repair and audit since we want them to still make DNS calls to confirm the IP is up to date
4) try to reduce confusion about hostname, ip, subnet, and address in the code base

Change-Id: I96ce0d8bb78303f82483d0701bc79544b74057ac
 2020-03-11 09:11:40 -07:00
Jennifer Johnson
140e2f0045 web/storagenode/src: removes references to available and remaining bandwidth 
Change-Id: I3945a94ddd6d80d0282f65e5e9939952e39ba571
 2020-03-11 14:17:33 +00:00
Yingrong Zhao
1a875baa1d scripts/tests: fix arguments orders passed to test-versions.sh 
Change-Id: I2e3b501477823413137f6a43fcdc4347af27e43c
 2020-03-11 13:50:18 +00:00
JT Olio
520b16e824 satellite/console: allow for project limits even with open registration 
Change-Id: I4d2528880638882ab8c427bd926e0c4f4b0a5bab
 2020-03-11 12:56:55 +00:00
littleskunk
7aa30d2f06
accounting/projectlimit: remove expansion factor (#3795) 
Co-authored-by: Ivan Fraixedes <ivan@fraixed.es>
 2020-03-11 11:51:22 +01:00
Ivan Fraixedes
eda8778f48 golangci-lint: Disable ifElseChain go-critic rule 
Disable the ifElseChain rule of the go-critic linter because it isn't of
the taste of Storj.

Change-Id: I26a36d32061c0675e5ec1e4e95e243b2b5af1e46
 2020-03-11 07:36:31 +00:00
Yingrong Zhao
46b04a38cc scripts/tests/: fix uplink access to contain satellite id 
Change-Id: I7dfb6bc2da3bf84a81d75a286ee9488e32ea4f01
 2020-03-10 21:15:39 +00:00
VitaliiShpital
de59e8e124 web/satellite: project creation restricted before adding payment method 
Change-Id: Ifc1f3b05b05bfb22891628892ce8c4f110d76861
 2020-03-10 18:38:08 +00:00