JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6,742 Commits 5 Branches 0 Tags 94 MiB
78fa0c11a3
Commit Graph

118 Commits

Author SHA1 Message Date
Egon Elbre
05e165283f storagenode/console/consoleapi: use fixed time.Now() 
It seems the tests relied on time.Now(), which might cause some
discrepancies in calculations. Use a fixed time.Now() rather than
recalculating.

As a sidefix, remove "Test" prefix from t.Run. These are unnecessary.

Change-Id: I1de903fcf0fcf46fc8e3acf2463e17239b8e3cc6
 2022-07-01 12:36:01 +03:00
Egon Elbre
dc0f7b5f77 storagenode,web/storagenode: use go:embed for assets 
Go can now directly embed files without relying on external tools.
This makes code use go:embed and avoid the external tooling.

go:embed requires files to be present in the embedded directory,
hence we need to add .keep to "dist" folder. We also add one to
public/.keep, such that it won't be deleted when building storagenode.

Change-Id: I8bef81236be6829ed37ed4c16ef693677b93a631
 2022-03-11 16:01:28 +02:00
Egon Elbre
5f7ea1358d private/web: make caching headers reusable 
Move storagnode/console caching headers to private/web. Also,
start using them in multinode/console/server.

Change-Id: I1f0f3c9833a183476009737cece515ae7537fb83
 2022-03-11 11:19:11 +02:00
Clement Sam
8b40a071a0 storagenode: check if QUIC is properly configured 
This change adds a check to confirm if UDP port if properly configured for QUIC

Resolves https://github.com/storj/storj/issues/4332
Partly resolves https://github.com/storj/storj/issues/4358

Change-Id: I9a66f26a115e48b4fcd168f50a7d0b4d81712f4e
 2022-01-20 12:04:04 +00:00
Clement Sam
589c82f23e storagenode: display quic status on SNO dashboard 
This change includes storagenode QUIC status on SNO dashboard.
If disabled, it displays warning for SNOs to foward their
UDP port for quic.

Change-Id: I8d28c9c0f5f1e90d80b7c18b9e1e7b78c5e45609
 2021-12-23 12:22:24 +00:00
Qweder93
4d0fe39235 storagenode/satellites: address added, caching satellite's addresses from trust 
Change-Id: Ica3eea5b8d81b176c6a4385fea803730b08ece16
 2021-07-08 15:38:23 +00:00
Egon Elbre
10372afbe4 ci: fix lint errors 
Change-Id: Ib5893440807811f77175ccd347aa3f8ca9cccbdf
 2021-05-17 13:37:31 +00:00
Qweder93
a11698f370 multinode/payouts: estimated payouts added 
estimated payouts for specific/all satellites added.

Change-Id: I2530c9f1775593588e2a8f6c087ce6b4f9e354c4
 2021-05-11 11:33:32 +00:00
Egon Elbre
961e841bd7 all: fix error naming 
errs.Class should not contain "error" in the name, since that causes a
lot of stutter in the error logs. As an example a log line could end up
looking like:

    ERROR node stats service error: satellitedbs error: node stats database error: no rows

Whereas something like:

    ERROR nodestats service: satellitedbs: nodestatsdb: no rows

Would contain all the necessary information without the stutter.

Change-Id: I7b7cb7e592ebab4bcfadc1eef11122584d2b20e0
 2021-04-29 15:38:21 +03:00
Qweder93
866a3e3ad3 storagenode/console: estimated payout tests fix 
Added check if days paste <1 and node joined in current month -> days paste = 1

Change-Id: Ice1ccd6c869f629a87da585850b9b4f3729ec65c
 2021-03-24 18:05:37 +02:00
NickolaiYurchenko
034eb2c214 storagenode: wallet features 
WHAT: updated dashboard type to return wallet features from storagenode api

Change-Id: Ifdbdeae8b9ae239eaebe32d0a093557154f777ad
 2021-03-24 09:08:36 +00:00
Qweder93
0b060c8297 storagenode/console: estimated payout flaky test skip 
Change-Id: Ibb20b5716df94f9430026ed697d57b6be9cc137d
 2021-03-15 15:26:47 +02:00
Qweder93
487ad84b23 storagenode:consoleAPI flacky tests for estimatedPayout fixed 
joinedAt date now is 2 months before time.Now which should fix calculations on early dates.

Change-Id: I6250ec2463c2dd609e811b74d908a02a3e64f19a
 2021-03-13 20:33:25 +02:00
Moby von Briesen
0370d1553e storagenode/console: Fix TestStorageNodeApi flakiness 
TestStorageNodeApi is failing due to very slight differences in
float values. This change rounds these values to 3 decimal places before
comparing them.

Change-Id: Ic7fae3a5e0a0a942c03d982bfa7b19357f2e3d2e
 2021-02-26 15:12:35 -05:00
Qweder93
f2be856864 storagenode/payouts: estimated payouts calculations upgraded 
Added recalculations of estimated income in current month in case
node joined in current month

Change-Id: Iac925fd8bcf2be8f1089e5f001a01448ba7650be
 2021-02-25 14:11:44 +00:00
NickolaiYurchenko
badd6d12d4 web/satellite: distributed amount added to tables, content changed 
Change-Id: Ib0eb3fa3f4f9d451f4b4048a6409d19968a41956
 2021-02-24 16:01:40 +00:00
Jeff Wendling
3eb321fd33 storagenode/console/consoleapi: fix flaky test 
Change-Id: I1af928953a19155e3c2e9f8c63e7162978e7b475
 2021-02-17 19:48:55 +00:00
Egon Elbre
5d895fb404 storagenode/{payouts,console}: use same time for all calculations 
When using calling time.Now() multiple times, they can cross
month boundary causing errors in calculations.

Change-Id: I66b5be7598f3bf475b4b5fe0dcce82eee55b3134
 2021-02-01 13:59:50 +02:00
Qweder93
6ba8f6c8a9 storanode, satellite: payout renamed to payouts, expected estimation payouts added, console api for audits reworked 
Change-Id: I4aa5e99bffaa87d0a800a429a4c83aa498ad4b7b
 2021-01-18 10:56:03 +00:00
Moby von Briesen
710b86849c storagenode/{console, reputation}: Add audit history to storagenode API 
Change-Id: Id680b07feea380824e56496d545f46a94fdcc5d5
 2021-01-04 17:37:45 +00:00
Qweder93
2fd7809e54 storagenode/payout: stefanbenten satellite name added to payout history, satellites with no held history removed from list 
Change-Id: I96861058ccb9c8ce52698796c91b999eaec1f6e6
 2020-12-17 11:01:28 +00:00
Qweder93
12144a600b storagenode/console: payout tests and heldhistory joined_at rounding added 
Change-Id: I1d43620fbafbf7ed92588b84cb9c6b8ced8832ef
 2020-12-14 19:35:04 +02:00
Qweder93
2f62cdf491 storagenode/console: diskSpaceInfo extended with overused diskspace, getDashboardData updated. 
Change-Id: I44db26661a8dfb45b5d8e9fcb7511f63deb88cad
 2020-12-08 14:55:55 +00:00
Qweder93
8dc10e32ad stefan benten satellited added to historical payout data 
Change-Id: I1177b2d2ef10d514f7d401e29891fa7dd964e9ac
 2020-11-09 15:43:41 +00:00
Moby von Briesen
aa86c0889c storagenode/console: Add current storage used per satellite to storagenode api 
Right now, the best way for a storage node operator to get the current
space used for each satellite is to run the `storagenode exit-satellite`
command for graceful exit, and cancel at the second confirmation prompt.
This is convoluted and the data is readily available from the Blobs
Usage Cache.

This change adds the current space used by each satellite to the
endpoints `/api/sno` and `/api/sno/satellite/<Satellite ID>`

Change-Id: I2173005bb016fc76db96fd598d26b485e5b2aa0b
 2020-10-14 21:30:28 +00:00
Qweder93
245986d528 negative space calculations fix removed 
Change-Id: I342c61856fce6d02dc99fd27fd3d563540f22b64
 2020-09-30 14:08:24 +00:00
Michal Niewrzal
cd2a5484f3 storagenode/console: ignore untrusted satellite while returning 
dashboard data and calculating satellites data

Change-Id: I71d596891477e0839863e007689b6e2e6e420a22
 2020-09-29 18:27:49 +00:00
Qweder93
8182fdad0b storagenode: heldamount renamed to payouts, renamed some methods and structs to more meaningful names. grouped estimated payout with pathouts 
satellite: heldamount renamed to SNOpayouts.

Change-Id: I244b4d2454e0621f4b8e22d3c0d3e602c0bbcb02
 2020-09-16 14:57:35 +00:00
Qweder93
ac29d80495 storagenode: heldamount GetPaystub refactored, estimationPayouts logic separated form console to separate service, storagenodeapi tests fixed. 
Change-Id: I902823ef40a62861ce32799e9fb7a67a1e14710d
 2020-09-09 15:31:16 +00:00
Qweder93
7d9897b7af storagenode/nodestats: online_score added 
Change-Id: I84b50a6cace306e5f10d53a2073fe8810d4d2960
 2020-09-02 17:45:01 +03:00
Qweder93
c4a4745dd8 storagenode/console: audit per satellite now uses satelliteName instead of satelliteID 
Change-Id: I8221ec840f654a62aedfb62a4194616db890f539
 2020-08-25 12:52:47 +00:00
Qweder93
f16cf5cccf storagenode/console & /inspector: added recalculation of disk space info 
Change-Id: Id003d031a6464ec095c31290fd6a756ead644261
 2020-08-25 14:19:10 +03:00
Qweder93
4ee1b2d45a storagenode/console: added list of all audits per satellite to sno dashboard/satellites 
Change-Id: I52e58748d6467f372d9a308347fc77e400d137e2
 2020-08-10 12:55:07 +00:00
Qweder93
b4c9badab1 storagenode/console: estimation payout fix 
Change-Id: I5d9f11fffd74978f3ca684fd08aac44a27a83c71
 2020-07-27 21:41:07 +03:00
Qweder93
f531bc8638 storagenode/heldamount payout-history rout fix, usage_at_rest in estimation payout calculations fixed 
Change-Id: I6f819a404a45b2a96c1aae33c67ebea1ab83aef0
 2020-07-24 15:19:45 +00:00
Qweder93
0949731caa storagenode/console: estimation payout held split from total payout, calculations fixed 
Change-Id: I064f473ffeb3a3051c9228d1dd84fe0fc86dd3ef
 2020-07-21 15:31:51 +03:00
Egon Elbre
080ba47a06 all: fix dots 
Change-Id: I6a419c62700c568254ff67ae5b73efed2fc98aa2
 2020-07-16 14:58:28 +00:00
Qweder93
62fec25104 storagenode/heldamount: returns usage_at_rest in tbm instead of tbh 
Change-Id: I183a56460ea76a53680ca6861d02cecebe3576ec
 2020-07-15 15:46:13 +03:00
Qweder93
7b4a8c4d6d storagenode/heldamount: payoutHistory added 
Change-Id: I93dd3d024085d19ecff76075e52bf66796207fd6
 2020-07-14 17:35:03 +03:00
Egon Elbre
262da14359 storagenode/console/consoleapi: disable flaky TestStorageNodeApi 
Change-Id: I076c9a46fece86d34eae117ab84f94f99e7e64e0
 2020-07-13 18:35:38 +03:00
Qweder93
e17243fcd7 storagenode/console: estimation payour for current and previous month reworked 
Change-Id: I937d5d8f7c17949b539dcd6e36af27400a5043e2
 2020-07-10 12:18:53 +00:00
Bill Thorp
a3c902ab84 storagenode/pieces: hours in a month should be 720 
Per https://documentation.tardigrade.io/pricing/billing-and-payment:
"The calculation of per object fees is based on a standard 720-hour month."

On most years, the average value is 730 (365*24/12), except leap years.
However, we want to have ours be 720 (30*24) so its lines up with days.

Change-Id: Ifb9691878f1a7ea81ed36c92b37985493295fe31
 2020-07-07 15:26:15 -04:00
Qweder93
ac716e1514 storagenode/heldamount: payment receipt added to monthly paystub, heldamount.service separated for service and endpoint 
Change-Id: Id759586c6362edbef34c230d4f0d2585c11c9b47
 2020-07-06 09:51:52 +00:00
NickolaiYurchenko
b878fcc4b2 storagenode/heldamount: id removed from satellite name 
Change-Id: Ic524a40930a5fe7673ccce817d6f68c3538e5208
 2020-07-01 15:38:05 +03:00
Qweder93
9a02149654 storagenode/heladamount: held history extended with joined_at date, total_held and total_disposed amounts 
Change-Id: I41fe9ab8c5667aa988257a94848ea70225305d79
 2020-06-30 13:33:25 +00:00
Qweder93
7f8e553022 console/dashboard: added pieces headers size to calculations 
Change-Id: I0ee8d6bcb9ce9f69d49ebac2b95579166389668e
 2020-06-04 16:39:02 +00:00
Egon Elbre
07050eea26 all: use common/storj 
Change-Id: Id1e36d52f9807b5ffbb72ce73f4b60cb21b68a78
 2020-05-29 11:57:32 +03:00
Qweder93
73214c6d1c storagenode/heldamount: heldhistory reworked to all satellites 
Change-Id: I8d7707fddfbdc52d29951a8a002978c7fbb07049
 2020-05-28 11:44:26 +00:00
Qweder93
8db848791f storagenode/console: added estimated payout for current month and estimated pay stub for previous month (until there's real data in satellite's table) + heldback percentage rate for previous month. 
Change-Id: I9346f6d22ed6fbb7e5346b102fc898467678f384
 2020-05-27 14:51:23 +03:00
Egon Elbre
bef84a5f9d storagenode: remove dependency to overlay.NodeDossier 
This is the last dependency from storage node to satellite.

Change-Id: I12f7abb91e84f823ba5af126c6e2979519838612
 2020-05-21 08:37:13 +03:00