Cameron Ayer
4424697d7f
satellite/accounting: refactor live accounting to hold current estimated totals
...
live accounting used to be a cache to store writes before they are picked up during
the tally iteration, after which the cache is cleared. This created a window in which
users could potentially exceed the storage limit. This PR refactors live accounting to
hold current estimations of space used per project. This should also reduce DB load
since we no longer need to query the satellite DB when checking space used for limiting.
The mechanism by which the new live accounting system works is as follows:
During the upload of any segment, the size of that segment is added to its respective
project total in live accounting. At the beginning of the tally iteration we record
the current values in live accounting as `initialLiveTotals`. At the end of the tally
iteration we again record the current totals in live accounting as `latestLiveTotals`.
The metainfo loop observer in tally allows us to get the project totals from what it
observed in metainfo DB which are stored in `tallyProjectTotals`. However, for any
particular segment uploaded during the metainfo loop, the observer may or may not
have seen it. Thus, we take half of the difference between `latestLiveTotals` and
`initialLiveTotals`, and add that to the total that was found during tally and set that
as the new live accounting total.
Initially, live accounting was storing the total stored amount across all nodes rather than
the segment size, which is inconsistent with how we record amounts stored in the project
accounting DB, so we have refactored live accounting to record segment size
Change-Id: Ie48bfdef453428fcdc180b2d781a69d58fd927fb
2020-01-16 10:26:49 -05:00
NikolaiYurchenko
224025d714
web/satellite: password recovery page title fixed
...
Change-Id: I4e070315ec2e5f0b7ff0140f93dd6aacf1e68112
2020-01-14 13:34:54 +00:00
crawter
a57ce18f58
satellite/payments: coupons, coupons usage, invoice generation with pricing model applied
...
Change-Id: Ic5d5a2fc116388647efe46896cfccc2038c77537
2020-01-14 12:45:00 +00:00
Yaroslav
0cc7056a9a
satellite/console: convert dates to UTC in advanced usage reports
...
Change-Id: I5c72c869533a7613bffdb8077fdedff2a4e203d0
2020-01-03 14:17:37 +02:00
Egon Elbre
6615ecc9b6
common: separate repository
...
Change-Id: Ibb89c42060450e3839481a7e495bbe3ad940610a
2019-12-27 14:11:15 +02:00
Jessica Grebenschikov
c5116cb2a0
satellitedb: fix migration cockroach test
...
Change-Id: Ie3b4a4b0795d156238d50a58078282cc0918a334
2019-12-16 18:02:31 +00:00
Yaroslav Vorobiov
f659d98a4d
satellite/payments/tokens: return checkout url on new deposit ( #3696 )
2019-12-12 15:09:19 +02:00
Yaroslav Vorobiov
77839dd41b
satellite/console: project usage limits api ( #3702 )
2019-12-12 14:58:15 +02:00
Nikolai Siedov
5d8d9cd89f
projectLimit error message changed ( #3718 )
2019-12-10 15:54:23 -05:00
Nikolai Siedov
c6776ae6bb
error messages fixed ( #3712 )
2019-12-09 15:20:44 +02:00
Malcolm Bouzi
18a5e614d9
satellite/web: add segmentio plugin ( #3405 )
2019-11-27 11:57:59 -05:00
Yingrong Zhao
79a4fff6c7
satellite/referrals: set up referrals service and http endpoints ( #3566 )
2019-11-25 16:36:36 -05:00
Nikolai Siedov
e5934cc92a
satellite/console/auth: return in error handle added ( #3639 )
2019-11-22 21:44:57 +02:00
Nikolai Siedov
ded7f6e2eb
web/satellite: registration/welcome message fixed, usage-report url fixed, storj-sim fixed ( #3622 )
2019-11-22 19:03:15 +02:00
Matt Robinson
976881f72b
satellite/console: Add security headers ( #3615 )
...
* satellite/console: Add X-Frame-Options and Referrer-Policy security headers
* Update to use CSP instead of XFO and include tardigrade.io
* Make FrameAncestors a config option
* Update satellite-config lock
* Make help text for FrameAncestors better
2019-11-21 11:15:22 -05:00
Yaroslav Vorobiov
87c7a2ff42
satellite/payments: token deposit accept cents ( #3628 )
2019-11-21 16:25:37 +02:00
Yehor Butko
9ca547acb1
web/satellite: project charges ( #3611 )
2019-11-20 15:46:22 +02:00
Nikolai Siedov
24318d74b3
storagenode/console: show satellite url in satellite selection ( #3602 )
2019-11-19 14:16:56 +02:00
Nikolai Siedov
3fe518d547
satellite: added ability to inject stripe public key post build ( #3560 )
2019-11-18 13:38:43 +02:00
Yehor Butko
a8e4e9cb03
satellite/payments: project usage charges ( #3512 )
2019-11-15 16:27:44 +02:00
Egon Elbre
ee6c1cac8a
private: rename internal to private ( #3573 )
2019-11-14 21:46:15 +02:00
Egon Elbre
1e64006e32
lint: add staticcheck as a separate step ( #3569 )
2019-11-14 10:31:30 +02:00
Nikolai Siedov
9797f8c49b
satellite/console: service error types added, error handling fixed ( #3538 )
2019-11-12 15:14:31 +02:00
Nikolai Siedov
70c7ee842e
satellite: adding proper headers to api responses ( #3489 )
2019-11-12 15:05:35 +02:00
Nikolai Siedov
c1ae8c332f
satellite/console: auth API error handling refactored ( #3540 )
2019-11-12 13:53:00 +02:00
Yaroslav Vorobiov
36311a3a05
satellite/console: add token deposit API, populate billing history with transactions ( #3500 )
2019-11-12 13:14:34 +02:00
Egon Elbre
23c556ae15
satellite/rewards: fixes from review comments ( #3495 )
2019-11-06 20:37:53 +02:00
Nikolay Yurchenko
e6c7b8180c
web/satellite: tabs title change ( #3496 )
2019-11-06 14:27:26 +02:00
Yaroslav Vorobiov
0b32690d0a
satellite/peer: add payments config ( #3488 )
...
* satellite/peer: add payments config
* remove stripe-key from console config
* update config lock
* fix imports
* fix config-lock
2019-11-05 21:26:19 +01:00
Yaroslav Vorobiov
35edc2bcc3
satellite/payments: invoice creation ( #3468 )
2019-11-05 15:16:02 +02:00
Egon Elbre
9c59efd33d
satellite/rewards: ensure that partner information is asked from a service ( #3275 )
2019-11-05 14:58:09 +02:00
Nikolai Siedov
1a0757ebf7
web/satellite: auth error messages fixed ( #3426 )
2019-11-05 13:55:26 +02:00
Nikolai Siedov
8ce09700af
web/satellite: internal server error template added, errors separated ( #3430 )
2019-10-31 20:42:28 +02:00
Yehor Butko
ecde507e4e
satellite/payments: list invoices ( #3389 )
2019-10-31 18:56:54 +02:00
Nikolai Siedov
6354b38849
web/satellite: auth graphql api replaced with REST API ( #3396 )
2019-10-29 16:24:16 +02:00
Nikolai Siedov
f4f142bf3e
satellite/console: get, update auth api endpoints added ( #3375 )
2019-10-25 15:07:17 +03:00
Yehor Butko
e82245e10e
satellite/payments: credit card selection ( #3304 )
2019-10-23 20:33:24 +03:00
Nikolai Siedov
655e2b3422
sattelite/console: sattellite name API endpoint added ( #3349 )
2019-10-23 18:36:58 +03:00
Yaroslav Vorobiov
1a304f5ef9
satellite/payments: add payments loop, update pending transactions ( #3318 )
2019-10-23 15:04:54 +03:00
Nikolai Siedov
3eec4e9070
satellite/console: add REST delete API endpoint ( #3337 )
2019-10-22 19:17:09 +03:00
Vitalii Shpital
867771787f
web/satellite: project owner status added on team page ( #3160 )
2019-10-22 14:12:49 +03:00
Nikolai Siedov
6dd478e43c
satellite/console: forgot password, resend email endpoints added, default http route replaced with gorilla mux ( #3327 )
2019-10-21 19:42:49 +03:00
Nikolai Siedov
1814fbfa89
satellite/console: new passwordChange API endpoint ( #3308 )
2019-10-21 15:48:29 +03:00
Nikolai Siedov
f4162bd33f
satellite/console: add REST registration API endpoint ( #3303 )
2019-10-17 19:34:27 +03:00
Yehor Butko
26cc625dc6
satellite/console: payments api ( #3297 )
2019-10-17 17:42:18 +03:00
Nikolai Siedov
c1033fc1ed
satellite/console: move token to separate endpoint ( #3292 )
2019-10-16 18:01:15 +03:00
Bogdan Artemenko
ed3a424858
satellite/console: Removed 'user not found' message on password reset request ( #3184 )
2019-10-09 13:18:58 +03:00
Nikolay Yurchenko
51003dcad2
web/satellie: added missing alt attribute to img tags ( #3172 )
2019-10-04 16:22:26 +03:00
Yaroslav Vorobiov
f05a2eea5b
satellite/console: remove domain prefix from token cookie key ( #3170 )
2019-10-04 10:23:52 +03:00
Bogdan Artemenko
423d35fb3f
satellite/console: Added support URLs and other fields to config file ( #3090 )
2019-09-27 10:48:53 -06:00
