Egon Elbre
5d0816430f
rename all the things ( #2531 )
...
* rename pkg/linksharing to linksharing
* rename pkg/httpserver to linksharing/httpserver
* rename pkg/eestream to uplink/eestream
* rename pkg/stream to uplink/stream
* rename pkg/metainfo/kvmetainfo to uplink/metainfo/kvmetainfo
* rename pkg/auth/signing to pkg/signing
* rename pkg/storage to uplink/storage
* rename pkg/accounting to satellite/accounting
* rename pkg/audit to satellite/audit
* rename pkg/certdb to satellite/certdb
* rename pkg/discovery to satellite/discovery
* rename pkg/overlay to satellite/overlay
* rename pkg/datarepair to satellite/repair
2019-07-28 08:55:36 +03:00
Maximillian von Briesen
906c77b55a
Add RetainStatus to storagenode config ( #2633 )
...
--storage2.retain-status = "disabled" (default), "debug", or "enabled"
2019-07-26 16:49:08 -04:00
paul cannon
b9a17913fa
storagenode/pieces: remove buffering from reading/writing and fix io.EOF bug ( #2554 )
2019-07-25 11:22:15 +03:00
Jess G
353b089927
update testplanet with libuplink ( #2618 )
...
* update testplanet uplink upload with libuplink
* add libuplink to testplanet download
* update createbucket and delete obj with libuplink
* update downloadStream, fix tests
* fix test
* updates for CR comments
2019-07-23 07:58:45 -07:00
Egon Elbre
13dd501042
storagenode/storagenodedb: move tests near the interface rather than the implementation ( #2596 )
2019-07-19 20:40:27 +03:00
Egon Elbre
f6f65a80d7
storagenode/trust: implement fetching peer identity without kademlia and endpoint ( #2584 )
2019-07-17 21:14:44 +03:00
paul cannon
0d1dce508e
ensure uplink is sending correct size with PieceHash ( #2555 )
...
If we verify that the size matches reality, we can then expect to use
the filesystem to store the piece size as used in the signed PieceHash
from the uplink. Otherwise, the uplink might send a garbage size value,
leaving the storagenode with no good way to verify the uplink signature
on the piece at a later date.
Also fix the code in uplink/piecestore/ so that it sends a valid size,
because it was being rude and sending 0.
2019-07-15 11:26:18 -04:00
Egon Elbre
d52f764e54
protocol: implement new piece signing and verification ( #2525 )
2019-07-11 16:51:40 -04:00
Maximillian von Briesen
8b507f3d73
Address concerns with storagenode Retain endpoint ( #2527 )
2019-07-11 16:04:21 -04:00
Jeff Wendling
7886a4d7b9
storagenodedb: use datetime functions in sqlite queries ( #2512 )
...
This way comparison happens on the actual time rather than the
string representation of the time which may change depending on
the time zone.
2019-07-10 10:47:59 -04:00
Fadila
fa1f5c8d7f
garbage collection endpoint on storage node ( #2424 )
2019-07-10 09:41:47 -04:00
Alexander Leitner
1c5db71faf
Change protobuf expirations to use time.Time ( #2509 )
...
* Change protobuf expirations to use time.Time instead of timestamp.Timestamp
2019-07-09 17:54:00 -04:00
Michal Niewrzal
bbc25a2bf7
Drop SN certifiates table from DB ( #2498 )
2019-07-09 17:33:45 -04:00
Jeff Wendling
d616be8ae0
storagenode: use minimum time in the order for expiration ( #2504 )
2019-07-09 17:16:30 -04:00
JT Olio
65aa8f227f
piecestore: pipeline chunks with orders ( #2451 )
2019-07-08 17:26:19 +03:00
Fadila
3f4662598e
storagenode/piecestore: add piece_creation field ( #2441 )
2019-07-08 09:22:36 +02:00
Cameron
d499d162f4
implement storj.NodeURL in trusted satellites ( #2388 )
...
* implement storj.NodeURL in trusted satellites
2019-07-03 13:29:18 -04:00
Michal Niewrzal
61dfa61e3a
Add timestamp and piece size to piece hash ( #2198 )
2019-07-03 18:14:37 +02:00
Egon Elbre
38f3d860a4
storagenode: decline uploads when there are too many live requests ( #2397 )
2019-07-03 16:47:55 +03:00
Alexander Leitner
6d55bbdb57
OrderLimit creation date time limit ( #2412 )
...
* Limit by order creation
2019-07-02 12:06:12 -04:00
Egon Elbre
385c046723
pkg/pb: rename Order2 to Order, OrderLimit2 to OrderLimit ( #2406 )
2019-07-01 18:54:11 +03:00
Egon Elbre
2b68a72428
internal/testplanet: ensure that metainfo connections get closed ( #2381 )
2019-07-01 17:35:10 +03:00
Egon Elbre
8a59999537
Revert "miscommit add debug info"
...
This reverts commit 512f3fa93e
2019-07-01 12:36:35 +03:00
Egon Elbre
512f3fa93e
add debug info
2019-07-01 12:33:03 +03:00
Egon Elbre
615bfca135
Fix TestGetSignee flakiness ( #2350 )
...
* add IsCanceled
* fixes to error handling
* fix imports
* retrigger jenkins
2019-06-26 09:30:37 -06:00
Egon Elbre
b6ad3e9c9f
internal/testrand: new package for random data ( #2282 )
2019-06-26 13:38:51 +03:00
Egon Elbre
c7679b9b30
Fix some leaks and add notes about close handling ( #2334 )
2019-06-25 23:00:51 +03:00
Egon Elbre
6502143e79
fix import ordering ( #2322 )
2019-06-25 12:46:29 +03:00
Egon Elbre
23e081f0c7
storagenode: delete piece when upload is cancelled ( #2286 )
...
* storagenode: delete piece when upload is cancelled
* don't delete when piece info has been committed
2019-06-21 18:16:39 +02:00
littleskunk
b8bced690c
improve logging ( #2219 )
2019-06-18 00:38:52 +02:00
littleskunk
5e7fed7541
improve logging ( #2170 )
...
Signed-off-by: littleskunk <jens.heimbuerge@googlemail.com>
2019-06-10 21:30:17 -06:00
JT Olio
ccb158c99b
pkg/auth: add monkit task to missing places ( #2123 )
...
What: add monkit.Task to a bunch of functions that are missing it
Why: this will significantly help our instrumentation, data collection, and tracing about what's going on in the network
2019-06-05 07:47:01 -06:00
JT Olio
d6c02fc657
storagenode/piecestore: add meters to upload/download rates ( #2106 )
2019-06-04 15:22:00 +02:00
JT Olio
c4bb84f209
storagenode: add monkit task to missing places ( #2107 )
2019-06-04 14:31:38 +02:00
Kaloyan Raev
2ab95b533e
Check errors for possible outcomes from audit's DownloadShares ( #2072 )
2019-06-03 12:17:09 +03:00
Maximillian von Briesen
04c20b0ac0
Add monkit stats to piecestore upload/download ( #2078 )
2019-05-30 11:44:47 -04:00
Brandon Iglesias
771271e7b8
updating help message on storage node for AllocatedBandwidth ( #2074 )
2019-05-29 13:40:04 -04:00
ethanadams
268dc6b7e4
Enable gocritic linter ( #2051 )
...
* first round cleanup based on go-critic
* more issues resolved for ifelsechain and unlambda checks
* updated from master and gocritic found a new ifElseChain issue
* disable appendAssign. i reports false positives
* re-enabled go-critic appendAssign and disabled lint check at code line level
* fixed go-critic lint error
* fixed // nolint add gocritic specifically
2019-05-29 09:14:25 -04:00
JT Olio
32b3f8fef0
cmd/storagenode: pull more things into releaseDefaults ( #1980 )
2019-05-21 13:48:47 +02:00
littleskunk
910eb5d2c7
improve logging ( #1987 )
2019-05-17 19:02:39 +02:00
Egon Elbre
a2b61fd67c
storage node collector ( #1913 )
2019-05-08 14:11:59 +03:00
Bill Thorp
6ece4f11ad
moved invalid/offline back into SQL ( #1838 )
...
* moved invalid/offline back into SQL, removed GetAll()
2019-05-01 09:45:52 -04:00
Egon Elbre
60c4c10c79
storagenode: delete psserver ( #1837 )
2019-04-26 08:17:18 +03:00
Kaloyan Raev
8fc5fe1d6f
Refactor pb.Node protobuf ( #1785 )
2019-04-22 12:07:50 +03:00
Egon Elbre
5b3c146d8a
Check context cancellation more nicely ( #1752 )
2019-04-17 13:09:44 +03:00
Michal Niewrzal
e922f71f61
Piecestore space and bandwidth allocation check ( #1527 )
...
* Space and bandwidth allocation check
* use proper config flag
* one more check + tests
* use monitor to check space and bandwidth
* remove unused field
* check during read/write
* fix linter
* fix pieceid
* remove unused methods
* revert unneeded change
2019-04-15 12:12:22 +02:00
Egon Elbre
a1fd7cb6b4
don't cache failed satellite certificate fetch attempt ( #1745 )
...
* don't cache failing error
* fix test
* fix linter errors
2019-04-12 16:28:27 +02:00
littleskunk
a3caa8e00d
upload, download and delete success message on log level info ( #1704 )
2019-04-09 01:14:09 +02:00
Bryan White
faf5fae3f9
Identity versioning ( #1389 )
2019-04-08 20:15:19 +02:00
Maximillian von Briesen
bb3b4e4816
Data repair integration test ( #1582 )
2019-04-08 13:33:47 -04:00
Bill Thorp
255b92b4b8
fixed test on windows ( #1667 )
...
* fixed test on windows
2019-04-04 12:56:42 -04:00
Michal Niewrzal
bfdfebbde2
Satellite orders receiving ( #1564 )
...
This change adds satellite endpoint for receiving OrderLimits sent by storage node.
Change includes:
* wire up orders sender in storage node (also in testplanet)
* saving serial number for OrderLimit in serial_numbers table
* satellite endpoint for receiving, verifying and storing OrderLimit and Order serial number
* initial implementation for Orders DB
* basic test for sending orders to satellite
2019-03-27 11:24:35 +01:00
Michal Niewrzal
d7feafe56b
Move psserver tests ( #1522 )
2019-03-20 23:12:00 +02:00
Michal Niewrzal
b05cf05649
Restrict slash in bucket name ( #1524 )
2019-03-19 15:37:28 +01:00
Egon Elbre
117edec54c
Add serial number type ( #1508 )
2019-03-18 15:08:24 +02:00
Egon Elbre
05d148aeb5
Storage node and upload/download protocol refactor ( #1422 )
...
refactor storage node server
refactor upload and download protocol
2019-03-18 12:55:06 +02:00
