Dylan Lott
82b9b54695
storagenode dashboard is working and passing tests locally ( #1072 )
...
* storagenode dashboard is working and passing tests locally
* linter fixes
* linter fixes
* moar linter fixes god
* review fixes and updates
* linter fixes
2019-01-16 16:09:13 -05:00
Michal Niewrzal
ab0c18de3a
Fix SN overrided params ( #1049 )
...
* Fix SN overrided params
* remove one more override
* fix missing var
* overriding default for storage node
* restore removed code
* fix docker
2019-01-15 10:43:10 -05:00
Kaloyan Raev
a63abf8fab
Save only user-specific flags to storage node's config.yaml ( #1051 )
2019-01-15 15:55:33 +02:00
Alexander Leitner
bfde515391
Clean up Storage node setup ( #1013 )
...
* Edit config on Setup
* Default to 1TiB storage space and 500GiB bandwidth
* Use human readable formats
* Use memory
* units of 1024 are measured with KiB/MiB etc
* pkg/cfgstruct: allow values to be configured with human readable sizes
Change-Id: Ic4e9ae461516d1d26fb81f6e44c5ac5cfccf777f
* Modify tests
* Removed comments
* More merge conflict stuff resolved
* Fix lint
* test fixin
Change-Id: I3a008206bf03a4446da19f642a2f9c1f9acaae36
* Remove commented code but secretly leave it in the histroy forever
* Move flag definition to struct
2019-01-14 16:19:15 -05:00
Bill Thorp
8b82114b7f
agreement sender bug fix ( #1044 )
2019-01-11 19:31:34 -05:00
Bill Thorp
273c3924ca
continue agreement sender loop on error ( #1020 )
...
* continue agreement sender loop on error
* added REJECTED grpc status
2019-01-11 13:15:49 -05:00
Egon Elbre
8893884044
convert piecestorage into a struct ( #1024 )
2019-01-11 13:26:39 +02:00
Egon Elbre
eb69ecadec
Storage Node Peer ( #1005 )
2019-01-10 15:13:27 +02:00
Michal Niewrzal
e5920ae0a4
Storage node config params descriptions cleanup ( #1004 )
...
* Storage node params descriptions cleanup
* reorg agreements sender param
* review changes
2019-01-10 13:50:50 +01:00
Bill Thorp
fb4a11ebb0
Differentiate GET and PUT operations in the tally service ( #965 )
...
* draft of new bandwidth agreement types
* updated storagenode report for new types
* use correct pba types
2019-01-10 06:41:57 -05:00
Bill Thorp
ea47d27c1b
Get satellites to send BW agreements to via KAD ( #985 )
...
* moved from hardcoded overlay IP to kad
2019-01-09 09:41:50 -05:00
Alexander Leitner
c9d900fe4d
Process for updating storage node stats in kademlia ( #904 )
...
* Process for updating node stats in kademlia
* Mutex lock
* Rename and set up the refresher
* Wrap errors
* Lock should be around the if
* Address comments; Build updateSelf funciton in Kademlia Routing Table
* Added test
* Address comments
2019-01-07 22:05:11 -05:00
Michal Niewrzal
bacc1b13b4
Verifier should use payer bandwidth alloc from satellite ( #960 )
...
* Verifier should use payer bandwidth alloc from satellite
* unit test added
* fix typo
* review comments applied
* fix renamed field
2019-01-06 19:51:01 +01:00
aligeti
ce1db97ce6
fix manipulated paychecks V3-1023 ( #961 )
...
Satellite crashing on receiving a manipulated bandwidthagreement V3-1022
2019-01-04 11:26:26 -05:00
Cameron
9fa874459a
remove starting node log in piecestore server ( #964 )
2019-01-03 13:57:12 -05:00
Jennifer Li Johnson
a2fa5c4c5a
Proper NodeType Handling ( #873 )
...
* adds enums to nodetype
* updating nodetype todos
* ran pb updates
* reorder nodetypes
* adding checks
* wip
* wip
* wip
* bug in test-captplanet
* wip
* add values to storagenode, satellite, captplanet binaries
* Cleanup
* more cleanup
* wip
* lint
* lint
* wip
* fixes bug
* regenerate protos
Change-Id: Id270212e8c7479e52641058042cf23b5317ab773
* limit node type changes to kademlia
Change-Id: I9c1a6cc4a79e05086627f0fdeb5028c62ce754f4
* dpanic
Change-Id: Id952a2ad13c807ebaea0ec0a875405e267d81c3e
* review comments
Change-Id: I7f9b77ef22779dd012fd490375b136014f51f834
2019-01-02 11:47:34 -07:00
Bryan White
249244536a
CSR Service (part 2): cert signing rpc ( #950 )
...
* CSR Service:
+ implement certificate sign rpc method
+ implement certificate signer client/server
+ refactor `AuthorizationDB#Create`
+ refactor `NewTestIdentity`
+ add `AuthorizationDB#Claim`
+ add `Token#Equal`
+ fix `Authorizations#Marshal` when marshaling identities and certificates
+ tweak `Authorization#String` format
+ cert debugging improvements (jsondiff)
+ receive context arg in `NewTestIdentity`
+ misc. fixes
2019-01-02 12:39:17 -05:00
Bryan White
398379b149
CSR service (part 1): authorizations ( #906 )
2018-12-20 19:29:05 +01:00
Egon Elbre
d9b9ae6ffa
Cleanup overlay methods and names. ( #914 )
2018-12-20 15:57:54 +02:00
Cameron
0d17c21a1b
Add logger to piecestore server/node started log ( #856 )
...
* add logger to psserver struct
* node started log
* rename initialize to NewEndpoint
* return err from WriteBandwidthAllocToDB
2018-12-17 10:23:02 -05:00
Michal Niewrzal
db5a3e0d0a
Parameters cleanup ( #864 )
...
* Parameters cleanup
* goimports
2018-12-14 16:55:45 +01:00
Maximillian von Briesen
a6c7306350
Cut off piecestore Puts if they exceed alloced bandwidth/space ( #819 )
...
* add bandwidth/storage limits to StreamWriter
* add StreamWriter tests for bandwidth/storage limits
2018-12-12 14:14:51 -05:00
Kaloyan Raev
3175eb74a6
Improve piece retrieving log with offset and length ( #813 )
2018-12-10 17:22:49 +02:00
JT Olio
890c87914f
pstore: fix blob permissions ( #788 )
...
Change-Id: I004747657221c6ac53894fc5c5917e3f92436990
2018-12-07 07:47:45 -07:00
JT Olio
1c96db01ba
better database error handling ( #784 )
...
* better database error handling
Change-Id: I28dbd69cf6c2fa268e02405521ff6e6c1a68a702
* missing comments added
* missing comment added
2018-12-07 07:46:42 -07:00
Egon Elbre
1e4556f88a
Fix import groupings ( #739 )
2018-11-30 15:40:13 +02:00
Bryan White
2a0c4e60d2
preparing for use of customtype gogo extension with NodeID type ( #693 )
...
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* wip
* tests passing
* wip fixing tests
* more wip test fixing
* remove NodeIDList from proto files
* linter fixes
* linter fixes
* linter/review fixes
* more freaking linter fixes
* omg just kill me - linterrrrrrrr
* travis linter, i will muder you and your family in your sleep
* goimports everything - burn in hell travis
* goimports update
* go mod tidy
2018-11-29 19:39:27 +01:00
Maximillian von Briesen
b884ee4626
Update protos to fit style guide (easy review) ( #702 )
...
* fix overlay.proto and piecestore.proto to meet style guide
* update code to be consistent with regenerated protos
2018-11-23 21:46:53 -05:00
Bryan White
dabd87cb36
swap golang/protobuf out for gogo/protobuf ( #692 )
...
* swap golang/protobuf out for gogo/protobuf
* revert go.mod and go.sum changes
* linter fixes
2018-11-20 19:29:07 +01:00
Bryan White
54ccb460a9
rename size fields in protobuf messages for gogo compatibility ( #690 )
...
* rename `size` fields in protobuf messages for gogo compatibility
* linter fixes
2018-11-20 18:09:35 +01:00
Dennis Coyle
e7e0d1daaa
Coyle/disable mock ( #627 )
...
* disabled mock overlay from captplanet
2018-11-20 11:54:52 -05:00
Alexander Leitner
5e9377524f
Refactor basystem ( #641 )
...
* Signature verification
* Clean up agreement sender to have less errors
* overlay address in captnplanet
* Refactor bandwidth.proto to not use streams
* Make sure the send worked
* Handle connection to satellite
* Save renter public key inside of renter bandwidth allocations
* Default diag to sqlite. Make configurable
* Separate bw server and dbm; regenerate dbx files
* Make sure test uses protobufs
* Demonstrate creating bandwidth allocations
2018-11-15 14:06:09 -05:00
Alexander Leitner
50d657af11
Cleanup agreement sender ( #630 )
...
* Signature verification
* code review comments & lint warnings
* Clean up agreement sender to have less errors
* overlay address in captnplanet
2018-11-13 10:37:49 -05:00
Dennis Coyle
e4baec8fce
Coyle/tls verify ( #612 )
...
* add nodeID to dial opts
* fix tests to use real identity
2018-11-09 17:08:33 -05:00
Michal Niewrzal
45d4234749
Logs cleanup (uplink, storage node) ( #600 )
...
* Logs cleanup (uplink, storage node)
* fix unit tests
* more logs cleanups
2018-11-08 15:27:07 -05:00
littleskunk
810835e6a9
pretty print logging ( #598 )
2018-11-08 11:28:30 +01:00
Bryan White
ee62e2a9d8
Use transport client and cleanup all the clients ( #574 )
...
* wip
* linter fixes
* linter fixes
* test fixes
* linter fixes
* fix merge + restructure piecestore packages
* review feedback
* linter fixes
* linter fixes
* remove unnecessary aliases to piecestore
* more merge fixing
2018-11-06 18:49:17 +01:00
Alexander Leitner
67306d296b
Bandwidth fix ( #567 )
...
* Don't scan into nil
2018-11-01 12:40:26 -04:00
Bryan White
8b9711cb5e
better waitlist-gating ( #557 )
...
* better waitlist-gating
(cherry picked from commit 490fe02b7c3558da18678dfb651c92ec9c4a75b5)
* fix broken test
* linter fixes
* linter fixes
* make extension verification optional
* add certifcate gating script for captplanet
* fixing tests
* linter fixes
* linter fixes?
* moar linter fixes
* Revert "moar linter fixes"
This reverts commit 8139ccbd73cbbead987b7667567844f50f7df2c8.
* just kill me
* refactor
* refactor tests
* liniter...
* cleanup
2018-11-01 16:48:43 +01:00
Alexander Leitner
db80358f32
bandwidth agreements protobuf ( #505 )
...
* protobuf for sending bandwidth agreements to satellite from storage nodes
* Setup process for sending agreements
* Add payer_id to db with bandwidth agreements for better sorting
* Renamed payer to satellite in psdb
2018-10-31 14:47:25 -04:00
Alexander Leitner
7e4149138a
Piecestore proto change ( #556 )
...
* add action and storage node id to piecestore.proto. renamed payer and renter to satellite_id and uplink_id
2018-10-30 15:03:41 -04:00
Egon Elbre
bd67288071
Add inmemory psdb ( #543 )
2018-10-30 18:43:09 +02:00
Michal Niewrzal
fb5ccbc407
Pieces must be name spaced by Satellite ( #503 )
...
* Pieces must be name spaced by Satellite
* fixed formatting
2018-10-23 18:03:35 +02:00
Michal Niewrzal
f9248c21d4
Satellite verification on storage node ( #469 )
...
* Satellite verification on storage node
* fix formatting
* fix formatting
* rename SignatureAuth to SignedMessage
* fixes after review
* fix linter errors
* improve errors handling
* remove SignedMessageProvider
* fix liter errors
* params changed to authorization, signed message in audit, minor fixes
* fix formatting
2018-10-17 13:40:11 +02:00
Egon Elbre
2dbada73ab
Separate storj.io packages in imports ( #481 )
...
Format with goimports -w -local storj.io
Add flag to golang lint
Remove commented out imports as they mess with goimports
2018-10-16 14:43:44 +03:00
aligeti
2b2e0996b0
updated based on review comments ( #456 )
2018-10-15 15:59:05 -04:00
Dylan Lott
7849d7fa63
Remove newID function ( #468 )
...
* Removes node.NewID usage from kademlia tests
* Updates more tests
* remove comments
* removes NewID method from overlay tests
* adds error checking to NewFullIdentity
* removes /x/tools from go.mod
* Removes commented out code
2018-10-12 15:10:50 -06:00
aligeti
4a51db2344
Tracking bandwidth v3-446 ( #430 )
...
* Added a new table 'mib' with 'data', 'size' and 'method' columns
* added AddMIB() function and test case TestMIBHappyPath()
* added function and a test case to add entries into bandwidth usage table
* added functionality to create an entry, update the entry and readback the entry based on a given date into/from bandwidth tbl
* added initial SumBandwidthSizes()
* added the functionality to retrieve the total bw usage based on start and end date
* Added the unit test case for AddBwUsageTbl
* changed the arguments to take time format as arg than Unix format
* changed the arguments to take time format as arg than Unix format
* changes per code review comments
* adding back go.sum
* changes per code review comments
* changes per code review comments
* changes per code review comments
2018-10-10 10:04:42 -04:00
Dennis Coyle
dee2c137c8
Remove BKAD dependency from pkg/kademlia ( #294 )
...
* slowly but surely
* hardcode ID for tests so we can get predictable results
* skipping bad test
* removing tests of bkad
* wip
* new algorithm for worker
* clean up
* remove skipped test
* changes
* uncomment
* fixed conflicts
* maybe done ?
* cleanup
* boot bkad
* wip
* cleanup
* undo change
* fixes
* wip
* wip
* moving nodeID around
* wip
* wip
* fixes
* fixes after merge
* added TODO
* fixed tests post identity
* linter fixes
* wip
* PR review comments
* wip
* fixing tests
* fix tests
* force db directory
* bad test
* fixes race condition
* small cleanups
* adding db folder
* testing
* wip
* cleanup
* cleanup
* linters
* export Restrict
* add timeout
* testing
* linters
* forgot one
* moar fixes from master merge
* PR comments
* moar PR comments
* removed stun flag
* remove duplicate declaration
* remove old tests
* remove timeout
* fix tests
* missed one
* changed StringToID >> IDFromString
* PR comments
* stupid linter
* moevd overlay mock
* fixed merge conflicts
* fixes
* linter
2018-10-08 11:09:37 -04:00
Kaloyan Raev
bc0f697929
Pointer stores only nodes with successfully uploaded pieces ( #390 )
2018-09-27 13:45:19 +03:00
