Egon Elbre
1df81b1460
Separate garbage collect logic from psdb ( #1167 )
2019-01-29 17:41:01 +02:00
Dylan Lott
bb2588e9ae
Refactors kademlia inspector to use FindNear ( #1157 )
...
* WIP
* update identity paths to get dump-nodes working
* Remove commented out code
* remove comment
* updates from code reviews
* updates linter
2019-01-28 15:53:37 -07:00
Bill Thorp
60946c2024
make bandwidth agreements sensible: without []byte's ( #1152 )
...
removed []byte's from bandwidth agreement protocol buffers
2019-01-28 14:45:25 -05:00
Egon Elbre
cecd4b0816
Remove server aliases ( #1154 )
2019-01-28 17:04:53 +02:00
Egon Elbre
49dacb662c
Improve bwagreement tests ( #1149 )
2019-01-26 01:06:38 +02:00
Bill Thorp
8ba4b61e59
Make Bandwidth Agreements Secure / Trustable ( #1117 )
...
* Added cert chains and nodeid verification to bandwidth agreement
2019-01-25 13:05:21 -05:00
Jennifer Li Johnson
856b98997c
updates copyright 2018 to 2019 ( #1133 )
2019-01-24 15:15:10 -05:00
Alexander Leitner
c4afec9328
quick log cleanup for storage node ( #1121 )
...
* Clean up logs
2019-01-24 11:09:37 -05:00
Cameron
95d2d54fc3
storagenode approvedSatelliteIDs ( #1116 )
...
* add config fields for satellite restriction on psserver
* add whitelistedSatIDs to psserver Server struct
* check pbwa satellite ID against whitelist
* add whitelist to psserver tests
* reword help message, make approved() a method on server
2019-01-23 12:56:12 -05:00
Egon Elbre
b6c61cdd55
Use storagenode.Peer for storagenode ( #1107 )
2019-01-23 12:39:03 +02:00
Egon Elbre
99d3b7a3c8
Fix import grouping ( #1111 )
2019-01-22 17:48:23 +02:00
Dylan Lott
7bc1944a08
Dashboard updates ( #1087 )
2019-01-18 05:41:25 -05:00
Alexander Leitner
944daeab02
Closing context doesn't stop storage node ( #1084 )
...
* Print when cancelled
* Close properly
* Don't log nil
* Don't print error when closing dashboard
2019-01-17 16:08:05 -05:00
JT Olio
a255e385df
memory.Size: autoformat sizes based on value entropy ( #1081 )
2019-01-17 20:47:57 +02:00
Michal Niewrzal
f9abb4584c
Storagenode logs and config improvements ( #1075 )
...
* Add more info to SN logs
* remove config-dir from user config
* add output where config was stored
* add message for successful connection
* fix linter
* remove storage.path from user config
* resolve config path
* move success message to info
* log improvements
2019-01-16 21:41:43 -05:00
Dylan Lott
82b9b54695
storagenode dashboard is working and passing tests locally ( #1072 )
...
* storagenode dashboard is working and passing tests locally
* linter fixes
* linter fixes
* moar linter fixes god
* review fixes and updates
* linter fixes
2019-01-16 16:09:13 -05:00
Michal Niewrzal
ab0c18de3a
Fix SN overrided params ( #1049 )
...
* Fix SN overrided params
* remove one more override
* fix missing var
* overriding default for storage node
* restore removed code
* fix docker
2019-01-15 10:43:10 -05:00
Kaloyan Raev
a63abf8fab
Save only user-specific flags to storage node's config.yaml ( #1051 )
2019-01-15 15:55:33 +02:00
Alexander Leitner
bfde515391
Clean up Storage node setup ( #1013 )
...
* Edit config on Setup
* Default to 1TiB storage space and 500GiB bandwidth
* Use human readable formats
* Use memory
* units of 1024 are measured with KiB/MiB etc
* pkg/cfgstruct: allow values to be configured with human readable sizes
Change-Id: Ic4e9ae461516d1d26fb81f6e44c5ac5cfccf777f
* Modify tests
* Removed comments
* More merge conflict stuff resolved
* Fix lint
* test fixin
Change-Id: I3a008206bf03a4446da19f642a2f9c1f9acaae36
* Remove commented code but secretly leave it in the histroy forever
* Move flag definition to struct
2019-01-14 16:19:15 -05:00
Bill Thorp
8b82114b7f
agreement sender bug fix ( #1044 )
2019-01-11 19:31:34 -05:00
Bill Thorp
273c3924ca
continue agreement sender loop on error ( #1020 )
...
* continue agreement sender loop on error
* added REJECTED grpc status
2019-01-11 13:15:49 -05:00
Egon Elbre
8893884044
convert piecestorage into a struct ( #1024 )
2019-01-11 13:26:39 +02:00
Egon Elbre
eb69ecadec
Storage Node Peer ( #1005 )
2019-01-10 15:13:27 +02:00
Michal Niewrzal
e5920ae0a4
Storage node config params descriptions cleanup ( #1004 )
...
* Storage node params descriptions cleanup
* reorg agreements sender param
* review changes
2019-01-10 13:50:50 +01:00
Bill Thorp
fb4a11ebb0
Differentiate GET and PUT operations in the tally service ( #965 )
...
* draft of new bandwidth agreement types
* updated storagenode report for new types
* use correct pba types
2019-01-10 06:41:57 -05:00
Bill Thorp
ea47d27c1b
Get satellites to send BW agreements to via KAD ( #985 )
...
* moved from hardcoded overlay IP to kad
2019-01-09 09:41:50 -05:00
Alexander Leitner
c9d900fe4d
Process for updating storage node stats in kademlia ( #904 )
...
* Process for updating node stats in kademlia
* Mutex lock
* Rename and set up the refresher
* Wrap errors
* Lock should be around the if
* Address comments; Build updateSelf funciton in Kademlia Routing Table
* Added test
* Address comments
2019-01-07 22:05:11 -05:00
Michal Niewrzal
bacc1b13b4
Verifier should use payer bandwidth alloc from satellite ( #960 )
...
* Verifier should use payer bandwidth alloc from satellite
* unit test added
* fix typo
* review comments applied
* fix renamed field
2019-01-06 19:51:01 +01:00
Cameron
9fa874459a
remove starting node log in piecestore server ( #964 )
2019-01-03 13:57:12 -05:00
Bryan White
249244536a
CSR Service (part 2): cert signing rpc ( #950 )
...
* CSR Service:
+ implement certificate sign rpc method
+ implement certificate signer client/server
+ refactor `AuthorizationDB#Create`
+ refactor `NewTestIdentity`
+ add `AuthorizationDB#Claim`
+ add `Token#Equal`
+ fix `Authorizations#Marshal` when marshaling identities and certificates
+ tweak `Authorization#String` format
+ cert debugging improvements (jsondiff)
+ receive context arg in `NewTestIdentity`
+ misc. fixes
2019-01-02 12:39:17 -05:00
Bryan White
398379b149
CSR service (part 1): authorizations ( #906 )
2018-12-20 19:29:05 +01:00
Egon Elbre
d9b9ae6ffa
Cleanup overlay methods and names. ( #914 )
2018-12-20 15:57:54 +02:00
Cameron
0d17c21a1b
Add logger to piecestore server/node started log ( #856 )
...
* add logger to psserver struct
* node started log
* rename initialize to NewEndpoint
* return err from WriteBandwidthAllocToDB
2018-12-17 10:23:02 -05:00
Michal Niewrzal
db5a3e0d0a
Parameters cleanup ( #864 )
...
* Parameters cleanup
* goimports
2018-12-14 16:55:45 +01:00
Maximillian von Briesen
a6c7306350
Cut off piecestore Puts if they exceed alloced bandwidth/space ( #819 )
...
* add bandwidth/storage limits to StreamWriter
* add StreamWriter tests for bandwidth/storage limits
2018-12-12 14:14:51 -05:00
Kaloyan Raev
3175eb74a6
Improve piece retrieving log with offset and length ( #813 )
2018-12-10 17:22:49 +02:00
JT Olio
1c96db01ba
better database error handling ( #784 )
...
* better database error handling
Change-Id: I28dbd69cf6c2fa268e02405521ff6e6c1a68a702
* missing comments added
* missing comment added
2018-12-07 07:46:42 -07:00
Egon Elbre
1e4556f88a
Fix import groupings ( #739 )
2018-11-30 15:40:13 +02:00
Bryan White
2a0c4e60d2
preparing for use of customtype gogo extension with NodeID type ( #693 )
...
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* wip
* tests passing
* wip fixing tests
* more wip test fixing
* remove NodeIDList from proto files
* linter fixes
* linter fixes
* linter/review fixes
* more freaking linter fixes
* omg just kill me - linterrrrrrrr
* travis linter, i will muder you and your family in your sleep
* goimports everything - burn in hell travis
* goimports update
* go mod tidy
2018-11-29 19:39:27 +01:00
Maximillian von Briesen
b884ee4626
Update protos to fit style guide (easy review) ( #702 )
...
* fix overlay.proto and piecestore.proto to meet style guide
* update code to be consistent with regenerated protos
2018-11-23 21:46:53 -05:00
Bryan White
dabd87cb36
swap golang/protobuf out for gogo/protobuf ( #692 )
...
* swap golang/protobuf out for gogo/protobuf
* revert go.mod and go.sum changes
* linter fixes
2018-11-20 19:29:07 +01:00
Bryan White
54ccb460a9
rename size fields in protobuf messages for gogo compatibility ( #690 )
...
* rename `size` fields in protobuf messages for gogo compatibility
* linter fixes
2018-11-20 18:09:35 +01:00
Dennis Coyle
e7e0d1daaa
Coyle/disable mock ( #627 )
...
* disabled mock overlay from captplanet
2018-11-20 11:54:52 -05:00
Alexander Leitner
5e9377524f
Refactor basystem ( #641 )
...
* Signature verification
* Clean up agreement sender to have less errors
* overlay address in captnplanet
* Refactor bandwidth.proto to not use streams
* Make sure the send worked
* Handle connection to satellite
* Save renter public key inside of renter bandwidth allocations
* Default diag to sqlite. Make configurable
* Separate bw server and dbm; regenerate dbx files
* Make sure test uses protobufs
* Demonstrate creating bandwidth allocations
2018-11-15 14:06:09 -05:00
Alexander Leitner
50d657af11
Cleanup agreement sender ( #630 )
...
* Signature verification
* code review comments & lint warnings
* Clean up agreement sender to have less errors
* overlay address in captnplanet
2018-11-13 10:37:49 -05:00
Dennis Coyle
e4baec8fce
Coyle/tls verify ( #612 )
...
* add nodeID to dial opts
* fix tests to use real identity
2018-11-09 17:08:33 -05:00
Michal Niewrzal
45d4234749
Logs cleanup (uplink, storage node) ( #600 )
...
* Logs cleanup (uplink, storage node)
* fix unit tests
* more logs cleanups
2018-11-08 15:27:07 -05:00
Bryan White
ee62e2a9d8
Use transport client and cleanup all the clients ( #574 )
...
* wip
* linter fixes
* linter fixes
* test fixes
* linter fixes
* fix merge + restructure piecestore packages
* review feedback
* linter fixes
* linter fixes
* remove unnecessary aliases to piecestore
* more merge fixing
2018-11-06 18:49:17 +01:00
