Alexander Leitner
aabcceef52
Don't create identity when running dash ( #1098 )
...
* Don't create identity when running dash
* only use configs for connecting with dash, delete unused client example
* use server address
2019-01-18 18:08:45 +01:00
Dylan Lott
7bc1944a08
Dashboard updates ( #1087 )
2019-01-18 05:41:25 -05:00
Alexander Leitner
944daeab02
Closing context doesn't stop storage node ( #1084 )
...
* Print when cancelled
* Close properly
* Don't log nil
* Don't print error when closing dashboard
2019-01-17 16:08:05 -05:00
JT Olio
a255e385df
memory.Size: autoformat sizes based on value entropy ( #1081 )
2019-01-17 20:47:57 +02:00
Michal Niewrzal
f9abb4584c
Storagenode logs and config improvements ( #1075 )
...
* Add more info to SN logs
* remove config-dir from user config
* add output where config was stored
* add message for successful connection
* fix linter
* remove storage.path from user config
* resolve config path
* move success message to info
* log improvements
2019-01-16 21:41:43 -05:00
Dylan Lott
82b9b54695
storagenode dashboard is working and passing tests locally ( #1072 )
...
* storagenode dashboard is working and passing tests locally
* linter fixes
* linter fixes
* moar linter fixes god
* review fixes and updates
* linter fixes
2019-01-16 16:09:13 -05:00
Michal Niewrzal
ab0c18de3a
Fix SN overrided params ( #1049 )
...
* Fix SN overrided params
* remove one more override
* fix missing var
* overriding default for storage node
* restore removed code
* fix docker
2019-01-15 10:43:10 -05:00
Kaloyan Raev
a63abf8fab
Save only user-specific flags to storage node's config.yaml ( #1051 )
2019-01-15 15:55:33 +02:00
Alexander Leitner
bfde515391
Clean up Storage node setup ( #1013 )
...
* Edit config on Setup
* Default to 1TiB storage space and 500GiB bandwidth
* Use human readable formats
* Use memory
* units of 1024 are measured with KiB/MiB etc
* pkg/cfgstruct: allow values to be configured with human readable sizes
Change-Id: Ic4e9ae461516d1d26fb81f6e44c5ac5cfccf777f
* Modify tests
* Removed comments
* More merge conflict stuff resolved
* Fix lint
* test fixin
Change-Id: I3a008206bf03a4446da19f642a2f9c1f9acaae36
* Remove commented code but secretly leave it in the histroy forever
* Move flag definition to struct
2019-01-14 16:19:15 -05:00
Bill Thorp
8b82114b7f
agreement sender bug fix ( #1044 )
2019-01-11 19:31:34 -05:00
Bill Thorp
273c3924ca
continue agreement sender loop on error ( #1020 )
...
* continue agreement sender loop on error
* added REJECTED grpc status
2019-01-11 13:15:49 -05:00
Egon Elbre
8893884044
convert piecestorage into a struct ( #1024 )
2019-01-11 13:26:39 +02:00
Egon Elbre
eb69ecadec
Storage Node Peer ( #1005 )
2019-01-10 15:13:27 +02:00
Michal Niewrzal
e5920ae0a4
Storage node config params descriptions cleanup ( #1004 )
...
* Storage node params descriptions cleanup
* reorg agreements sender param
* review changes
2019-01-10 13:50:50 +01:00
Bill Thorp
fb4a11ebb0
Differentiate GET and PUT operations in the tally service ( #965 )
...
* draft of new bandwidth agreement types
* updated storagenode report for new types
* use correct pba types
2019-01-10 06:41:57 -05:00
Bill Thorp
ea47d27c1b
Get satellites to send BW agreements to via KAD ( #985 )
...
* moved from hardcoded overlay IP to kad
2019-01-09 09:41:50 -05:00
Alexander Leitner
c9d900fe4d
Process for updating storage node stats in kademlia ( #904 )
...
* Process for updating node stats in kademlia
* Mutex lock
* Rename and set up the refresher
* Wrap errors
* Lock should be around the if
* Address comments; Build updateSelf funciton in Kademlia Routing Table
* Added test
* Address comments
2019-01-07 22:05:11 -05:00
Michal Niewrzal
bacc1b13b4
Verifier should use payer bandwidth alloc from satellite ( #960 )
...
* Verifier should use payer bandwidth alloc from satellite
* unit test added
* fix typo
* review comments applied
* fix renamed field
2019-01-06 19:51:01 +01:00
aligeti
ce1db97ce6
fix manipulated paychecks V3-1023 ( #961 )
...
Satellite crashing on receiving a manipulated bandwidthagreement V3-1022
2019-01-04 11:26:26 -05:00
Cameron
9fa874459a
remove starting node log in piecestore server ( #964 )
2019-01-03 13:57:12 -05:00
Jennifer Li Johnson
a2fa5c4c5a
Proper NodeType Handling ( #873 )
...
* adds enums to nodetype
* updating nodetype todos
* ran pb updates
* reorder nodetypes
* adding checks
* wip
* wip
* wip
* bug in test-captplanet
* wip
* add values to storagenode, satellite, captplanet binaries
* Cleanup
* more cleanup
* wip
* lint
* lint
* wip
* fixes bug
* regenerate protos
Change-Id: Id270212e8c7479e52641058042cf23b5317ab773
* limit node type changes to kademlia
Change-Id: I9c1a6cc4a79e05086627f0fdeb5028c62ce754f4
* dpanic
Change-Id: Id952a2ad13c807ebaea0ec0a875405e267d81c3e
* review comments
Change-Id: I7f9b77ef22779dd012fd490375b136014f51f834
2019-01-02 11:47:34 -07:00
Bryan White
249244536a
CSR Service (part 2): cert signing rpc ( #950 )
...
* CSR Service:
+ implement certificate sign rpc method
+ implement certificate signer client/server
+ refactor `AuthorizationDB#Create`
+ refactor `NewTestIdentity`
+ add `AuthorizationDB#Claim`
+ add `Token#Equal`
+ fix `Authorizations#Marshal` when marshaling identities and certificates
+ tweak `Authorization#String` format
+ cert debugging improvements (jsondiff)
+ receive context arg in `NewTestIdentity`
+ misc. fixes
2019-01-02 12:39:17 -05:00
Bryan White
398379b149
CSR service (part 1): authorizations ( #906 )
2018-12-20 19:29:05 +01:00
Egon Elbre
d9b9ae6ffa
Cleanup overlay methods and names. ( #914 )
2018-12-20 15:57:54 +02:00
Cameron
0d17c21a1b
Add logger to piecestore server/node started log ( #856 )
...
* add logger to psserver struct
* node started log
* rename initialize to NewEndpoint
* return err from WriteBandwidthAllocToDB
2018-12-17 10:23:02 -05:00
Michal Niewrzal
db5a3e0d0a
Parameters cleanup ( #864 )
...
* Parameters cleanup
* goimports
2018-12-14 16:55:45 +01:00
Maximillian von Briesen
a6c7306350
Cut off piecestore Puts if they exceed alloced bandwidth/space ( #819 )
...
* add bandwidth/storage limits to StreamWriter
* add StreamWriter tests for bandwidth/storage limits
2018-12-12 14:14:51 -05:00
Kaloyan Raev
3175eb74a6
Improve piece retrieving log with offset and length ( #813 )
2018-12-10 17:22:49 +02:00
JT Olio
890c87914f
pstore: fix blob permissions ( #788 )
...
Change-Id: I004747657221c6ac53894fc5c5917e3f92436990
2018-12-07 07:47:45 -07:00
JT Olio
1c96db01ba
better database error handling ( #784 )
...
* better database error handling
Change-Id: I28dbd69cf6c2fa268e02405521ff6e6c1a68a702
* missing comments added
* missing comment added
2018-12-07 07:46:42 -07:00
Egon Elbre
1e4556f88a
Fix import groupings ( #739 )
2018-11-30 15:40:13 +02:00
Bryan White
2a0c4e60d2
preparing for use of customtype
gogo extension with NodeID
type ( #693 )
...
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* wip
* tests passing
* wip fixing tests
* more wip test fixing
* remove NodeIDList from proto files
* linter fixes
* linter fixes
* linter/review fixes
* more freaking linter fixes
* omg just kill me - linterrrrrrrr
* travis linter, i will muder you and your family in your sleep
* goimports everything - burn in hell travis
* goimports update
* go mod tidy
2018-11-29 19:39:27 +01:00
Maximillian von Briesen
b884ee4626
Update protos to fit style guide (easy review) ( #702 )
...
* fix overlay.proto and piecestore.proto to meet style guide
* update code to be consistent with regenerated protos
2018-11-23 21:46:53 -05:00
Bryan White
dabd87cb36
swap golang/protobuf out for gogo/protobuf ( #692 )
...
* swap golang/protobuf out for gogo/protobuf
* revert go.mod and go.sum changes
* linter fixes
2018-11-20 19:29:07 +01:00
Bryan White
54ccb460a9
rename size
fields in protobuf messages for gogo compatibility ( #690 )
...
* rename `size` fields in protobuf messages for gogo compatibility
* linter fixes
2018-11-20 18:09:35 +01:00
Dennis Coyle
e7e0d1daaa
Coyle/disable mock ( #627 )
...
* disabled mock overlay from captplanet
2018-11-20 11:54:52 -05:00
Alexander Leitner
5e9377524f
Refactor basystem ( #641 )
...
* Signature verification
* Clean up agreement sender to have less errors
* overlay address in captnplanet
* Refactor bandwidth.proto to not use streams
* Make sure the send worked
* Handle connection to satellite
* Save renter public key inside of renter bandwidth allocations
* Default diag to sqlite. Make configurable
* Separate bw server and dbm; regenerate dbx files
* Make sure test uses protobufs
* Demonstrate creating bandwidth allocations
2018-11-15 14:06:09 -05:00
Alexander Leitner
50d657af11
Cleanup agreement sender ( #630 )
...
* Signature verification
* code review comments & lint warnings
* Clean up agreement sender to have less errors
* overlay address in captnplanet
2018-11-13 10:37:49 -05:00
Dennis Coyle
e4baec8fce
Coyle/tls verify ( #612 )
...
* add nodeID to dial opts
* fix tests to use real identity
2018-11-09 17:08:33 -05:00
Michal Niewrzal
45d4234749
Logs cleanup (uplink, storage node) ( #600 )
...
* Logs cleanup (uplink, storage node)
* fix unit tests
* more logs cleanups
2018-11-08 15:27:07 -05:00
littleskunk
810835e6a9
pretty print logging ( #598 )
2018-11-08 11:28:30 +01:00
Bryan White
ee62e2a9d8
Use transport client and cleanup all the clients ( #574 )
...
* wip
* linter fixes
* linter fixes
* test fixes
* linter fixes
* fix merge + restructure piecestore packages
* review feedback
* linter fixes
* linter fixes
* remove unnecessary aliases to piecestore
* more merge fixing
2018-11-06 18:49:17 +01:00
Alexander Leitner
67306d296b
Bandwidth fix ( #567 )
...
* Don't scan into nil
2018-11-01 12:40:26 -04:00
Bryan White
8b9711cb5e
better waitlist-gating ( #557 )
...
* better waitlist-gating
(cherry picked from commit 490fe02b7c3558da18678dfb651c92ec9c4a75b5)
* fix broken test
* linter fixes
* linter fixes
* make extension verification optional
* add certifcate gating script for captplanet
* fixing tests
* linter fixes
* linter fixes?
* moar linter fixes
* Revert "moar linter fixes"
This reverts commit 8139ccbd73cbbead987b7667567844f50f7df2c8.
* just kill me
* refactor
* refactor tests
* liniter...
* cleanup
2018-11-01 16:48:43 +01:00
Alexander Leitner
db80358f32
bandwidth agreements protobuf ( #505 )
...
* protobuf for sending bandwidth agreements to satellite from storage nodes
* Setup process for sending agreements
* Add payer_id to db with bandwidth agreements for better sorting
* Renamed payer to satellite in psdb
2018-10-31 14:47:25 -04:00
Alexander Leitner
7e4149138a
Piecestore proto change ( #556 )
...
* add action and storage node id to piecestore.proto. renamed payer and renter to satellite_id and uplink_id
2018-10-30 15:03:41 -04:00
Egon Elbre
bd67288071
Add inmemory psdb ( #543 )
2018-10-30 18:43:09 +02:00
Michal Niewrzal
fb5ccbc407
Pieces must be name spaced by Satellite ( #503 )
...
* Pieces must be name spaced by Satellite
* fixed formatting
2018-10-23 18:03:35 +02:00
Michal Niewrzal
f9248c21d4
Satellite verification on storage node ( #469 )
...
* Satellite verification on storage node
* fix formatting
* fix formatting
* rename SignatureAuth to SignedMessage
* fixes after review
* fix linter errors
* improve errors handling
* remove SignedMessageProvider
* fix liter errors
* params changed to authorization, signed message in audit, minor fixes
* fix formatting
2018-10-17 13:40:11 +02:00
Egon Elbre
2dbada73ab
Separate storj.io packages in imports ( #481 )
...
Format with goimports -w -local storj.io
Add flag to golang lint
Remove commented out imports as they mess with goimports
2018-10-16 14:43:44 +03:00