Natalie Villasana
c3d3f41d30
removes some SignedMessage use ( #1258 )
...
Removes most instances of pb.SignedMessage (there's more to take out but they shouldn't hurt anyone as is).
There used to be places in psserver where a PieceID was hmac'd with the SatelliteID, which was gotten from a SignedMessage. This PR makes it so some functions access the SatelliteID from the Payer Bandwidth Allocation instead.
This requires passing a SatelliteID into psserver functions where they weren't before, so the following proto messages have been changed:
* PieceId - satellite_id field added
This is so the psserver.Piece function has access to the SatelliteID when it needs to get the namespaced pieceID.
This proto message should probably be renamed to PieceRequest, or a new PieceRequest message should be created so this isn't misnamed.
* PieceDelete - satellite_id field added
This is so the psserver.Delete function has access to the SatelliteID when receiving a request to Delete.
2019-02-19 23:36:08 -06:00
Dennis Coyle
36e4d8c1c2
restrict actions on PayerBandwidthAllocation ( #1326 )
...
* restrict actions on PayerBandwidthAllocation
* defaults to error if action unknown
2019-02-19 16:00:58 -05:00
Jennifer Li Johnson
a5aa5f84a1
handle server termination in kademlia tests ( #1323 )
2019-02-19 20:41:32 +02:00
Michal Niewrzal
8d685217e4
Storagenode migrations ( #1299 )
...
* creates initial migration for psdb
* add test mechanism to validate migration to every version
* fix few small issues in versions.go and context.go
2019-02-19 10:39:04 +01:00
Bill Thorp
c598ed034d
kad.FindNear fix ( #1320 )
...
We realized that the Kademlia FindNear() function was
1. not using XOR distance (AKA _totally broken_)
2. largely a duplicate of the RoutingTable FindNear() function
Changes in this PR:
1. upgraded RoutingTable FindNear() to use iterator and restrictions
2. removed unneeded RoutingTable interface
3. made Kademlia wrap methods that were previously accessed via RoutingTable
4. fixed the tests
2019-02-15 22:23:35 -05:00
Egon Elbre
12261c0624
Satellite migrations ( #1301 )
2019-02-14 23:55:21 +02:00
Bryan White
d93c57cffa
add certificates claim delete & refactor ( #1317 )
...
* add \`certificates claim delete\` & refactor
* quickfix
* goimports
2019-02-14 20:17:26 +01:00
Bill Thorp
dfd6589fbe
fix kad refresh bad bucket range ( #1315 )
...
fix kad refresh bad bucket range
2019-02-14 10:47:03 -05:00
Michal Niewrzal
58792533b9
Fix invalid config key msg for dashbord ( #1314 )
2019-02-14 14:06:15 +01:00
Stefan Benten
661df2a625
Reduce Log Messages on Level Info ( #1313 )
2019-02-14 13:50:35 +01:00
Bill Thorp
9b580c5fb6
Repair checker is checking the same 1000 elements all the time ( #1297 )
...
* removed limit on repair, now using cycle
* added BatchIteratorOptions
* consolidated boltdb common.go
* PR feedback cleanup
2019-02-14 13:33:41 +01:00
Egon Elbre
1a5a9903a2
Move SplitConnstr to a nicer place ( #1308 )
2019-02-13 23:54:59 +02:00
Bill Thorp
b53f9896d3
Removed ReverseList from KeyValueStore interfaces ( #1306 )
...
Removed ReverseList from KeyValueStore interfaces
2019-02-13 12:27:03 -05:00
Bill Thorp
2c5716e874
pb.Equal fix ( #1304 )
...
* pb.Equal fix
* file capitalization
* oh snake case
2019-02-13 09:08:57 -05:00
Michal Niewrzal
b2f9453184
Disable Checker subsystem in tests ( #1279 )
...
* Disable Checker subsystem in tests
* rename field
* remove sleeps and errgroup.Group
2019-02-11 22:06:39 +01:00
Maximillian von Briesen
f94a2e1161
Node selection method name change ( #1296 )
...
* SelectNodes -> SelectStorageNodes
2019-02-11 14:24:51 -05:00
Maximillian von Briesen
c9d00d8241
test random selection for new nodes ( #1294 )
2019-02-11 12:10:32 -05:00
Maximillian von Briesen
c6c23a319b
move node type definition to db level for node selection ( #1295 )
2019-02-11 11:35:28 -05:00
Egon Elbre
18bd2d7b1a
Fix randomized selection test limit ( #1290 )
2019-02-11 14:04:00 +02:00
JT Olio
2a59679766
pkg/transport: require tls configuration for dialing ( #1286 )
...
* separate TLS options from server options (because we need them for dialing too)
* stop creating transports in multiple places
* ensure that we actually check revocation, whitelists, certificate signing, etc, for all connections.
2019-02-11 13:17:32 +02:00
JT Olio
ea28a9a581
pkg/transport: fail on bad certificates ( #1285 )
2019-02-11 13:02:49 +02:00
Maximillian von Briesen
690d5447a1
Add test for randomized node selection ( #1271 )
2019-02-09 16:17:49 -05:00
Dylan Lott
612919d95b
Adds tests to discovery/graveyard ( #1272 )
...
* adds tests for cache graveyard
* updates tests for cache graveyard to use sync2
2019-02-08 13:56:24 -07:00
Egon Elbre
17a7f9d002
Enable planet Merging test ( #1281 )
2019-02-08 22:35:59 +02:00
Egon Elbre
e37e0c1b5f
Fix server config usage ( #1282 )
2019-02-08 20:57:17 +02:00
Kaloyan Raev
4e738bbd44
Fix randomness in stopping nodes in TestGetObjectStream ( #1277 )
2019-02-08 15:20:12 +02:00
Michal Niewrzal
c7ad427d95
Move metainfo config ( #1234 )
...
* Move metainfo config
* move config to uplink
* reorganize code
* use satellite apikey
* comment update
2019-02-08 13:57:35 +01:00
Egon Elbre
995927dcd2
Disable psserver TestRetrieve ( #1273 )
2019-02-08 11:54:50 +02:00
Egon Elbre
9c1e299f3c
Ensure everyone sees everyone else ( #1275 )
2019-02-08 11:25:13 +02:00
Egon Elbre
5a13bdec18
close revocation database in test ( #1274 )
2019-02-08 11:13:32 +02:00
paul cannon
c35b93766d
Unite all cryptographic signing and verifying ( #1244 )
...
this change removes the cryptopasta dependency.
a couple possible sources of problem with this change:
* the encoding used for ECDSA signatures on SignedMessage has changed.
the encoding employed by cryptopasta was workable, but not the same
as the encoding used for such signatures in the rest of the world
(most particularly, on ECDSA signatures in X.509 certificates). I
think we'll be best served by using one ECDSA signature encoding from
here on, but if we need to use the old encoding for backwards
compatibility with existing nodes, that can be arranged.
* since there's already a breaking change in SignedMessage, I changed
it to send and receive public keys in raw PKIX format, instead of
PEM. PEM just adds unhelpful overhead for this case.
2019-02-07 14:39:20 -06:00
Bill Thorp
0b35762105
Convert Payments to use SQL, for SUM() and Wallet ( #1266 )
...
* payments query no longer DBX, using SQL
* sum in SQL
* removed old function
* fixed rollup test
* wrap errors
* removed DBX code
2019-02-07 15:26:55 -05:00
aligeti
b736ae4823
Store the uplinks public key on the satellite so that it can verify bandwidth requests in the future ( #1042 )
...
* integrated with bwagreement & psserver
* integrated with pointerdb
* code review updates
* refactor after code review
* uplinkdb rename to certdb
* Code review changes
2019-02-07 14:22:49 -05:00
paul cannon
ef61c170b1
Consolidate key/cert/signature encoding and decoding ( #1243 )
2019-02-07 12:40:28 -06:00
paul cannon
32882daf38
SHA256Hash() and TBSBytes() needn't return error ( #1242 )
2019-02-07 11:08:52 -06:00
paul cannon
0032147665
regroup things related to public-key cryptography ( #1241 )
2019-02-07 10:04:29 +01:00
Cameron
bfe8060f4d
Rollup tests ( #1224 )
...
* createdAt field no longer autoinsert
* rollup tests
2019-02-06 23:16:24 -05:00
Bryan White
3b54cf0e15
identity improvements: ( #1215 )
2019-02-06 17:40:55 +01:00
Egon Elbre
30f89b0362
Ensure overlay tests run against postgres ( #1232 )
2019-02-06 15:32:42 +02:00
Egon Elbre
bb11d83ed0
Proper planet shutdown ( #1249 )
2019-02-06 15:19:14 +02:00
Michal Niewrzal
aa3836c06a
Add checker irreparable test ( #1246 )
...
* Add checker irreparable test
* use RepairUnixSec
* wait for second check
* use storagenode.ID()
* Update comments
2019-02-06 14:03:38 +01:00
Egon Elbre
fdbe2db273
Remove node package and simplify DHT interface ( #1233 )
2019-02-06 14:37:17 +02:00
Egon Elbre
2d6b5faf6d
Fix discovery busy-spin ( #1248 )
2019-02-06 14:25:29 +02:00
Bryan White
00554f0876
add certificates claims+ ( #1216 )
2019-02-06 12:00:26 +01:00
Bryan White
7b7e6c43f8
better batch-generation ( #1219 )
2019-02-06 09:04:12 +01:00
Egon Elbre
218e95728c
psserver: swallow io.EOF when getting full content in FileRanger ( #1238 )
2019-02-06 07:41:41 +02:00
paul cannon
331f0cc845
don't put nil nodes in GetResponse ( #1218 )
2019-02-05 23:12:27 +02:00
Bill Thorp
690e8b2061
storage node cert cache ( #1226 )
...
* draft
* still errors
* double close fix
* added tests
* weird, goimports must not be working
* renames
* missed one
* forgot to save:
2019-02-05 12:57:56 -05:00
Egon Elbre
07412698a9
Use lower bcrypt cost for console.Service when running tests and disable flaky tests ( #1236 )
2019-02-05 19:31:53 +02:00
Yaroslav Vorobiov
2ff0d9d435
Add bucket to project relationship on satellite ( #1143 )
...
* integrate console api keys with buckets in pointerdb
* fix test
* fix tests kvmetainfo
* linter fix
* disable account activation
* fix test
* review fixes
* fix comments
* little refactoring
* remove debug println
* fix typo
* disable activation in a propper way
* fix test
* fix imports
* fix uplink count in testplanet
* move key creation to planet.newUplink
2019-02-05 19:22:17 +02:00
Egon Elbre
b16f27c54b
Ensure discovery tests run against postgres ( #1230 )
2019-02-05 19:03:16 +02:00
Kaloyan Raev
3c73d3a33c
Fixes intermitent failures in storage/ec TestPut ( #1239 )
2019-02-05 18:49:52 +02:00
Egon Elbre
39c1e5ccec
Ensure checker tests run against postgres ( #1229 )
2019-02-05 18:00:52 +02:00
Egon Elbre
94ee200e35
Ensure cursor tests run against postgres ( #1228 )
2019-02-05 17:45:09 +02:00
Egon Elbre
6564357e13
Ensure that tally tests run against postgres ( #1227 )
2019-02-05 16:23:45 +02:00
Kaloyan Raev
dd76829d10
Improve logic for cutting the long tail during upload ( #909 )
2019-02-05 12:54:25 +02:00
Egon Elbre
87d6410b50
Revert "Remove node package and simplify DHT interface."
...
This reverts commit 03ec1ff92d
2019-02-05 10:38:48 +02:00
Egon Elbre
03ec1ff92d
Remove node package and simplify DHT interface.
2019-02-05 10:37:24 +02:00
Dylan Lott
21a58d0ece
node graveyard resurrection ( #1186 )
...
* deletes nodes from cache if unresponsive
* update error messages
* WIP restructuring discovery tickers
* passes tests
* Removes log messages
* Passes up error in graveyard ticker
2019-02-04 14:52:06 -07:00
Egon Elbre
c37e0c1b6d
testplanet.Run ( #1222 )
2019-02-04 22:37:46 +02:00
Michal Niewrzal
2f8b3da1af
Upload/download for testplanet Uplink ( #1183 )
...
* Upload/download for testplanet Uplink
* check error in tests
* cleanup
* refactor node -> uplink
* add missing test file
* rest of refactoring
* workaround to resolve cycles in tests
* rename method
* add missing comments
* review comments
* use KiB
2019-02-04 17:56:10 +01:00
Michal Niewrzal
53c11dfc5d
Stop storagenode on ctrl+c ( #1220 )
...
* Stop storagenode on ctrl+c
* Cancel grpc server
* handle error
* handle error
* use errgroup
* fix check-travis-tidy
* remove pipefail
2019-02-04 15:50:55 +01:00
paul cannon
0238a7785b
make a map object before inserting into it ( #1217 )
...
I think this is causing panics.
2019-02-03 18:42:20 -06:00
Bill Thorp
0f662b8e38
sql based tally ( #1166 )
...
* WIP
* wacky changes
* more
* it builds.... IT BUILDS!!!
* fixed SQL, broke out saving tallies for testing
* shorter lines
* fixed SQL, moved tally_test to testplanet
* lint
* WIP logic error preventing PUT and GETs to same serialnum
* fixed BWA test
* fixed temporary brain failure
* eliminated magic numbers
* cleaned up satellite uplink stats
* use errs.Combine instead
* thrashing
* fixed tally erroneous error msg
* fixed tally test
* lint
* SQL syntax attempt to fix
* spelling error
* made bwa db test resist old postgres data
* postgres pk error msg hunting
* postgres pk error msg hunting
* postgres
* err might be nil?
* fixed error logging bug
* hopefully solved postgres issue
* using rebind
* moved tests to _test package
* fixing test dirs
* finally made sense of Egons package name feedback
* UTC, array fixes
2019-02-01 13:50:12 -05:00
Egon Elbre
4117600f32
Cleanup repository a bit ( #1203 )
2019-02-01 20:21:00 +02:00
Kaloyan Raev
5c2b67db63
Fix EOF error on audits (storage node) ( #1208 )
...
* Fix EOF error on audits
* Specify the correct number of bytes to CopyN instead of checking for EOF
* Fix imports order
2019-02-01 10:57:11 -07:00
Kaloyan Raev
a90aa18582
Fix panic in PointerDB.Get ( #1209 )
...
* Fix panic in PointerDB.Get
* Allow nil nodes, check if v is nil instead
* More checks like this
* Remove unnecessary check
* More checks
2019-02-01 10:55:47 -07:00
JT Olio
41d19f3c3d
miniogw: fix buffer size alignment ( #1213 )
...
Change-Id: I47e0e67e385d236ac0338fe36f11cc7c00e23dba
2019-02-01 10:42:30 -07:00
Dylan Lott
c77a647174
Updates transport dialopts to use WithBlock() ( #1201 )
...
* Updates transport opts to use WithBlock()
* Removes unnecessary withBlock's and adds WithBlock to DialAddress
2019-02-01 10:40:35 -07:00
Egon Elbre
5a63c00442
Fix issues with blocking during startup ( #1212 )
2019-02-01 19:28:40 +02:00
Bryan White
3e3088e37c
improve identity create ux ( #1211 )
2019-02-01 11:58:33 -05:00
Egon Elbre
7a85c5c1c6
Fix audit node ids ( #1207 )
2019-02-01 16:48:57 +02:00
Egon Elbre
00570df1f9
Add top flag to tparse ( #1205 )
2019-02-01 16:35:13 +02:00
Egon Elbre
b91d77436f
Test merging planets ( #1181 )
2019-02-01 15:32:28 +02:00
Egon Elbre
0c366c1ed2
Clearer code for node selection ( #1173 )
2019-01-31 13:49:00 -05:00
Kaloyan Raev
8c357ac571
Correctly update uptime when ping fails ( #1190 )
2019-01-31 16:51:38 +02:00
Dylan Lott
6025f9f19e
deletes nodes from cache if unresponsive ( #1185 )
...
* deletes nodes from cache if unresponsive
* update error messages
2019-01-30 14:15:24 -07:00
Egon Elbre
97714d150f
Remove unused kademlia.Disconnect method ( #1178 )
2019-01-30 22:57:13 +02:00
Egon Elbre
d5346982c2
Delete provider package ( #1177 )
2019-01-30 22:47:21 +02:00
Egon Elbre
19de56bf83
Fix race in discovery test ( #1184 )
2019-01-30 22:29:33 +02:00
Alexander Leitner
7c741c16d1
Readable sizes in dashboard ( #1180 )
...
* Readable sizes
* Use tabwriter
* Added more addresses to dashboard stats
* Use kad to look up addresses
* Move dashboard command to dashboard.go
2019-01-30 14:49:25 -05:00
Michal Niewrzal
14434594c4
Re-enable repair checker tests ( #1172 )
...
* Re-enable repair checker tests
* simpler NodeID construction
* adjust benchmark
2019-01-30 19:34:44 +01:00
Dylan Lott
5e1ab841cf
Cache refresher ( #1171 )
...
* got tests passed
* wire up paginate function for cache node retrieval
* Add tests for paginate but they're failing
* fix the test arguments
* Updates paginate function to return more variable
* Updates
* Some test and logic tweaks
* improves config handling in discovery
* adds refresh offset to discovery struct
2019-01-30 11:29:18 -05:00
Egon Elbre
6132ce86b7
Remove utils.LogClose ( #1169 )
2019-01-29 22:42:27 +02:00
Natalie Villasana
8d7944bcf8
new node selection in overlay ( #1136 )
2019-01-29 14:42:43 -05:00
Egon Elbre
1df81b1460
Separate garbage collect logic from psdb ( #1167 )
2019-01-29 17:41:01 +02:00
Egon Elbre
54eb1b099c
don't display message unless logger has been specified ( #1165 )
2019-01-29 14:12:24 +02:00
Egon Elbre
e1a8bbdcb6
Kademlia flags cleanup ( #1137 )
2019-01-29 08:51:07 +02:00
Dylan Lott
bb2588e9ae
Refactors kademlia inspector to use FindNear ( #1157 )
...
* WIP
* update identity paths to get dump-nodes working
* Remove commented out code
* remove comment
* updates from code reviews
* updates linter
2019-01-28 15:53:37 -07:00
Bill Thorp
60946c2024
make bandwidth agreements sensible: without []byte's ( #1152 )
...
removed []byte's from bandwidth agreement protocol buffers
2019-01-28 14:45:25 -05:00
Dylan Lott
df903ea215
Decreases refresh time per bucket in Kademlia ( #1150 )
2019-01-28 12:36:20 -07:00
Egon Elbre
d50c07e56c
Implement WorkGroup ( #1151 )
2019-01-28 21:04:42 +02:00
Egon Elbre
cecd4b0816
Remove server aliases ( #1154 )
2019-01-28 17:04:53 +02:00
Bryan White
2b20acbec9
identity cleanup ( #1145 )
2019-01-26 15:59:53 +01:00
Egon Elbre
49dacb662c
Improve bwagreement tests ( #1149 )
2019-01-26 01:06:38 +02:00
Egon Elbre
f7e18882c4
Kademlia closing race ( #1139 )
2019-01-26 00:33:20 +02:00
Bill Thorp
8ba4b61e59
Make Bandwidth Agreements Secure / Trustable ( #1117 )
...
* Added cert chains and nodeid verification to bandwidth agreement
2019-01-25 13:05:21 -05:00
Bryan White
7bed8050aa
Improve identity cli ux: ( #1142 )
2019-01-25 17:55:45 +01:00
Jennifer Li Johnson
5397efe5c1
removes standalone payments service ( #1134 )
...
* remove standalone payments service - will integrate within satellite directly
* regenerate proto files
2019-01-25 11:23:25 -05:00
Egon Elbre
85b43926b4
Separate identity from server config ( #1138 )
2019-01-25 16:54:54 +02:00
Egon Elbre
a1027c7836
Make inmemory a separate command ( #1127 )
2019-01-24 23:04:29 +02:00
Egon Elbre
78b0414e6c
internal/sync2: fix file handle leak ( #1124 )
2019-01-24 22:48:54 +02:00
Cameron
f5b1e77cf2
rollup timestamp fix ( #1132 )
...
* create timestamp if isNew
* pass isNil into SaveRollup
2019-01-24 15:41:22 -05:00
Jennifer Li Johnson
856b98997c
updates copyright 2018 to 2019 ( #1133 )
2019-01-24 15:15:10 -05:00
Jennifer Li Johnson
030d294399
adds logs in rollup and tally run ( #1131 )
2019-01-24 15:05:53 -05:00
Jennifer Li Johnson
70940b8710
Making sure payments works ( #1122 )
...
* byte hours
* updates comment
* removes payment test data methods
* wip
* adds tally and rollup to peer
* remove sim test for payment (for now)
* lint error
2019-01-24 13:44:14 -05:00
Alexander Leitner
c4afec9328
quick log cleanup for storage node ( #1121 )
...
* Clean up logs
2019-01-24 11:09:37 -05:00
Egon Elbre
28427e7fad
Change identity command ( #1128 )
2019-01-24 17:41:16 +02:00
Egon Elbre
5de7f8af7f
Satellite Peer ( #1119 )
2019-01-23 21:58:44 +02:00
Cameron
95d2d54fc3
storagenode approvedSatelliteIDs ( #1116 )
...
* add config fields for satellite restriction on psserver
* add whitelistedSatIDs to psserver Server struct
* check pbwa satellite ID against whitelist
* add whitelist to psserver tests
* reword help message, make approved() a method on server
2019-01-23 12:56:12 -05:00
Michal Niewrzal
3fdb47e31c
Try accessing bootstrap node for verification ( #1089 )
2019-01-23 17:48:46 +02:00
Egon Elbre
8677c68b68
Print successfully connected message every 100 times ( #1118 )
2019-01-23 14:07:22 +02:00
Egon Elbre
05b96f95a3
Change default difficulty to 30 ( #1113 )
2019-01-23 13:36:19 +02:00
Egon Elbre
b6c61cdd55
Use storagenode.Peer for storagenode ( #1107 )
2019-01-23 12:39:03 +02:00
Egon Elbre
99d3b7a3c8
Fix import grouping ( #1111 )
2019-01-22 17:48:23 +02:00
Egon Elbre
ad49f4b994
Enable linters ( #1105 )
2019-01-22 17:09:02 +02:00
Bryan White
322a2813f7
oops ( #1110 )
2019-01-22 15:34:40 +01:00
Egon Elbre
6c48d69c38
Disable mounting for bsd-like systems ( #1109 )
...
* Disable mounting for bsd-like
* Remove debug code
2019-01-22 15:28:57 +02:00
Bryan White
8edfd43abb
certificates config and --certs-dir fixes ( #1093 )
2019-01-22 13:35:48 +01:00
Michal Niewrzal
eb2d858ffc
Use pointerdb.Service instead of pointerdb.Server ( #1099 )
2019-01-19 13:58:53 -05:00
Alexander Leitner
aabcceef52
Don't create identity when running dash ( #1098 )
...
* Don't create identity when running dash
* only use configs for connecting with dash, delete unused client example
* use server address
2019-01-18 18:08:45 +01:00
Cameron
ecd704692e
wip testing and timestamp fix ( #1100 )
...
* wip testing and timestamp fix
* fixed import cycle
2019-01-18 11:53:23 -05:00
Michal Niewrzal
cc1bdef8b7
Move pointerdb logic to a service ( #1037 )
...
* test
* Move pointerdb logic to service
* tset
* reorder constructor params
* restore field
2019-01-18 10:10:21 -05:00
JT Olio
2d53a33bc5
pkg/node: fix connection logging ( #1096 )
...
* pkg/node: fix connection logging
Change-Id: Iac552ac5eb126642fc1d01bae5f44720fafad536
* debug logging
Change-Id: Ibb95bc7baf1d4d0f07640ae807b2eb2f943aaab0
2019-01-18 10:03:19 -05:00
Egon Elbre
2d00f882a3
Kademlia Dialer ( #1092 )
2019-01-18 10:00:56 -05:00
Egon Elbre
78dc02b758
Satellite Peer ( #1034 )
...
* add satellite peer
* Add overlay
* reorganize kademlia
* add RunRefresh
* add refresh to storagenode.Peer
* add discovery
* add agreements and metainfo
* rename
* add datarepair checker
* add repair
* add todo notes for audit
* add testing interface
* add into testplanet
* fixes
* fix compilation errors
* fix compilation errors
* make testplanet run
* remove audit refrences
* ensure that audit tests run
* dev
* checker tests compilable
* fix discovery
* fix compilation
* fix
* fix
* dev
* fix
* disable auth
* fixes
* revert go.mod/sum
* fix linter errors
* fix
* fix copyright
* Add address param for SN dashboard (#1076 )
* Rename storj-sdk to storj-sim (#1078 )
* Storagenode logs and config improvements (#1075 )
* Add more info to SN logs
* remove config-dir from user config
* add output where config was stored
* add message for successful connection
* fix linter
* remove storage.path from user config
* resolve config path
* move success message to info
* log improvements
* Remove captplanet (#1070 )
* pkg/server: include production cert (#1082 )
Change-Id: Ie8e6fe78550be83c3bd797db7a1e58d37c684792
* Generate Payments Report (#1079 )
* memory.Size: autoformat sizes based on value entropy (#1081 )
* Jj/bytes (#1085 )
* run tally and rollup
* sets dev default tally and rollup intervals
* nonessential storj-sim edits (#1086 )
* Closing context doesn't stop storage node (#1084 )
* Print when cancelled
* Close properly
* Don't log nil
* Don't print error when closing dashboard
* Fix panic in inspector if ping fails (#1088 )
* Consolidate identity management to identity cli commands (#1083 )
* Consolidate identity management:
Move identity cretaion/signing out of storagenode setup command.
* fixes
* linters
* Consolidate identity management:
Move identity cretaion/signing out of storagenode setup command.
* fixes
* sava backups before saving signed certs
* add "-prebuilt-test-cmds" test flag
* linters
* prepare cli tests for travis
* linter fixes
* more fixes
* linter gods
* sp/sdk/sim
* remove ca.difficulty
* remove unused difficulty
* return setup to its rightful place
* wip travis
* Revert "wip travis"
This reverts commit 56834849dcf066d3cc0a4f139033fc3f6d7188ca.
* typo in travis.yaml
* remove tests
* remove more
* make it only create one identity at a time for consistency
* add config-dir for consitency
* add identity creation to storj-sim
* add flags
* simplify
* fix nolint and compile
* prevent overwrite and pass difficulty, concurrency, and parent creds
* goimports
2019-01-18 08:54:08 -05:00
Dylan Lott
7bc1944a08
Dashboard updates ( #1087 )
2019-01-18 05:41:25 -05:00
Egon Elbre
bbf81f2479
Consolidate identity management to identity cli commands ( #1083 )
...
* Consolidate identity management:
Move identity cretaion/signing out of storagenode setup command.
* fixes
* linters
* Consolidate identity management:
Move identity cretaion/signing out of storagenode setup command.
* fixes
* sava backups before saving signed certs
* add "-prebuilt-test-cmds" test flag
* linters
* prepare cli tests for travis
* linter fixes
* more fixes
* linter gods
* sp/sdk/sim
* remove ca.difficulty
* remove unused difficulty
* return setup to its rightful place
* wip travis
* Revert "wip travis"
This reverts commit 56834849dcf066d3cc0a4f139033fc3f6d7188ca.
* typo in travis.yaml
* remove tests
* remove more
* make it only create one identity at a time for consistency
* add config-dir for consitency
* add identity creation to storj-sim
* add flags
* simplify
* fix nolint and compile
* prevent overwrite and pass difficulty, concurrency, and parent creds
* goimports
2019-01-18 11:36:58 +01:00
Alexander Leitner
944daeab02
Closing context doesn't stop storage node ( #1084 )
...
* Print when cancelled
* Close properly
* Don't log nil
* Don't print error when closing dashboard
2019-01-17 16:08:05 -05:00
Jennifer Li Johnson
c4b876ddc5
Jj/bytes ( #1085 )
...
* run tally and rollup
* sets dev default tally and rollup intervals
2019-01-17 14:39:32 -05:00
JT Olio
a255e385df
memory.Size: autoformat sizes based on value entropy ( #1081 )
2019-01-17 20:47:57 +02:00
Jennifer Li Johnson
e6fbf63620
Generate Payments Report ( #1079 )
2019-01-17 13:34:13 -05:00
JT Olio
b2e69d847f
pkg/server: include production cert ( #1082 )
...
Change-Id: Ie8e6fe78550be83c3bd797db7a1e58d37c684792
2019-01-17 12:36:45 -05:00
Michal Niewrzal
f9abb4584c
Storagenode logs and config improvements ( #1075 )
...
* Add more info to SN logs
* remove config-dir from user config
* add output where config was stored
* add message for successful connection
* fix linter
* remove storage.path from user config
* resolve config path
* move success message to info
* log improvements
2019-01-16 21:41:43 -05:00
Dylan Lott
82b9b54695
storagenode dashboard is working and passing tests locally ( #1072 )
...
* storagenode dashboard is working and passing tests locally
* linter fixes
* linter fixes
* moar linter fixes god
* review fixes and updates
* linter fixes
2019-01-16 16:09:13 -05:00
paul cannon
a2333c4809
trivial: log bootstrap node address used to DEBUG ( #1063 )
2019-01-16 15:43:00 -05:00
Bill Thorp
342dc857f5
rollup query ( #1056 )
...
* implemention notes
* more notes
* starting rollup query
* not working yet
* fixed build
* fixed cfg bug
* change context cancelled errs to debugs
* using byte hours for at rest tally
* revert changes to go.mod
* comment fixes
* prevent double recording tallies in rollup
* linting
* stop leaking dbx
* nodeid changes
* fix build
2019-01-16 14:30:33 -05:00
paul cannon
b3713b7d92
trivial: log "connection to node failed" at DEBUG level ( #1064 )
...
instead of ERROR, because errors contacting other nodes in the network
are entirely normal and expected, and they don't need urgent attention.
2019-01-16 13:01:59 -05:00
Michal Niewrzal
01e4811a6f
Fix ignored overridden flag in user config ( #1059 )
...
* Fix ignored overridden flag in user config
* rename variable
2019-01-15 16:03:24 -05:00
Egon Elbre
f8906ce000
Change overlay cache database interface ( #1047 )
2019-01-15 11:08:45 -05:00
Michal Niewrzal
ab0c18de3a
Fix SN overrided params ( #1049 )
...
* Fix SN overrided params
* remove one more override
* fix missing var
* overriding default for storage node
* restore removed code
* fix docker
2019-01-15 10:43:10 -05:00
paul cannon
248ee6438f
use Node ID for metrics ID ( #1052 )
...
This change removes automatic metrics reporting for everything going
through process.Exec(), and re-adds metrics reporting for those commands
which are expected to be long-lived. Other commands (which may have been
intermittently sending metrics before this, if they ran unusually long)
will no longer send any metrics.
For commands where it makes sense, a node ID is used as the metrics ID.
2019-01-15 10:02:54 -05:00
Kaloyan Raev
a63abf8fab
Save only user-specific flags to storage node's config.yaml ( #1051 )
2019-01-15 15:55:33 +02:00
Yehor Butko
e38cf8f50d
Renaming and moving pkg/satellite to satellite/console ( #1054 )
...
* [WIP] V3-853 Merge the satellite DB into the master database
* Removing consoleDB from satelliteDB
* Fixing tests for satellite/console
* fixing linter
* sorting imports in satellite/console
* fixing console config
* fixing linter
2019-01-15 15:03:24 +02:00
littleskunk
2aebbeed34
add more bwagreement unit tests ( #1046 )
...
* add more bwagreement unit tests
2019-01-15 05:44:56 +01:00
Alexander Leitner
bfde515391
Clean up Storage node setup ( #1013 )
...
* Edit config on Setup
* Default to 1TiB storage space and 500GiB bandwidth
* Use human readable formats
* Use memory
* units of 1024 are measured with KiB/MiB etc
* pkg/cfgstruct: allow values to be configured with human readable sizes
Change-Id: Ic4e9ae461516d1d26fb81f6e44c5ac5cfccf777f
* Modify tests
* Removed comments
* More merge conflict stuff resolved
* Fix lint
* test fixin
Change-Id: I3a008206bf03a4446da19f642a2f9c1f9acaae36
* Remove commented code but secretly leave it in the histroy forever
* Move flag definition to struct
2019-01-14 16:19:15 -05:00
JT Olio
87925789de
pkg/inspector: split functionality to be per-service ( #1029 )
...
now kad inspector features exist on every server that has
kademlia running. likewise, overlay and statdb.
this means kad inspection features are now available on
storage nodes
Change-Id: I343c873552341de13302bfb7a5d79cccc84fc6b8
2019-01-14 11:47:22 -07:00
Bill Thorp
8b82114b7f
agreement sender bug fix ( #1044 )
2019-01-11 19:31:34 -05:00
Bill Thorp
273c3924ca
continue agreement sender loop on error ( #1020 )
...
* continue agreement sender loop on error
* added REJECTED grpc status
2019-01-11 13:15:49 -05:00
Bryan White
9e1ec633d8
Improve cert signing integration test+: ( #997 )
2019-01-11 15:59:35 +01:00
