Bill Thorp
6ece4f11ad
moved invalid/offline back into SQL ( #1838 )
...
* moved invalid/offline back into SQL, removed GetAll()
2019-05-01 09:45:52 -04:00
Bill Thorp
2367918331
removed unused .List() method ( #1853 )
...
* removed unused .List()
* removed unused test
2019-04-26 17:41:13 +02:00
Bill Thorp
a11dc76169
wired up online config ( #1827 )
...
* wired up online config
2019-04-26 08:15:06 -04:00
Egon Elbre
ee3bf4a102
only run selection code once ( #1825 )
2019-04-24 06:35:50 -04:00
Bill Thorp
2029c558af
updated audit configs ( #1814 )
...
updated audit configs
2019-04-23 16:47:11 -04:00
Kaloyan Raev
8fc5fe1d6f
Refactor pb.Node protobuf ( #1785 )
2019-04-22 12:07:50 +03:00
Kaloyan Raev
bfdee78f05
Introduce NodeDossier type and cleanup overlay.DB interface ( #1626 )
...
Co-authored-by: Natalie Villasana <navillasa@gmail.com>
Co-authored-by: Bill Thorp <bill3000@hotmail.com>
2019-04-04 19:34:36 +03:00
Kaloyan Raev
f9ba935286
Merge overlay_cache_nodes into nodes table ( #1581 )
2019-03-29 10:53:43 +02:00
Natalie Villasana
5b48a48a79
adds test for correct download with non-critical amount of nodes offline ( #1574 )
2019-03-26 14:09:44 -04:00
Kaloyan Raev
d1639c4157
Merge statdb pkg into overlay pkg ( #1570 )
2019-03-25 18:25:09 -04:00
Egon Elbre
94e79eda6d
remove overlay endpoint ( #1521 )
2019-03-23 10:06:11 +02:00
Maximillian von Briesen
f94a2e1161
Node selection method name change ( #1296 )
...
* SelectNodes -> SelectStorageNodes
2019-02-11 14:24:51 -05:00
Maximillian von Briesen
c9d00d8241
test random selection for new nodes ( #1294 )
2019-02-11 12:10:32 -05:00
Maximillian von Briesen
c6c23a319b
move node type definition to db level for node selection ( #1295 )
2019-02-11 11:35:28 -05:00
Egon Elbre
18bd2d7b1a
Fix randomized selection test limit ( #1290 )
2019-02-11 14:04:00 +02:00
Maximillian von Briesen
690d5447a1
Add test for randomized node selection ( #1271 )
2019-02-09 16:17:49 -05:00
Egon Elbre
30f89b0362
Ensure overlay tests run against postgres ( #1232 )
2019-02-06 15:32:42 +02:00
Dylan Lott
5e1ab841cf
Cache refresher ( #1171 )
...
* got tests passed
* wire up paginate function for cache node retrieval
* Add tests for paginate but they're failing
* fix the test arguments
* Updates paginate function to return more variable
* Updates
* Some test and logic tweaks
* improves config handling in discovery
* adds refresh offset to discovery struct
2019-01-30 11:29:18 -05:00
Jennifer Li Johnson
856b98997c
updates copyright 2018 to 2019 ( #1133 )
2019-01-24 15:15:10 -05:00
Egon Elbre
f8906ce000
Change overlay cache database interface ( #1047 )
2019-01-15 11:08:45 -05:00
Egon Elbre
4346cd060f
Implement mutex around satellitedb ( #932 )
2018-12-27 11:56:25 +02:00
Dylan Lott
05c1644fec
adds delete functions and tests for cache ( #921 )
2018-12-21 11:35:21 -07:00
Egon Elbre
d9b9ae6ffa
Cleanup overlay methods and names. ( #914 )
2018-12-20 15:57:54 +02:00
Michal Niewrzal
a819d819e3
Overlay Cache master db merge ( #877 )
...
* Overlay Cache master db merge
* test update
* review comments
* Fix transaction usage
* removed unused variable
* added better limit handling
* better error handling
2018-12-17 21:14:16 +01:00
Egon Elbre
6b5945139f
Overlay error handling ( #880 )
2018-12-17 20:47:26 +02:00
aligeti
5e1b02ca8b
Statdb master db v3 848 ( #830 )
...
* intial changes to migrate statdb to masterdb framework
* statdb refactor compiles
* added TestCreateDoesNotExist testcase
* Initial port of statdb to masterdb framework working
* refactored statdb proto def to pkg/statdb
* removed statdb/proto folder
* moved pb.Node to storj.NodeID
* CreateEntryIfNotExistsRequest moved pd.Node to storj.NodeID
* moved the fields from pb.Node to statdb.UpdateRequest
ported TestUpdateExists, TestUpdateUptimeExists, TestUpdateAuditSuccessExists TestUpdateBatchExists
2018-12-14 15:17:30 -05:00
Dylan Lott
9bdee7b106
Discovery service ( #805 )
...
* WIP possible discovery service impl
* Adds discovery service to CaptPlanet
* Updates the config and server for discovery service
* updates testplanet to use discovery package
* update satellite imports
* Removes unnecessary cache test
* linter fixes
* adds discovery startup to captplanet
* invoke refresh
* updates to discovery refresh cycle
* Make implementation more consistent with previous implementation
* add wait before trying to upload
* sleep a bit more
* remove kademlia bootstrap
* updates
* remove comments
2018-12-14 12:23:54 -07:00
Maximillian von Briesen
6c655d117b
Filter nodes by reputation and IP address (node selection) ( #720 )
...
* Pulls statdb stats into overlay cache whenever cache.Put() is called
* Updates overlay.FindStorageNodes()/overlayClient.Choose() to filter based on node stats
* Updates overlay.FindStorageNodes()/overlayClient.Choose() to exclude duplicate IP addresses
2018-12-04 15:18:26 -05:00
Egon Elbre
1e4556f88a
Fix import groupings ( #739 )
2018-11-30 15:40:13 +02:00
Bryan White
2a0c4e60d2
preparing for use of customtype gogo extension with NodeID type ( #693 )
...
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* preparing for use of `customtype` gogo extension with `NodeID` type
* review changes
* wip
* tests passing
* wip fixing tests
* more wip test fixing
* remove NodeIDList from proto files
* linter fixes
* linter fixes
* linter/review fixes
* more freaking linter fixes
* omg just kill me - linterrrrrrrr
* travis linter, i will muder you and your family in your sleep
* goimports everything - burn in hell travis
* goimports update
* go mod tidy
2018-11-29 19:39:27 +01:00
Egon Elbre
d07433c150
Use testplanet to test Refresh ( #678 )
2018-11-19 16:40:01 +02:00
Egon Elbre
6fe16e48ba
Simplify and fix tests ( #660 )
2018-11-16 18:31:14 +02:00
Bill Thorp
d3c347a0ac
Verify overlay cache is accurately and fully tested ( #540 )
...
* added intro node id, moved port range to 1024, listen in go routines
2018-11-14 16:30:07 -05:00
Bryan White
8b9711cb5e
better waitlist-gating ( #557 )
...
* better waitlist-gating
(cherry picked from commit 490fe02b7c3558da18678dfb651c92ec9c4a75b5)
* fix broken test
* linter fixes
* linter fixes
* make extension verification optional
* add certifcate gating script for captplanet
* fixing tests
* linter fixes
* linter fixes?
* moar linter fixes
* Revert "moar linter fixes"
This reverts commit 8139ccbd73cbbead987b7667567844f50f7df2c8.
* just kill me
* refactor
* refactor tests
* liniter...
* cleanup
2018-11-01 16:48:43 +01:00
Egon Elbre
68796d7964
Ensure we can create kademlia with custom storage ( #533 )
2018-10-26 19:54:00 +03:00
Bill Thorp
69b1307bd4
use net.JoinHostPort ( #484 )
...
* Used net.JoinHostPort
* ordered imports
2018-10-16 11:34:05 -04:00
Egon Elbre
caecb2801d
Cleanups related to transport ( #475 )
...
* Remove DialUnauthenticated method
* Use more specific node transport enum
* Formatting
* Rename Provider.g -> Provider.grpc
* Fix naming in dialer
2018-10-15 15:04:21 +03:00
Dylan Lott
7849d7fa63
Remove newID function ( #468 )
...
* Removes node.NewID usage from kademlia tests
* Updates more tests
* remove comments
* removes NewID method from overlay tests
* adds error checking to NewFullIdentity
* removes /x/tools from go.mod
* Removes commented out code
2018-10-12 15:10:50 -06:00
Dylan Lott
a69bc65a30
Kad flags ( #443 )
...
* Allows kademlia params to be configured with flags
* Removes commented out code
* updates kad tests to use kadconfig struct
2018-10-09 10:47:05 -06:00
Dennis Coyle
783f055417
create db directory if it does not exist ( #439 )
...
* create db directory if it does not exist
* linter fix
* pass db path in from config
* change mkdir to mkdirAll
* windows love
* PR comments
* changing the path
* change the config default to $CONFDIR/kademlia
2018-10-08 16:37:52 -04:00
Dennis Coyle
dee2c137c8
Remove BKAD dependency from pkg/kademlia ( #294 )
...
* slowly but surely
* hardcode ID for tests so we can get predictable results
* skipping bad test
* removing tests of bkad
* wip
* new algorithm for worker
* clean up
* remove skipped test
* changes
* uncomment
* fixed conflicts
* maybe done ?
* cleanup
* boot bkad
* wip
* cleanup
* undo change
* fixes
* wip
* wip
* moving nodeID around
* wip
* wip
* fixes
* fixes after merge
* added TODO
* fixed tests post identity
* linter fixes
* wip
* PR review comments
* wip
* fixing tests
* fix tests
* force db directory
* bad test
* fixes race condition
* small cleanups
* adding db folder
* testing
* wip
* cleanup
* cleanup
* linters
* export Restrict
* add timeout
* testing
* linters
* forgot one
* moar fixes from master merge
* PR comments
* moar PR comments
* removed stun flag
* remove duplicate declaration
* remove old tests
* remove timeout
* fix tests
* missed one
* changed StringToID >> IDFromString
* PR comments
* stupid linter
* moevd overlay mock
* fixed merge conflicts
* fixes
* linter
2018-10-08 11:09:37 -04:00
Egon Elbre
b6b6111173
Flatten proto definitions into a single package ( #360 )
...
* protos: move streams to pb
* protos: move overlay to pb
* protos: move pointerdb to pb
* protos: move piecestore to pb
* fix statdb import naming
2018-09-18 07:39:06 +03:00
Egon Elbre
6ee6f0fdf5
Remove duplicated mock store implementations ( #337 )
2018-09-11 10:27:12 +03:00
Jennifer Li Johnson
d0f87f0de1
Overlay Bulk Lookup ( #279 )
...
* implements bulk node lookup from overlay cache
2018-09-11 00:52:14 -04:00
Egon Elbre
00ac266bda
Remove zap dependency from boltdb ( #334 )
...
* Remove zap dependency from boltdb
* Avoid pulling in testing in main binary
2018-09-10 05:52:53 -04:00
JT Olio
fd94300c53
move stacktraces to debug level, disable debug by default ( #329 )
...
* move stacktraces to debug level, disable debug by default
* configure zap better
* var to const
2018-09-09 05:27:09 -06:00
Egon Elbre
ff57fa5c00
use better redis server setup with fallback ( #310 )
2018-09-07 10:33:33 +03:00
Egon Elbre
0f5a2f4ef5
Enable more linters ( #272 )
...
* enable more linters
* Run gofmt -s
* run goimports
* run unconvert
* fix naked return
* fix misspellings
* fix ineffectual assigments
* fix missing declaration
* don't use deprecated grpc.Errof
* check errors in tests
* run gofmt -w -r "assert.Nil(err) -> assert.NoError(err)"
* fix directory permissions
* don't use nil Context
* simplify boolean expressions
* use bytes.Equal instead of bytes.Compare
* merge variable declarations, remove redundant returns
* fix some golint errors
* run goimports
* handle more errors
* delete empty TestMain
* delete empty TestMain
* ignore examples for now
* fix lint errors
* remove unused values
* more fixes
* run gofmt -w -s .
* add more comments
* fix naming
* more lint fixes
* try switching travis to go1.11
* fix unnecessary conversions
* fix deprecated methods
* use go1.10 and disable gofmt/goimports for now
* switch to 1.10
* don't re-enable gofmt and goimports
* switch covermode to atomic because of -race
* gofmt
2018-08-27 11:28:16 -06:00
Egon Elbre
f80185a807
Preliminary support for windows ( #266 )
...
* Don't use url.Parse for bolt paths: filepaths may not be valid URL-s.
* go.mod: update dependencies
* README.md: add Windows instructions
* pkg/overlay: check for the correct path and text in error
* pkg/overlay: fix tests for windows
* pkg/piecestore: make windows tests pass
* pkg/telemetry: skip test, as it doesn't shutdown nicely
* storage/redis: ensure that redis is clean before running tests
2018-08-23 10:05:56 +03:00
nfarah86
d396eb6be9
Bug/download ( #216 )
...
* fixed downloading empty file
* fixed formatting
* fixed error handling
* fixed cache_test.go to accomodate for error
* fixed error verbose messaging for wrong downlaods
* clean up
2018-08-14 08:22:29 -07:00
