storj/storagenode
Simon Guindon a2b1e9fa95
storagenode/storagenodedb: refactor both data access objects and migrations to support multiple DB connections (#3057)
* Split the info.db database into multiple DBs using Backup API.

* Remove location. Prev refactor assumed we would need this but don't.

* Added VACUUM to reclaim space after splitting storage node databases.

* Added unique names to SQLite3 connection hooks to fix testplanet.

* Moving DB closing to the migration step.

* Removing the closing of the versions DB. It's already getting closed.

* Swapping the database connection references on reconnect.

* Moved sqlite closing logic away from the boltdb closing logic.

* Moved sqlite closing logic away from the boltdb closing logic.

* Remove certificate and vouchers from DB split migration.

* Removed vouchers and bumped up the migration version.

* Use same constructor in tests for storage node databases.

* Use same constructor in tests for storage node databases.

* Adding method to access underlining SQL database connections and cleanup

* Adding logging for migration diagnostics.

* Moved migration closing database logic to minimize disk usage.

* Cleaning up error handling.

* Fix missing copyright.

* Fix linting error.

* Add test for migration 21 (#3012)

* Refactoring migration code into a nicer to use object.

* Refactoring migration code into a nicer to use object.

* Fixing broken migration test.

* Removed unnecessary code that is no longer needed now that we close DBs.

* Removed unnecessary code that is no longer needed now that we close DBs.

* Fixed bug where an invalid database path was being opened.

* Fixed linting errors.

* Renamed VersionsDB to LegacyInfoDB and refactored DB lookup keys.

* Renamed VersionsDB to LegacyInfoDB and refactored DB lookup keys.

* Fix migration test. NOTE: This change does not address new tables satellites and satellite_exit_progress

* Removing v22 migration to move into it's own PR.

* Removing v22 migration to move into it's own PR.

* Refactored schema, rebind and configure functions to be re-useable.

* Renamed LegacyInfoDB to DeprecatedInfoDB.

* Cleaned up closeDatabase function.

* Renamed storageNodeSQLDB to migratableDB.

* Switched from using errs.Combine() to errs.Group in closeDatabases func.

* Removed constructors from storage node data access objects.

* Reformatted usage of const.

* Fixed broken test snapshots.

* Fixed linting error.
2019-09-18 12:17:28 -04:00
..
bandwidth all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
collector all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
console storagenode/console: remove kademlia (#2942) 2019-09-11 16:41:43 -04:00
contact pkg/pb: minor changes to contact.proto (#3048) 2019-09-13 19:37:32 -05:00
inspector storagenode/inspector: fix TestInspectorStats flakyiness by waiting for requests to be handled (#3018) 2019-09-12 02:26:55 -07:00
monitor all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
nodestats all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
orders storagenode/orders: fix data race in settle (#3042) 2019-09-13 15:50:39 +03:00
pieces storagenode/pieces: fix race condition in cache service (#2972) 2019-09-12 12:42:39 -04:00
piecestore bootstrap/satellite/certificate/storagenode: register drpc services 2019-09-12 15:09:46 -06:00
reputation all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
retain all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
storagenodedb storagenode/storagenodedb: refactor both data access objects and migrations to support multiple DB connections (#3057) 2019-09-18 12:17:28 -04:00
storageusage all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
trust all: add archview annotations (#2964) 2019-09-10 16:24:16 +03:00
peer.go bootstrap/satellite/certificate/storagenode: register drpc services 2019-09-12 15:09:46 -06:00