Go to file
paul cannon 2feb49afc3 cmd/tools/segment-verify: don't cache offline status forever
Because it was originally intended to work on only a few pieces from
each segment at a time, and would frequently have reset its list of
online nodes, segment-verify has been taking nodes out of its
onlineNodes set and never putting them back. This means that over a long
run in Check=0 mode, we end up treating more and more nodes as offline,
permanently. This trend obfuscates the number of missing pieces that
each segment really has, because we don't check pieces on offline nodes.

This commit changes the onlineNodes set to an "offlineNodes" set, with
an expiration time on the offline-ness quality. So nodes are added to
the offlineNodes set when we see they are offline, and then we only
treat them as offline for the next 30 minutes (configurable). After that
point, we will try connecting to them again.

Change-Id: I14f0332de25cdc6ef655f923739bcb4df71e079e
2023-01-03 23:11:42 +00:00
.github .github: remove invalid codeowners 2022-11-10 15:52:48 +02:00
certificate certificate/authorization: add golden test for Group marshaling 2022-10-18 14:19:03 -04:00
cmd cmd/tools/segment-verify: don't cache offline status forever 2023-01-03 23:11:42 +00:00
crashcollect crashcollect: removed redundant structure 2021-04-28 00:35:39 +03:00
docs docs/blueprints: Satellite Node Events Design Doc 2022-12-23 20:15:00 +00:00
installer/windows storj/storj: more domain changes 2021-04-15 20:51:43 +00:00
multinode cmd/multinode: generate identity when not provided 2022-10-12 12:01:14 +00:00
private console/userinfo: stub userinfo endpoint 2022-12-20 06:10:08 +00:00
resources cmd: add ca-certificates to Docker images (#3986) 2020-12-08 01:38:33 +01:00
satellite satellite/gc/bloomfilter: implement rangedloop observer 2023-01-03 09:46:02 -07:00
scripts satellite/gc/bloomfilter: implement rangedloop observer 2023-01-03 09:46:02 -07:00
storage all: replace deprecated ioutil 2022-10-31 15:50:41 +00:00
storagenode storagenode/pieces: fix concurrent empty and restore trash 2023-01-03 15:01:54 +00:00
testsuite storagenode/pieces: fix concurrent empty and restore trash 2023-01-03 15:01:54 +00:00
versioncontrol all: fix deprecated ioutil commands 2022-10-11 15:27:29 +00:00
web web/satellite: ShareContainer, ShareButton refactored and migrated to use composition api 2022-12-23 21:42:00 +00:00
.dockerignore Forward-port release-alpha8 build script issues (#1726) 2019-04-09 23:01:10 -06:00
.earthlyignore build: provides earthfile for nightly build 2022-10-27 09:25:17 +00:00
.gitattributes web/: add check for change to eslint import 2021-12-21 15:59:23 +00:00
.gitignore gitignore: add go workspace files 2022-12-13 10:15:53 -07:00
.gitreview add config file for git review usage 2021-10-14 18:01:30 +00:00
CODE_OF_CONDUCT.md Adding CODE_OF_CONDUCT to storj/storj repo (#779) 2018-12-07 15:10:02 -05:00
CODEOWNERS CODEOWNERS: added package ownership for Team Integrations 2022-12-05 16:25:53 +00:00
CONTRIBUTING.md go.mod: update to minimum supported go version (#4239) 2021-10-22 21:12:13 +02:00
DEVELOPING.md Makefile: run lint locally in docker 2022-05-25 12:30:15 -05:00
docker-compose.tests.yaml Makefile: disable postgres fsync in the test container 2022-12-01 22:03:31 +00:00
Earthfile build: use latest storj-up@main in Earthfile 2022-12-12 15:06:01 +00:00
go.mod storagenode/pieces: fix concurrent empty and restore trash 2023-01-03 15:01:54 +00:00
go.sum storagenode/pieces: fix concurrent empty and restore trash 2023-01-03 15:01:54 +00:00
Jenkinsfile ci: fixes for new Go version 2022-11-02 15:17:46 +02:00
Jenkinsfile.premerge ci: removed ui artifacts (#5400) 2022-12-12 14:15:16 +01:00
Jenkinsfile.public ci: removed ui artifacts (#5400) 2022-12-12 14:15:16 +01:00
Jenkinsfile.verify ci: removed ui artifacts (#5400) 2022-12-12 14:15:16 +01:00
LICENSE license code with agplv3 (#126) 2018-07-05 10:24:26 -04:00
MAINTAINERS.md Maintainers: remove link 2022-03-14 14:16:31 +02:00
Makefile ci: fixes for new Go version 2022-11-02 15:17:46 +02:00
monkit.lock satellite/audit: Begin using piecewise reverifications 2022-12-16 14:21:13 +00:00
proto.lock multinode/payouts: paystub extended with disposed 2021-06-01 16:28:20 +00:00
README.md Update README.md (#4320) 2021-12-22 14:12:58 +01:00

Storj V3 Network

Go Report Card Go Doc Coverage Status

Storj is building a decentralized cloud storage network. Check out our white paper for more info!


Storj is an S3-compatible platform and suite of decentralized applications that allows you to store data in a secure and decentralized manner. Your files are encrypted, broken into little pieces and stored in a global decentralized network of computers. Luckily, we also support allowing you (and only you) to retrieve those files!

Table of Contents

Contributing to Storj

All of our code for Storj v3 is open source. If anything feels off, or if you feel that some functionality is missing, please check out the contributing page. There you will find instructions for sharing your feedback, building the tool locally, and submitting pull requests to the project.

A Note about Versioning

While we are practicing semantic versioning for our client libraries such as uplink, we are not practicing semantic versioning in this repo, as we do not intend for it to be used via Go modules. We may have backwards-incompatible changes between minor and patch releases in this repo.

Start using Storj

Our wiki has documentation and tutorials. Check out these three tutorials:

License

This repository is currently licensed with the AGPLv3 license.

For code released under the AGPLv3, we request that contributors sign our Contributor License Agreement (CLA) so that we can relicense the code under Apache v2, or other licenses in the future.

Support

If you have any questions or suggestions please reach out to us on our community forum or file a ticket at https://support.storj.io/.