Go to file
Natalie Villasana a4bb03d0da
adds inline segment support for segmentstore (#162)
* begins adding inline segment support for segmentstore

* adds PeekThresholdReader struct plus Read and isInline methods

* moves PeekThresholdReader to peek.go, adds more simplified Read function

* adds PeekThresholdReader tests

* reverts Read function to earlier version, updates tests to use ReadFull instead

* Get function now handles inline type pointers

* adds correct type Size and ExpirationDate to inline segment

* fixes return value in Put func error condition

* moves thresholdBuf and Read tests into a table test

* adds border case test, fixes redundant parts

* passes sizedReader size to makeRemotePointer
2018-08-01 16:25:06 -04:00
cmd cmd/hc, cmd/gw, cmd/captplanet: simplify setup/run commands (#178) 2018-07-30 01:38:31 -06:00
docs Add error handling section 2018-04-11 07:43:23 -05:00
examples Cleanup metadata across layers (#180) 2018-07-30 21:57:50 +03:00
internal First pass at node restrictions (#146) 2018-08-01 10:15:38 -04:00
logo wip on structure 2018-04-06 12:32:34 -04:00
pkg adds inline segment support for segmentstore (#162) 2018-08-01 16:25:06 -04:00
pointerdb/auth Refactor List in PointerDB (#163) 2018-07-27 09:02:59 +03:00
protos First pass at node restrictions (#146) 2018-08-01 10:15:38 -04:00
scripts protos: update protobufs with go generate (#169) 2018-07-26 13:20:02 -07:00
static Cache (#67) 2018-06-05 17:06:37 -04:00
storage First pass at node restrictions (#146) 2018-08-01 10:15:38 -04:00
test Add files for testing builds in docker (#161) 2018-07-25 17:47:02 -04:00
.clabot Update .clabot (#187) 2018-07-31 12:13:28 -04:00
.gitignore First pass at node restrictions (#146) 2018-08-01 10:15:38 -04:00
.travis.yml Add files for testing builds in docker (#161) 2018-07-25 17:47:02 -04:00
docker-compose.yaml Add files for testing builds in docker (#161) 2018-07-25 17:47:02 -04:00
go.mod pkg/kademlia tests and restructuring (#97) 2018-06-22 09:33:57 -04:00
Gopkg.lock Admin node (#131) 2018-07-09 16:43:32 -06:00
Gopkg.toml dep init (#56) 2018-05-29 20:28:46 -06:00
index.html Cache (#67) 2018-06-05 17:06:37 -04:00
Jenkinsfile Add files for testing builds in docker (#161) 2018-07-25 17:47:02 -04:00
LICENSE license code with agplv3 (#126) 2018-07-05 10:24:26 -04:00
Makefile First pass at node restrictions (#146) 2018-08-01 10:15:38 -04:00
README.md add workaround for error "multiple registrations for /debug/requests" (#183) 2018-07-31 13:53:47 -06:00

Storj

Go Report Card Go Doc Coverage Status

Storj is in the midst of a rearchitecture. Please stay tuned for our v3 whitepaper!


Storj is a platform, token, and suite of decentralized applications that allows you to store data in a secure and decentralized manner. Your files are encrypted, shredded into little pieces and stored in a global decentralized network of computers. Luckily, we also support allowing you (and only you) to recover them!

To start developing

Install required packages

First of all, install git and golang.

Debian based (like Ubuntu)

apt-get install git golang
echo 'export GOPATH="$HOME/go"' >> $HOME/.bashrc
echo 'export PATH="$PATH:${GOPATH//://bin:}/bin"' >> $HOME/.bashrc
source $HOME/.bashrc

Mac OSX

brew install git go
if test -e $HOME/.bash_profile
then
	echo 'export GOPATH="$HOME/go"' >> $HOME/.bash_profile
	echo 'export PATH="$PATH:${GOPATH//://bin:}/bin"' >> $HOME/.bash_profile
	source $HOME/.bash_profile
else
	echo 'export GOPATH="$HOME/go"' >> $HOME/.profile
	echo 'export PATH="$PATH:${GOPATH//://bin:}/bin"' >> $HOME/.profile
	source $HOME/.profile
fi

Install storj

Clone the storj repository. You may want to clone your own fork and branch.

git clone https://github.com/storj/storj $GOPATH/src/storj.io/storj

Install all dependencies

go get can be used to install all dependencies. The execution will take some time. You can add -v if you want to get more feedback.

go get -t storj.io/storj/...

Fix error message cannot use "github.com/minio/cli" and panic: http: multiple registrations for /debug/requests See https://github.com/minio/minio/issues/5974 for more details.

rm -rf $GOPATH/src/github.com/minio/minio/vendor/github.com/minio/cli
rm -rf $GOPATH/src/github.com/minio/minio/vendor/golang.org/x/net/trace
go get -t storj.io/storj/...

Run unit tests

go clean -testcache
go test storj.io/storj/...

You can execute only a single test package. For example: go test storj.io/storj/pkg/kademlia. Add -v for more informations about the executed unit tests.

Start the network

$ go install -v storj.io/storj/cmd/captplanet
$ captplanet setup
$ captplanet run

Configure AWS CLI

$ aws configure
AWS Access Key ID [None]: insecure-dev-access-key
AWS Secret Access Key [None]: insecure-dev-secret-key
Default region name [None]: us-east-1
Default output format [None]: 
$ aws configure set default.s3.multipart_threshold 1TB  # until we support multipart

Do an upload

$ aws s3 --endpoint=http://localhost:7777/ cp large-file s3://bucket/large-file

Support

If you need support, start with the [troubleshooting guide], and work your way through the process that we've outlined.

That said, if you have any questions or suggestions please reach out to us on rocketchat or twitter.