Jeff Wendling
098cbc9c67
all: use pkg/rpc instead of pkg/transport
...
all of the packages and tests work with both grpc and
drpc. we'll probably need to do some jenkins pipelines
to run the tests with drpc as well.
most of the changes are really due to a bit of cleanup
of the pkg/transport.Client api into an rpc.Dialer in
the spirit of a net.Dialer. now that we don't need
observers, we can pass around stateless configuration
to everything rather than stateful things that issue
observations. it also adds a DialAddressID for the
case where we don't have a pb.Node, but we do have an
address and want to assert some ID. this happened
pretty frequently, and now there's no more weird
contortions creating custom tls options, etc.
a lot of the other changes are being consistent/using
the abstractions in the rpc package to do rpc style
things like finding peer information, or checking
status codes.
Change-Id: Ief62875e21d80a21b3c56a5a37f45887679f9412
2019-09-25 15:37:06 -06:00
JT Olio
946ec201e2
metainfo: move api keys to part of the request ( #3069 )
...
What: we move api keys out of the grpc connection-level metadata on the client side and into the request protobufs directly. the server side still supports both mechanisms for backwards compatibility.
Why: dRPC won't support connection-level metadata. the only thing we currently use connection-level metadata for is api keys. we need to move all information needed by a request into the request protobuf itself for drpc support. check out the .proto changes for the main details.
One fun side-fact: Did you know that protobuf fields 1-15 are special and only use one byte for both the field number and type? Additionally did you know we don't use field 15 anywhere yet? So the new request header will use field 15, and should use field 15 on all protobufs going forward.
Please describe the tests: all existing tests should pass
Please describe the performance impact: none
2019-09-19 10:19:29 -06:00
Maximillian von Briesen
574c96c350
satellite/metainfo: Verify storagenode signature on satellite upload ( #2985 )
2019-09-18 09:50:33 -04:00
Michal Niewrzal
64c467ffe7
uplink: integrate new Metainfo calls ( #2640 )
2019-09-10 08:39:47 -07:00
Michal Niewrzal
a6721ba92f
satellite/metainfo: Improve metainfo ListSegments ( #2882 )
2019-08-30 23:30:18 +02:00
Egon Elbre
00b2e1a7d7
all: enable staticcheck ( #2849 )
...
* by having megacheck in disable it also disabled staticcheck
* fix closing body
* keep interfacer disabled
* hide bodies
* don't use deprecated func
* fix dead code
* fix potential overrun
* keep stylecheck disabled
* don't pass nil as context
* fix infinite recursion
* remove extraneous return
* fix data race
* use correct func
* ignore unused var
* remove unused consts
2019-08-22 13:40:15 +02:00
Michal Niewrzal
de7dddbe59
metainfo: Batch request ( #2694 )
2019-08-06 16:56:23 +02:00
Michal Niewrzal
688d932d93
Make one implementation for SetAttribution/SetBucketAttribution ( #2683 )
2019-08-05 09:07:40 +02:00
Michal Niewrzal
287fdf9936
Integrate new Metainfo calls (server side) ( #2682 )
2019-08-01 11:04:31 +02:00
Natalie Villasana
238e264a8f
satellite confirms success threshold reached ( #2657 )
2019-07-31 14:28:43 -04:00
Egon Elbre
5d0816430f
rename all the things ( #2531 )
...
* rename pkg/linksharing to linksharing
* rename pkg/httpserver to linksharing/httpserver
* rename pkg/eestream to uplink/eestream
* rename pkg/stream to uplink/stream
* rename pkg/metainfo/kvmetainfo to uplink/metainfo/kvmetainfo
* rename pkg/auth/signing to pkg/signing
* rename pkg/storage to uplink/storage
* rename pkg/accounting to satellite/accounting
* rename pkg/audit to satellite/audit
* rename pkg/certdb to satellite/certdb
* rename pkg/discovery to satellite/discovery
* rename pkg/overlay to satellite/overlay
* rename pkg/datarepair to satellite/repair
2019-07-28 08:55:36 +03:00
Michal Niewrzal
5710dc3a32
Metainfo RPC segment methods (part 2) ( #2616 )
2019-07-24 13:33:23 +02:00
Jess G
353b089927
update testplanet with libuplink ( #2618 )
...
* update testplanet uplink upload with libuplink
* add libuplink to testplanet download
* update createbucket and delete obj with libuplink
* update downloadStream, fix tests
* fix test
* updates for CR comments
2019-07-23 07:58:45 -07:00
Michal Niewrzal
cba008d7df
Add GetObject method to Metainfo ( #2611 )
2019-07-23 13:09:12 +02:00
Michal Niewrzal
0b827f1375
Speedup metainfo tests ( #2556 )
2019-07-16 21:16:41 +02:00
Michal Niewrzal
260d9c49a8
Metainfo RPC objects methods ( #2534 )
2019-07-16 12:39:23 +02:00
Egon Elbre
d52f764e54
protocol: implement new piece signing and verification ( #2525 )
2019-07-11 16:51:40 -04:00
Alexander Leitner
1c5db71faf
Change protobuf expirations to use time.Time ( #2509 )
...
* Change protobuf expirations to use time.Time instead of timestamp.Timestamp
2019-07-09 17:54:00 -04:00
Alexander Leitner
3587e1a579
Change pointerdb pointer to use time.Time for Creation date ( #2483 )
2019-07-09 00:16:50 +02:00
aligeti
a554752ce0
adding expiration date check on satellite's CreateSegment ( #2476 )
...
* adding expiration check on satellite createsegment
2019-07-08 14:10:16 -04:00
Michal Niewrzal
56fcf228fb
Enable bucket name validation ( #2449 )
2019-07-03 14:56:17 -04:00
aligeti
ae8b9698f9
Rename/remove EncryptionScheme -> EncryptionParame… ( #2363 )
...
* rename/remove EncryptionScheme -> EncryptionParameters
2019-07-03 14:07:44 -04:00
Michal Niewrzal
61dfa61e3a
Add timestamp and piece size to piece hash ( #2198 )
2019-07-03 18:14:37 +02:00
Maximillian von Briesen
52e5a4eee3
pass logger into repairer and ecclient ( #2365 )
2019-07-02 13:08:02 +03:00
Egon Elbre
385c046723
pkg/pb: rename Order2 to Order, OrderLimit2 to OrderLimit ( #2406 )
2019-07-01 18:54:11 +03:00
Egon Elbre
2b68a72428
internal/testplanet: ensure that metainfo connections get closed ( #2381 )
2019-07-01 17:35:10 +03:00
Egon Elbre
e83ebd7cde
jenkins: avoid using goimports and distribute load better ( #2359 )
2019-06-27 21:52:50 +03:00
Jeff Wendling
efcdaa43a3
lib/uplink: encryption context ( #2349 )
...
* lib/uplink: encryption context
Change-Id: I5c23dca3286a46b713b30c4997e9ae6e630b2280
* lib/uplink: bucket operation examples
Change-Id: Ia0f6e69f365dcff0cf11c731f51b30842bce053b
* lib/uplink: encryption key sharing test cases
Change-Id: I3a172d565f33f4e591402cdcb9460664a7cc7fbe
* fix encrypted path prefix restriction issue
Change-Id: I8f3921f9d52aaf4b84039de608b8cbbc88769554
* implement panics in libuplink encryption code
todo on cipher suite selection as well as an api concern
Change-Id: Ifa39eb3cc4b3443f7d96f9304df9b2ac4ec4085d
* implement GetProjectInfo api call to get salt
Change-Id: Ic5f6b3be9ea35df48c1aa214ab5d355fb328e2cf
* some fixes and accessors for encryption store
Change-Id: I3bb61f6712a037900e2a96e72ad4029ec1d3f718
* general fixes to builds/tests/etc
Change-Id: I9930fa96acb3b221d9a001f8e274af5729cc8a47
* java bindings changes
Change-Id: Ia2bd4c9c69739c8d3154d79616cff1f36fb403b6
* get libuplink examples passing
Change-Id: I828f09a144160e0a5dd932324f78491ae2ec8a07
* fix proto.lock file
Change-Id: I2fbbf4d0976a7d0473c2645e6dcb21aaa3be7651
* fix proto.lock again
Change-Id: I92702cf49e1a340eef6379c2be4f7c4a268112a9
* fix golint issues
Change-Id: I631ff9f43307a58e3b25a58cbb4a4cc2495f5eb6
* more linting fixes
Change-Id: I51f8f30b367b5bca14c94b15417b9a4c9e7aa0ce
* bug fixed by structs bump
Change-Id: Ibb03c691fce7606c35c08721b3ef0781ab48a38a
* retrigger
Change-Id: Ieee0470b6a2d07168a1578552e8e7f271ae93a13
* retrigger
Change-Id: I753d63853171e6a436c104ce176048892eb974c5
* semantic merge conflict
Change-Id: I9419448496de90340569047a6a16a1b858a7978a
* update total to match prod defaults
Change-Id: I693d55c1ebb28b5803ee1d26e9e198decf82308b
* retrigger
Change-Id: I28b74d5d6202f61aa3866fe407d423f6a0a14b9e
* retrigger
Change-Id: I6fd054885c715f602e2cef623fd464c42e88742c
* retrigger
Change-Id: I6a01bae88c72406d4ed5a8f13bf8a2b3c650bd2d
2019-06-27 17:36:51 +00:00
aligeti
7facda4422
value attribution integration with libuplink ( #2297 )
...
* integrates the value attribution with libuplink
2019-06-26 12:22:01 -04:00
Egon Elbre
b6ad3e9c9f
internal/testrand: new package for random data ( #2282 )
2019-06-26 13:38:51 +03:00
Egon Elbre
414648d660
Fix some metainfo.Client leaks ( #2327 )
2019-06-25 18:36:23 +03:00
Jeff Wendling
c35c8e4c24
allow reading bucket metadata with restricted keys ( #2321 )
...
Change-Id: I47d3a2f5f02744ae6c51d54963cdf2dff24134e2
2019-06-24 17:36:09 -06:00
Michal Niewrzal
fdeb834801
Bucket name validation ( #2244 )
2019-06-24 11:52:25 +02:00
aligeti
043d603cbe
satellite rs config check with validation check set to false default ( #2229 )
...
* satellite rs config check with validation check
2019-06-21 14:15:58 -04:00
Kaloyan Raev
964c87c476
Fix checks around repair threshold ( #2246 )
2019-06-19 22:13:11 +02:00
Egon Elbre
8f4a6afc8a
Fixes for value attribution ( #2238 )
...
* Move value attribution to satellite/
* remove unnecessary conversion
2019-06-19 08:02:37 -04:00
aligeti
8e8a5eb89c
initial value attribution check development ( #2091 )
...
* initial value attribution check development
* code reveiew updates
2019-06-12 21:35:37 -04:00
Michal Niewrzal
b5ac4f3eac
Better metainfo Create/Commit request validation ( #2088 )
2019-06-05 18:41:02 +02:00
Jeff Wendling
1bd52b9f90
server side macaroons ( #1945 )
...
What: Adds macaroon support to the server side
Why: So that api keys are now macaroons
2019-05-24 10:51:27 -06:00
Bill Thorp
91721f63ba
Bt/repair no nodes ( #1974 )
...
* handle cases where repair is equal to total
2019-05-17 15:02:40 -04:00
Kaloyan Raev
8fc5fe1d6f
Refactor pb.Node protobuf ( #1785 )
2019-04-22 12:07:50 +03:00
Michal Niewrzal
a684b7b953
Test number of pieces lower than repair threshold ( #1683 )
2019-04-09 15:31:19 +02:00
Egon Elbre
872bd5d7c1
Remove pointerdb.Server ( #1609 )
2019-03-30 13:21:49 +02:00
