Skip to content

Releases: storj/storj

v0.28.2

18 Dec 16:23
Compare
Choose a tag to compare

Changelog

General

  • pkg/rpc/rpcpool: add idle expiration to connections

Storagenode

  • storagenode/trust: rule and excluders
  • storagenode/trust: source entry cache
  • cmd/storagenode-updater, pkg/process: Fix logging timestamp
  • storagenode/trust: list implementation
  • storagenode/trust: wire up list into pool
  • storagenode/orderdb: fix db lock
  • storagenode/notifications: db created (#3707)
  • storagenode/garbagecollection: enable in production

Uplink

  • uplink: remove dependency to storage/ (#3720)
  • lib/uplinkc: use SliceHeader instead of [1<<30]
  • uplink/storage: remove unused Meta methods
  • uplinkc: add restrict_scope function (#3724)

Satellite

  • satellite/metainfo: don't leak error implementation detail (#3722)
  • segment-reaper: fix for not analyzing last project in detect command
  • satellite/console: project usage limits api (#3702)
  • satellite/payments/tokens: return checkout url on new deposit (#3696)
  • web/satellite: billing page behaviour (#3711)
  • web/satellite: deposit link opens directly
  • do not update pointer for failed audits
  • web/satellite: project limits
  • web/satellite: billing banner changed
  • private/dbutil: register "cockroach" as sql.DB driver
  • scripts: Add script that filters postgres plaintext backup to cockroachdb compat.

v0.27.1

11 Dec 16:35
Compare
Choose a tag to compare

Changelog

General

  • add sourcerer hall-of-fame to README

Storagenode

  • storagenode: add new metric satellite.request (#3610)
  • web/storagenode: egress chart implemented (#3574)
  • storagenode/collect: delete piece 24 hours after expiration (#3613)
  • storagenode/pieces: Add Trash and RestoreTrash to piecestore (#3575)
  • storagenode: add bandwidth metrics (#3623)
  • storagenode/gracefulexit: improve logging (#3633)
  • web: ms edge support bug fixed (#3638)
  • web/storagenode: ingress chart implemented (#3618)
  • web/storagenode: disk space chart's tooltip reworked (#3652)
  • web/storagenode: info containers of remaining bandwidth/diskSpace replaced (#3653)
  • web/storagenode: minimal allowed version view implemented (#3583)
  • storagenode/pieces: Add EmptyTrash functionality (#3640)
  • add completion receipt to exit-status cli command on storage node (#3650)
  • storagenode: Add new endpoint to receive satellite requests for deleting pieces (#3590)
  • web/storagenode: disk space chart's tooltip size fixed (#3684)
  • web/storagenode: blurred checks hint added for all satellites state (#3709)
  • storagenode/garbagecollection: increase MaxTimeSkew to be higher than satellite MaxCommitInterval
  • storagenode/trust: satellite URL implementation
  • storagenode/trust: source implementations

Uplink

  • uplinkc: basic support for Scope (#3689)
  • uplink/metainfo: remove additional GetObject from download
  • uplinkc: add more functions to manage Scope (#3694)
  • uplinkc: add download_range function (#3704)

Storj-sim

  • storj-sim: work with cockroach:// urls for satellite databases

Satellite

  • satellite/payments: stripe client use satellite logger, give credits when applying transaction to balance (#3603)
  • satellitedb: merge migration into one step (#3551)
  • web/satellite: successful reset password page styling bug fixed (#3612)
  • satellite/payments: add cents values to transaction info (#3614)
  • satellite/payments: token deposit accept cents (#3628)
  • pkg/pb/referralmanager: update to add satellite ID to Get Tokens request (#3625)
  • satellite/gracefulexit: refactor concurrency (#3624)
  • cmd/segment-reaper: Implement bitmask type (#3626)
  • satellitedb: add support to testplanet for cockroachdb (#3634)
  • satellite/metainfo: reduce pointerDB access for CommitObject (#3589)
  • web/satellite: token payments logic (#3581)
  • satellite/accounting: separate project limit from project entity (#3632)
  • satellite/referrals: set up referrals service and http endpoints (#3566)
  • cmd/segment-reaper: skeleton command for zombie deletion (#3599)
  • refactor sql to be compatible with pq and cockroach (#3647)
  • web/satellite: referral links (#3655)
  • satellite/payments: coupons and coupon usage (#3648)
  • web/satellite: billing banners (#3649)
  • satellite/mailservice: move logging to send rendered async to cover template parsing (#3654)
  • satellitedb/accounting: project usage optimization (#3668)
  • web/satellite: password strength implemented on register page (#3669)
  • Satellite: log the project information for upload, download, and list activities (#3651)
  • web/satellite: referral links and registration (#3678)
  • satellite/satellitedb/satellitedbtest: flag to run cockroach tests (#3674)
  • satellitedb: fixes for cockroachdb compatibility (#3682)
  • satellite/gracefulexit: Add graceful exit completed/failed receipt verification to satellite CLI (#3679)
  • satellite/metainfo, satellite/repair, uplink/eestream: add metric for download failed due to not enough pieces available (#3665)
  • private/dbutil: distinguishes between db drivers and implementations to allow for different implementations of SQL queries.
  • satellitedb/attribution: updates valueAttrQuery to work for both postgres and cockroach
  • private/dbutil/pgutil: make QuerySchema work on crdb
  • satellitedb/repairqueue: runs a different implementation of the query within Select() for postgres vs cockroach
  • storage/cockroachkv: initial client implementation
  • satellite/metainfo: Use cockroachdb client for metainfo db
  • segment-reaper: delete command logic (#3660)
  • cmd/segment-reaper: add detecting and printing zombie segments (#3598)
  • satellite/satellitedb: reset storage node reputations to re-enable disqualification (#3693)
  • satellite/repair: decrease repair interval

v0.26.3

25 Nov 19:24
Compare
Choose a tag to compare

Changelog

Uplink

  • argon2: choose a steady parallelism value (#3630)
  • lib/uplink: explain safe versions (#3644)

Storagenode

  • storagenode/updater: read identity location from storagenode's config.yaml (#3607)

v0.26.2

20 Nov 18:16
Compare
Choose a tag to compare

Changelog

General

  • pkg/rpc: ensure connections are quickly closed
  • all: build release fully dprc and test in mixed mode
  • pkg/{rpc,server,tlsopts}: pick larger defaults for buffer sizes
  • pkg/rpc/rpcstatus: do not depend on grpc/drpc build mode

Storagenode

  • windows/installer: Change "Ethereum wallet address" label to "STORJ payout address" (#3482)
  • docs/blueprints: Storage Node Satellite Selection design (#3353)
  • storagenode/gracefulexit: get hash and limit using original piece ID (#3557)
  • Keep v0pieceinfo database isolated (#3364)
  • storagenode/storagenodedb: dont log opening of each database (#3571)
  • storage/filestore: Add Trash and RestoreTrash to Blobs (#3529)
  • storagenode/updater: recover command in Service Manager (#3425)
  • storagenode-updater: re-enable auto-update storagenode-updater (#3588)
  • storagenode/console: show satellite url in satellite selection (#3602)

Identity

  • {certificates,pkg/rpcstatus}: improve error logging (#3475)

Uplink

  • uplink: Suppress one metainfo call on delete (#3511)
  • lib/uplinkc: add additional fields to UplinkConfig (#3526)
  • storage/postgreskv: fix ultra-slow nonrecursive list (#3564)
  • uplink/storage/streams: Fix upload error clean up (#3555)
  • libuplink: remove additional GetBucket for upload/download (#3568)
  • docs/blueprints: Deletion performance (#3520)
  • uplink/metainfo: remove GetObject from download Batch (#3596)

Satellite

  • satellite/gracefulexit: Check if node already has a piece in the pointer (#3434)
  • satellite/gracefulexit: select new node filtered by Distinct IP (#3435)
  • satellite/gracefulexit: Check if pointer has been overwritten or deleted before sending transfer message. (#3481)
  • satellite/gracefulexit: not allow disqualified node to graceful exit (#3493)
  • docs/design: zombie segments cleaner (#3461)
  • satellite/console: add token deposit API, populate billing history with transactions (#3500)
  • satellite/gracefulexit: add count for order limits sent from satellite to exiting node (#3544)
  • cmd: skeleton for segment-reaper detect command (#3562)
  • satellite/payments: add API for retrieving conversion ratio, convert tokens to USD before applying to balance (#3530)
  • satellite/payments: switch to using STORJ tokens (#3582)
  • satellite/nodeselection: don't select nodes that haven't checked in for a while (#3567)
  • satellite: added ability to inject stripe public key post build (#3560)
  • satellite/repair: reduce upload timeout (#3597)
  • satellite/audit: do not contain nodes for unknown errors (#3592)

Certificate Authority

  • Increase min required difficulty to 36 in signing service (#3535)

v0.25.1

07 Nov 18:03
Compare
Choose a tag to compare

Changelog

General

  • pkg/rpc: remove read/write deadlines as a mechanism for request timeouts (#3335)
  • drpc: version bump (#3386)
  • Increase default difficulty in identity CLI to 36 (#3428)
  • drpc: enable by default (#3452)
  • pkg/rpc/rpcpeer: check both drpc and grpc for peers on a context
  • drpc: bump version
  • Bump go version to 1.13.4 (#3450)
  • release: opt more binaries in to grpc (#3503)
  • logging: unify logging around satellite ID, node ID and piece ID (#3491)
  • cli: should return non-zero code for error (#3469)
  • pkg/rpc: fix grpc dial timeouts (#3517)

Storagenode

  • storagenode/gracefulexit + satellite/gracefulexit: add storagenode-side transfer validation (#3371)
  • Storagenode/windows: Make windows version more dynamic (#3169)
  • storagenode/gracefulexit: Exclude finished exits from chore/worker processing. Fix update status bug (#3399)
  • storagenode/piecestore: Respect config.MaxConcurrentRequests for drpc (#3402)
  • installer/windows: make upgrade possible (#3345)
  • storagenode/gracefulexit: delete pieces when receive Delete or Completed message from satellite (#3406)
  • storagenode-updater: add autoupdating (#3422)
  • installer/windows: custom upgrade validation dialog (#3415)
  • storagenode/contact: fix panic in ping satellites (#3447)
  • storagenode/updater: disable self-autoupdate (#3459)
  • storagenode/pieces: Add migration from v0 piece to v1 piece (#3401)
  • storagenode/contact: exponential backoff retries for pinging Satellites (#3372)
  • storagenode/gracefulexit: allow storagenodes to concurrently transfer pieces for graceful exit (#3478)
  • storagenode/contact: fix connection leak with contact checkin

Uplink

  • uplink: Reduce satellite request using Batch when possible (#3351)
  • uplink/storage: use Batch to optimize upload requests (#3408)
  • mobile: add build stage to Jenkins (#3377)
  • groupcancel/ec delete: add a timeout based on completion times
  • mobile: build gomobile in .build on Jenkins (#3421)
  • Metadata Access from Uplink CLI (#3310)

Satellite

  • satellite/gracefulexit: add failure threshold check (#3329)
  • satellite/gracefulexit: add piece hash validation for successful transfer (#3313)
  • satellite/metainfo: fix broken object listing (#3348)
  • satellite/gracefulexit: Update pointer after success (#3369)
  • docs/storage-node-downtime-tracking: add open issue regarding satellite outages (#3370)
  • satellite/gracefulexit: Add signatures for success/failed exit finished messages. (#3368)
  • satellite/gracefulexit: check duplicate node id before update pointer (#3380)
  • satellite/gracefulexit: add piece num to transfer queue PK (#3390)
  • satellite/gracefulexit: Use original pointer when calling UpdatePieces (#3397)
  • satellite/metainfo: fix index out of range error for validate pointer (#3398)
  • satellite/satellitedb/dbx: remove sqlite.sql file (#3409)
  • satellite/gracefulexit: only allow one connection per node to graceful exit endpoint (#3357)
  • satellite/gracefulexit: add metrics on satellite for graceful exit (#3355)
  • satellite/contact: improve errors in contact endpoints (#3356)
  • satellite/repair: add timeout for repair download from a single node(#3418)
  • satellite/payments: list invoices (#3389)
  • satellite/metainfo: support a wider range of values for RS.Total in satellite metainfo validation (#3431)
  • satellite/gracefulexit: add flag for enabling/disabling graceful exit on the satellite (#3437)
  • satellite/satellitedb: update nodes in sorted order (#3446)
  • satellite: make outgoing connections with grpc (#3457)
  • satellitedb: separate migration into subcommand (#3436)
  • satellite/metainfo: don't allow uplink to commit same piece multiple times (#3460)
  • satellite/audit: increase timeout to 5 minutes (#3480)
  • satellite/audit: do not audit expired segments (#3497)
  • satellite/payments: invoice creation (#3468)
  • satellite/peer: add payments config (#3488)
  • internal/dbutil/pgutil: retry create schema on a concurrent call (#3510)
  • satellite/gracefulexit: handle piece not found messages from storagenode (#3456)

Storj-sim

  • cmd/storj-sim: add --redis flag (#3451)
  • cmd/storj-sim: allow user to designate which redis db they want to start at (#3458)
  • makefile: bump drpc and build storj-sim binaries like release (#3506)
  • storj-sim: add rollout seed to avoid warnings (#3508)

Certificate Authority

  • certificate: change MaxClockOffset (renamed) to 15 min and use duration type (#3438)

v0.24.5

28 Oct 13:51
Compare
Choose a tag to compare

Changelog

General

  • examples/scope: small scope exploder command line tool (#3266)
  • Go 1.13.3 (#3321)
  • pkg/rpc: drpc connection pooling

Storagenode

  • storagenode/web: charts on first day of the month updated (#3219)
  • storagenode/cmd: create start graceful exit CLI (#3202)
  • storagenode/web: node status updated (#3220)
  • storagenode/web: chart y and x axis reworked (#3179)
  • storagenode/gracefulexit: Add graceful exit chore and worker. (#3262)
  • storagenode/cmd: add exit-status command for graceful exit (#3264)
  • storagenode-updater/versioncontrol: add rollout to storagenode updater (#3276)
  • add config dir arg to windows installer (#3328)
  • installer/windows: custom welcome dialog (#3228)
  • storagenode/gracefulexit: Implement storage node graceful exit worker - part 1 (#3322)
  • storagenode/piecestore: Only limit grpc requests (#3342)
    storagenode/piecestore: Rename liveGRPCRequests back to liveRequests #3354
  • storagenode/contact: wait for UpdateSelf before start (#3332)

Uplink

  • mobile: add EncryptionRestrictions (#3260)
  • mobile: create release script (#3197)
  • upload: Add more info to returned error response & to logs (#3218)
  • gomobile Reader.Read should take offset and length params (#3326)
  • Expose range download in gomobile (#3336)

Satellite

  • satellite/gracefulexit: Add protobuf definitions for communication between storage node and satellite (#3201)
  • satellite/overlay: do not include gracefully exiting nodes in node selection (#3211)
  • satellite/console: Added error for adding api key with existing name attempt. (#3185)
  • satellite/payments: payment account setup (#3187)
  • satellite/web: api key validation bug fixed (#3227)
  • satellite/payments: account balance (#3242)
  • satellite/payments: add coinpayments HTTP client (#3181)
  • satellite/gracefulexit: Implement the 'process' endpoint on the satellite (#3223)
  • satellite/discovery: remove discovery related code (#3175)
  • satellite/payments: receive credit cards (#3249)
  • satellite/accounting: add redis support to live accounting (#3213)
  • satellite/cmd: create API subcommand (#3280)
  • satellite/payments: token deposit (#3283)
  • satellite/console: payments api (#3297)
  • satellite/console: add REST registration API endpoint (#3303)
  • satellite/satellitedb: switch to postgres only (#3320)
  • satellite/satellitedb: remove sqlite support (#3296)
  • satellite/console: new passwordChange API endpoint (#3308)
  • satellite/console: forgot password, resend email endpoints added, default http route replaced with gorilla mux (#3327)
  • satellite/metainfo: pass streamID/segmentID between Batch request/response (#3311)
  • satellite/console: add REST delete API endpoint (#3337)
  • satellite/cmd: add graceful exit reports command to satellite CLI (#3300)
  • satellite/payments: add payments loop, update pending transactions (#3318)
  • satellite/payments: credit card selection (#3304)
  • satellite/web: temporar removing of payments api calls (#3361)

Storj-sim

  • storj-sim/cmd: make postgres default to STORJ_SIM_POSTGRES (#3317)
  • scripts: dev script to start postgres before tests (#3344)

Versioncontrol

  • versioncontrol/version: add rollout to versioncontrol server (#3176)

v0.23.5

21 Oct 12:50
Compare
Choose a tag to compare

Changelog

Storagenode

  • pkg/rpc/rpcstatus: fix drpc grpc compatibilty #3306

Satellite

  • satellite/repair: reduce timeout #3302

v0.23.4

16 Oct 18:08
Compare
Choose a tag to compare

Changelog

Storagenode

  • Installer/windows: checkbox for opening SNOboard after installation (#3212)
  • Installer: identity directory defaults to %APPDATA%\Storj\Identity\Storagenode (#3216)
  • Bump drpc version (#3235)
  • Storagenode/piecestore: Fix to ignore both gRPC and dRPC EOF errors. (#3274)

Uplink

  • Uplink/piecestore: Check SN piece hash timestamp (#3246)

Satellite

  • Satellite/repair: dont error on deleted segments (#3252)
  • Satellite/audit: improve logging (#3285)
  • Satellite/PieceHashValidation: Increase time window from 2h to 24h to avoid timezone issues (#3291)
  • Satellite/repair: improve logging (#3287)

Storj-sim

  • cmd/storj-sim: expose GATEWAY_X_API_KEY (#3225)

v0.23.3

13 Oct 18:42
Compare
Choose a tag to compare

Changelog

General

  • OrderLimit/GracePeriod: Increase time window from 1h to 24h (#3255)

Storagenode

  • remove random sleep in storagenode contact (#3243)

Certificate Authority

  • Change Error Handling to return more clear messages to the user/client (#3254)

v0.23.2

09 Oct 15:58
Compare
Choose a tag to compare

Changelog

General

  • Delete Bootstrap and Kademlia (#2974)

Storagenode

  • storagenode/console: use bytes for remaining info (#3186)
  • storagenode/console: use bandwidth monthly summary (#3183)
  • web/storagenode: memory conversions extended (#3188)
  • storagenode/windows: Storage Node Dashboard shortcut opens the SNOboard (#3171)
  • storagenode/signature: Reject uploads with a timestamp too far in the future (#3194)

Uplink

  • mobile: build libuplink aar (#3165)
  • mobile: API updates (#3155)
  • uplink/gateway: wizard message update (#3150)
  • mobile: move to lib/uplink-gomobile (#3177)
  • Add the tempDir as parameter (#3065)

Satellite

  • split satellite: create separate API process (#3152)
  • docs/blueprints: referral manager v1 (#3038)
  • satellite/audit: do not fail or contain nodes for audited segments that are not piece-hash-verified (#3161)
  • satellite/gracefulexit: add transfer queue for pieces (#3174)
  • satellite/accounting: implement tally as an observer (#2992)
  • satellite/audit: Add piece hash verified to log messages (#3204)