|
Size: 2560
Comment: S3 strong consistency
|
← Revision 13 as of 2021-07-15 19:07:03 ⇥
Size: 2688
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 3: | Line 3: |
| = Services = | = Object storage = == Services == |
| Line 7: | Line 9: |
| [[https://wasabi.com/|Wasabi]]: Amazon S3-like service, Glacier like pricing. Minimum 1 TB. | [[https://wasabi.com/|Wasabi]]: Amazon S3-like service, Glacier like pricing. Minimum 1 TB. Minimum lifetime of 90 days. |
| Line 10: | Line 12: |
[[https://minio.io/|Minio]]: Minimal AWS S3 clone, written in Go. [[https://www.storj.io/|Storj DCS (née Tardigrade)]]. S3-like service, decentralized. == Amazon S3 == [[https://github.com/kahing/goofys|kahing/goofys]]: Fast, s3fs-like FUSE layer over S3-compatible object stores. [[https://github.com/kahing/catfs|kahing/catfs]]: Caching FUSE filesystem. Caches data only, not metadata access. [[https://github.com/gaul/s3proxy|gaul/s3proxy]]: Proxy for clients expecting S3 to use a non-S3 store. Java. Strong consistency: * [[https://www.nextplatform.com/2021/04/22/amazon-cto-on-past-present-future-of-s3/amp/|Amazon CTO on Past, Present, and Future of S3]]: high-level description of S3 improvements, including strong consistency * [[https://www.nextplatform.com/2021/04/22/amazon-cto-on-past-present-future-of-s3/amp/|Diving Deep on S3 consistency]]: more in-depth article S3 strong consistency |
|
| Line 39: | Line 58: |
= Local Services = [[https://minio.io/|Minio]]: Minimal AWS S3 clone, written in Go. = S3 = [[https://github.com/kahing/goofys|kahing/goofys]]: Fast, s3fs-like FUSE layer over S3-compatible object stores. [[https://github.com/kahing/catfs|kahing/catfs]]: Caching FUSE filesystem. Caches data only, not metadata access. [[https://github.com/gaul/s3proxy|gaul/s3proxy]]: Proxy for clients expecting S3 to use a non-S3 store. Java. Strong consistency: * [[https://www.nextplatform.com/2021/04/22/amazon-cto-on-past-present-future-of-s3/amp/|Amazon CTO on Past, Present, and Future of S3]]: high-level description of S3 improvements, including strong consistency * [[https://www.nextplatform.com/2021/04/22/amazon-cto-on-past-present-future-of-s3/amp/|Diving Deep on S3 consistency]]: more in-depth article S3 strong consistency |
Object storage
Services
hubiC. Storage service from OVH. Provides apps, 10 TB for €50/year at max 10 Mbit/stream. OpenSwift-compatible API.
Wasabi: Amazon S3-like service, Glacier like pricing. Minimum 1 TB. Minimum lifetime of 90 days.
Backblaze B2. Amazon S3-like service.
Minio: Minimal AWS S3 clone, written in Go.
Storj DCS (née Tardigrade). S3-like service, decentralized.
Amazon S3
kahing/goofys: Fast, s3fs-like FUSE layer over S3-compatible object stores.
kahing/catfs: Caching FUSE filesystem. Caches data only, not metadata access.
gaul/s3proxy: Proxy for clients expecting S3 to use a non-S3 store. Java.
Strong consistency:
Amazon CTO on Past, Present, and Future of S3: high-level description of S3 improvements, including strong consistency
Diving Deep on S3 consistency: more in-depth article S3 strong consistency
Generic (across all services)
rclone: rsync for cloud storage. Used to work with Amazon Cloud Drive, but only works with some fiddling (not guaranteed to stay working). Workaround discussed in https://forum.rclone.org/t/proxy-for-amazon-cloud-drive/2848 (source code at https://github.com/ncw/oauthproxy).
Google Drive
Clients
skicka: Google Drive client for Linux provided by Google
Amazon Cloud Drive
Reading
See https://developer.amazon.com/public/apis/experience/cloud-drive/content/getting-started for information on getting your client ID and secret.
Using UnionFS-FUSE with Amazon Cloud Drive encrypted files
Software
multidrive: CLI program for uploading to Amazon Cloud Drive
acd_fuse: FUSE adapter for Amazon Cloud Drive
acd_cli: CLI and FUSE adapter for Amazon Cloud Drive
duplicity-acdcli: Plugin for duplicity to upload to Amazon Cloud Drive via acd_cli
