S3 Datastore
Store data in an Amazon S3 bucket with local cache synchronization. Provides distributed locking via S3 conditional writes and bidirectional sync between a local cache directory and S3. Features SHA-256 content hashing, per-path dirty tracking, partitioned index for scoped sync, namespace-scoped sync for multi-repo shared datastores, and configurable transfer concurrency.
Authentication
Uses the default AWS credential chain — no credentials in config. Provide credentials via one of:
- Environment variables:
AWS_ACCESS_KEY_ID,AWS_SECRET_ACCESS_KEY - AWS profile:
~/.aws/credentials - IAM role attached to the instance or task
Required IAM Permissions
s3:HeadBuckets3:GetObjects3:PutObjects3:DeleteObjects3:ListBuckets3:HeadObject
Usage
swamp datastore setup @swamp/s3-datastore \
--config '{"bucket": "my-bucket", "prefix": "swamp", "region": "us-east-1"}' --jsonS3-Compatible Endpoints
Supports S3-compatible services (MinIO, DigitalOcean Spaces, etc.) via the
endpoint and forcePathStyle config options.
Store data in an Amazon S3 bucket with local cache synchronization.
Config Fields
| Field | Type | Description |
|---|---|---|
| bucket | string | S3 bucket name |
| prefix? | string | Key prefix within the bucket |
| region? | string | AWS region (defaults to environment/credentials) |
| endpoint? | string | Custom S3-compatible endpoint URL (e.g., https://nyc3.digitaloceanspaces.com) |
| forcePathStyle? | boolean | Use path-style addressing (bucket in path, not subdomain). Default: false |
| pullConcurrency? | number | Maximum concurrent S3 downloads during pull. Default: 50 |
| pushConcurrency? | number | Maximum concurrent S3 uploads during push. Default: 25 |
Modified 1 datastores
Not yet scored.
A score will be generated the next time this extension is published. The owner can also trigger scoring manually.