We’re thrilled to unveil a brand-new feature in CrateDB Cloud: Direct Data Import from S3 and compatible storage services. This new capability allows you to effortlessly pull your data from any S3-compatible storage service directly into your CrateDB Cloud cluster. What’s more, you can also specify and reuse securely stored secrets for all your data imports.
Single-File Import: The First Step in Our Journey
Currently, the S3 import supports importing a single file at a time in Parquet, CSV or JSON formats. This means you can effortlessly move individual files from your S3 storage service to CrateDB Cloud with just a few clicks.
We understand that many projects require the ability to import multiple files at once. That’s why we are already working on extending this feature to support globbing, allowing you to import multiple files simultaneously.
Security Is Our Priority: Securely Stored Secrets
To ensure top-notch security, we’ve implemented a mechanism for securely storing secrets that you might need for importing data. Without diving into the technical specifics, know that these secrets are safely stored using state of the art technology and can be reused for future imports. This feature saves you from the hassle of entering sensitive information repeatedly, keeping the process as seamless as possible.
Your Feedback Matters!
We’re committed to making this feature as efficient and user-friendly as possible, and your feedback is crucial for us. Whether it’s a bug, a query, or a feature request, we’re all ears.