# »Loading data into CrateDB« weekly edition **URL:** \ **Category:** Tutorials\ **Tags:** integration, getting-started\ **Created:** [July 7, 2025, 10:00pm UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052 "2025-07-07T22:00:00Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [July 7, 2025, 10:00pm UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/1 "2025-07-07T22:00:00Z")
## Introduction We are currently unlocking data loading into CrateDB using the excellent [ingestr](https://bruin-data.github.io/ingestr/) toolkit, based on [dlt](https://dlthub.com/docs/intro) \[1\]. This topic informs about the progress and gives everyone the chance to participate early in the development. ## Prerequisites For executing the commands in this walkthrough, you need a working installation of [Docker](https://www.docker.com/) or [Podman](https://podman.io/) and a [Python](https://www.python.org/) installation on your machine. For installing Python packages, we recommend to use the [uv](https://docs.astral.sh/uv/) package manager \[2\]. ## Call for support Because relevant data adapters are still in their infancy, we will very much appreciate receiving feedback in form of bug reports, suggestions for improvements, or success notes. ## Other options CrateDB also provides integrations for many other [ETL applications and frameworks](https://cratedb.com/docs/guide/ingest/etl/). * * * 1. The CrateDB destination adapter for ingestr uses [dlt](https://github.com/dlt-hub/dlt) via [dlt-cratedb](https://github.com/crate/dlt-cratedb). 2. The `uv` package manager can easily be installed using `pip` or `pipx`, e.g. `pipx install uv`. It also offers [other installation methods](https://docs.astral.sh/uv/getting-started/installation/). ---
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [July 9, 2025, 8:29pm UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/4 "2025-07-09T20:29:55Z")
# Loading data from Amazon Kinesis ## Synopsis ```shell ctk load \ "kinesis:?aws_access_key_id=test&aws_secret_access_key=test®ion_name=us-east-1&table=demo" \ "crate://crate:crate@localhost:4200/testdrive/kinesis" ``` ## Documentation > **[Amazon Kinesis](https://cratedb-toolkit.readthedocs.io/io/stream/kinesis.html#kinesis)** > > Load data from Amazon Kinesis into CrateDB. Amazon Kinesis is a cloud-based service to collect and process large streams of data records in real time. Prerequisites: Use Docker or Podman to run all... ---
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [July 8, 2025, 8:56pm UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/5 "2025-07-08T20:56:45Z")
# Loading data from Apache Kafka ## Synopsis ```shell ctk load \ "kafka:?bootstrap_servers=localhost:9092&group_id=test&table=demo" \ "crate://crate:crate@localhost:4200/testdrive/kafka" ``` ## Documentation > **[Apache Kafka](https://cratedb-toolkit.readthedocs.io/io/stream/kafka.html)** > > Load data from Apache Kafka into CrateDB. Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics... ---
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [February 8, 2026, 2:00am UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/6 "2026-02-08T02:00:24Z")
# Loading data from Databricks SQL warehouses ## Synopsis ```shell ctk load \ "databricks://token:@.cloud.databricks.com:443/?http_path=/sql/1.0/warehouses/&catalog=samples&table=accuweather.forecast_hourly_metric" \ "crate://crate:crate@localhost:4200/testdrive/accuweather_forecast_hourly_metric" ``` ## Documentation > **[Databricks](https://cratedb-toolkit.readthedocs.io/io/data-warehouse/databricks/)** > > Load data from Databricks into CrateDB. Databricks is a cloud-based data warehouse platform for big data analytics and artificial intelligence based on Apache Spark and Delta Lake. Prerequisites: U... ---
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [February 8, 2026, 9:13pm UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/7 "2026-02-08T21:13:02Z")
# Loading data from SAP HANA ## Synopsis ```shell ctk load \ "hana://SYSTEM:HXEHana1@localhost:39017/SYSTEMDB?table=sys.adapters" \ "crate://crate:crate@localhost:4200/testdrive/hana_sys_adapters" ``` ## Documentation > **[SAP HANA](https://cratedb-toolkit.readthedocs.io/io/data-warehouse/hana/)** > > Load data from SAP HANA into CrateDB. SAP HANA is a high-performance, in-memory data warehousing solution, including SAP BW/4HANA and native SQL options. It enables real-time data consolidation, an... ---
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [March 4, 2026, 12:31pm UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/9 "2026-03-04T12:31:27Z")
# Apache Iceberg and Delta Lake (load and save) Hi again. We recently added I/O adapters for [Apache Iceberg](https://iceberg.apache.org/) tables \[1\] and [Delta Lake](https://delta.io/) tables \[2\] following our aims to enhance [interoperability with open table formats](https://github.com/crate/crate-clients-tools/issues/264). Both are [open table formats](https://www.baeldung.com/cs/open-table-formats) that build upon [Apache Parquet](https://en.wikipedia.org/wiki/Apache_Parquet) data files, a free and open-source column-oriented data storage format, effectively succeeding and superseding [Apache Hive](https://hive.apache.org/) use cases from the [Hadoop](https://hadoop.apache.org/) era. CrateDB Toolkit now provides adapters to import and export data into/from those open table formats. Please let us know if you can discover any flaws and don’t hesitate to share any ideas for improvement. Thank you in advance. 🙏 ## Synopsis ```shell uv tool install --upgrade 'cratedb-toolkit[iceberg,deltalake]' ``` ```shell ctk load \ "s3+iceberg://bucket1/demo/taxi-tiny/metadata/00003-dd9223cb-6d11-474b-8d09-3182d45862f4.metadata.json?s3.access-key-id=&s3.secret-access-key=&s3.endpoint=&s3.region=" \ "crate://crate:crate@localhost:4200/demo/taxi-tiny" ``` ```shell ctk load \ "s3+deltalake://bucket1/demo/taxi-tiny?AWS_ACCESS_KEY_ID=&AWS_SECRET_ACCESS_KEY=&AWS_ENDPOINT=&AWS_REGION=" \ "crate://crate:crate@localhost:4200/demo/taxi-tiny" ``` ## Documentation - [Apache Iceberg I/O - CrateDB Toolkit](https://cratedb-toolkit.readthedocs.io/io/open-table/iceberg/) - [Delta Lake I/O - CrateDB Toolkit](https://cratedb-toolkit.readthedocs.io/io/open-table/deltalake/) * * * 1. [Iceberg is a specification](https://iceberg.apache.org/spec/) and high-performance format for huge analytic tables, making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time. Apache Iceberg is its reference implementation. 2. Delta Lake ([paper](https://www.databricks.com/wp-content/uploads/2020/08/p975-armbrust.pdf)) is the optimized storage layer that [provides the foundation and default format for all table operations on Databricks](https://docs.databricks.com/aws/en/delta/). It was developed for tight integration with Structured Streaming, allowing you to easily use a single copy of data for both batch and streaming operations and providing incremental processing at scale. ---
**Author:** ![amotl](https://sea2.discourse-cdn.com/flex020/user_avatar/community.cratedb.com/amotl/32/617_2.png) [@amotl](https://community.cratedb.com/u/amotl)\ **Post date:** [March 5, 2026, 2:10am UTC](https://community.cratedb.com/t/loading-data-into-cratedb-weekly-edition/2052/10 "2026-03-05T02:10:56Z")
# Loading data from Elasticsearch ## Synopsis ```shell ctk load \ "elasticsearch://localhost:9200?secure=false&table=taxi_details" \ "crate://crate:na@localhost:4200/testdrive/taxi_details" ``` ## Documentation > **[Elasticsearch](https://cratedb-toolkit.readthedocs.io/io/search-engine/elasticsearch/)** > > Load data from Elasticsearch into CrateDB. Elasticsearch is a source-available search engine developed by Elastic. It is based on Apache Lucene and provides a distributed, multitenant- capable full...