# \#orchestration **URL:** https://community.cratedb.com/tag/orchestration/2.md [Latest](https://community.cratedb.com/latest.md) · [Categories](https://community.cratedb.com/categories.md) · [Tags](https://community.cratedb.com/tags.md) --- ## [Version upgrading : The correct sequence?](https://community.cratedb.com/t/version-upgrading-the-correct-sequence/2032)
**Author:** [@cocoa](https://community.cratedb.com/u/cocoa)\ **Replies:** 1\ **Last updated:** [May 23, 2025, 8:26am UTC](https://community.cratedb.com/t/version-upgrading-the-correct-sequence/2032 "2025-05-23T08:26:47Z")
I would like to upgrade CrateDB from version 5.6.3 to version 5.10.6. In the recommendations on GitHub I find written in the release notes “We recommend that you upgrade to the latest 5.9 release before moving to 5.10.6… --- ## [Automating export of CrateDB data to S3 using Apache Airflow](https://community.cratedb.com/t/automating-export-of-cratedb-data-to-s3-using-apache-airflow/901)
**Author:** [@Marija](https://community.cratedb.com/u/Marija)\ **Replies:** 0\ **Last updated:** [November 19, 2021, 1:23pm UTC](https://community.cratedb.com/t/automating-export-of-cratedb-data-to-s3-using-apache-airflow/901 "2021-11-19T13:23:51Z")
Written by Niklas Schmidtmer and Marija Selakovic Introduction This article is the first in a series of articles demonstrating how to effectively use Apache Airflow with CrateDB. In this part, we first introduce Apach… --- ## [Updating stock market data automatically with CrateDB and Apache Airflow](https://community.cratedb.com/t/updating-stock-market-data-automatically-with-cratedb-and-apache-airflow/1304)
**Author:** [@rafaelasantana](https://community.cratedb.com/u/rafaelasantana)\ **Replies:** 0\ **Last updated:** [December 9, 2022, 8:34am UTC](https://community.cratedb.com/t/updating-stock-market-data-automatically-with-cratedb-and-apache-airflow/1304 "2022-12-09T08:34:42Z")
Watch this tutorial on Youtube: https://www.youtube.com/watch?v=YTTUzeaYUgQ&t=685s If you are struggling with keeping your stock market data up to date, this tutorial walks you through exactly what you need to do so y… --- ## [Cluster with integral and independent replicas](https://community.cratedb.com/t/cluster-with-integral-and-independent-replicas/1674)
**Author:** [@cocoa](https://community.cratedb.com/u/cocoa)\ **Replies:** 2\ **Last updated:** [December 18, 2023, 9:16am UTC](https://community.cratedb.com/t/cluster-with-integral-and-independent-replicas/1674 "2023-12-18T09:16:14Z")
Hi, I need help to understand how to handle this situation : I have a cluster of three CrateDB nodes that run on three different hosts, such as docker containers. I thought I had an exact replica of the db on each no… --- ## [Building Seamless Data Pipelines Made Easy: Combining Prefect and CrateDB](https://community.cratedb.com/t/building-seamless-data-pipelines-made-easy-combining-prefect-and-cratedb/1555)
**Author:** [@Marija](https://community.cratedb.com/u/Marija)\ **Replies:** 0\ **Last updated:** [August 3, 2023, 12:13pm UTC](https://community.cratedb.com/t/building-seamless-data-pipelines-made-easy-combining-prefect-and-cratedb/1555 "2023-08-03T12:13:37Z")
Introduction Prefect is an open-source workflow automation and orchestration tool for data engineering, machine learning, and other data-related tasks. It allows you to define, schedule, and execute complex data workflow… --- ## [Setting up data pipelines with CrateDB and Kestra.io](https://community.cratedb.com/t/setting-up-data-pipelines-with-cratedb-and-kestra-io/1400)
**Author:** [@Marija](https://community.cratedb.com/u/Marija)\ **Replies:** 0\ **Last updated:** [March 8, 2023, 11:01am UTC](https://community.cratedb.com/t/setting-up-data-pipelines-with-cratedb-and-kestra-io/1400 "2023-03-08T11:01:03Z")
Kestra.io is an open-source workflow automation and orchestration tool that enables users to automate and manage complex workflows in a streamlined and efficient manner. The tool provides a wide range of features and int… --- ## [Automating the import of Parquet files with Apache Airflow](https://community.cratedb.com/t/automating-the-import-of-parquet-files-with-apache-airflow/1247)
**Author:** [@karynsaz](https://community.cratedb.com/u/karynsaz)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 6:11pm UTC](https://community.cratedb.com/t/automating-the-import-of-parquet-files-with-apache-airflow/1247 "2022-10-06T18:11:40Z")
Introduction In a previous tutorial, we approached how to Build a data ingestion pipeline using Airflow and the NYC Taxi and Limousine dataset. However, due to a change in the data format provided, switching from CSV to… --- ## [Building a data retention policy for CrateDB with Apache Airflow](https://community.cratedb.com/t/building-a-data-retention-policy-for-cratedb-with-apache-airflow/1001)
**Author:** [@hammerhead](https://community.cratedb.com/u/hammerhead)\ **Replies:** 0\ **Last updated:** [February 2, 2022, 10:19am UTC](https://community.cratedb.com/t/building-a-data-retention-policy-for-cratedb-with-apache-airflow/1001 "2022-02-02T10:19:08Z")
In time-series use cases, a significant amount of data can accumulate over time. Making efficient use of available storage can be a key factor for the economic success of a database solution. Keeping full historical d… --- ## [Automating stock data collection and storage with CrateDB and Apache Airflow](https://community.cratedb.com/t/automating-stock-data-collection-and-storage-with-cratedb-and-apache-airflow/990)
**Author:** [@rafaelasantana](https://community.cratedb.com/u/rafaelasantana)\ **Replies:** 0\ **Last updated:** [January 19, 2022, 9:27am UTC](https://community.cratedb.com/t/automating-stock-data-collection-and-storage-with-cratedb-and-apache-airflow/990 "2022-01-19T09:27:48Z")
There is an updated version of this tutorial on Updating stock market data automatically with CrateDB and Apache Airflow Motivation Previously, on the Automating financial data collection and storage in CrateDB with P… --- ## [Implementing a data retention policy in CrateDB using Apache Airflow](https://community.cratedb.com/t/implementing-a-data-retention-policy-in-cratedb-using-apache-airflow/913)
**Author:** [@Marija](https://community.cratedb.com/u/Marija)\ **Replies:** 0\ **Last updated:** [November 25, 2021, 10:17am UTC](https://community.cratedb.com/t/implementing-a-data-retention-policy-in-cratedb-using-apache-airflow/913 "2021-11-25T10:17:55Z")
Written by Niklas Schmidtmer and Marija Selakovic What is a Data Retention Policy? A data retention policy describes the practice of storing and managing data for a designated period of time. Once a data set completes… --- ## [Automating recurrent CrateDB queries](https://community.cratedb.com/t/automating-recurrent-cratedb-queries/788)
**Author:** [@hammerhead](https://community.cratedb.com/u/hammerhead)\ **Replies:** 0\ **Last updated:** [September 9, 2021, 6:43am UTC](https://community.cratedb.com/t/automating-recurrent-cratedb-queries/788 "2021-09-09T06:43:42Z")
Certain database operations can require running identical queries recurringly, creating the wish to make use of a scheduling mechanism. This article will discuss different existing scheduling solutions and how to inte…