Exploring options to sync collections from MongoDB

CrateDB Configuration
,
1

Dear @M_Duyen_L_u,

let me pick this up from another conversation, and also because of recent interests by @Vo_Thien in the same area.

We hear you. In general, if you are a CrateDB Cloud user, we can recommend to use the managed CrateDB Cloud MongoDB CDC integration for what you call Zero-ETL today.

If you are using CrateDB on your premises, there is a companion to the MongoDB Table Loader, namely the MongoDB CDC Relay – you may want to give it a shot if that fits your requirements on continuous data syncing. [1]

This documentation section displays all the available options to connect with MongoDB on a single page:

We hope this helps.

With kind regards,
Andreas.

  1. It is certainly not as mature as a full-fledged framework like Debezium/Kafka, but instead gets the job done by connecting natively to both MongoDB and CrateDB, reading CDC events from MongoDB using its MongoDB Change Stream interface. If you can make it work or not, or have future wishes, its issue tracker is the right spot to request features or report errors. ↩︎

2

4 posts were split to a new topic: Making CTK’s MongoDB CDC relay work