Unable to create a repository (CrateDB cluster running with docker containers) [SOLVED]

[amotl]

Dear Luca,

@cocoa

I ask you to confirm the following observations, so that we can proceed correctly

1. To be definitively sure, if I want to back up CrateDB that runs as a cluster consisting of x nodes, each host machine on which runs the container (that runs the instance of the CrateDB) node of the cluster must be equipped with a shared file system that allows to share the ‘/backup’ directory between all containers.
2. So to use the ‘fs’ option in ‘CREATE REPOSITORY’ I must have the destination directory shared among all hosts (for example by installing glusterfs or ceph and others fs on each node in the cluster).

Thank you for asking. Sharing filesystems between multiple containers sounds really dangerous to me.

I am not an expert on this matter, but I think creating fs-type repositories is not well suited for container use. Instead, I believe the recommended way to create repositories in advanced setups is to use remote object storage.

I have been able to discover the following options for that:

• Setting AWS S3 object storage as snapshot repository for CrateDB
• Setting Azure blob storage as snapshot repository for CrateDB
• Setting MinIO as a CrateDB backup repository

As I see you are running CrateDB on your own premises, I think the third option would be the best fit for your setup.

With kind regards,
Andreas.