SQL selects retrieve partial data

[amotl]

Dear Felipe,

thank you for writing in. Let me start by citing our documentation on this topic, where I believe you are observing the corresponding behaviour, when quickly querying the table directly after inserting.

CrateDB is eventually consistent. Data written with a former statement is not guaranteed to be fetched with the next following select statement for the affected rows.

If required, one or more tables can be refreshed explicitly in order to ensure that the latest state of the table gets fetched, i.e. to synchronize data, using the REFRESH TABLE <tablename> SQL statement.

– Refresh — CrateDB: Reference
– https://crate.io/docs/crate/reference/en/latest/sql/statements/refresh.html

By default, the table-level setting refresh_interval is set to 1000ms, but that setting can be changed to fit your needs.

Other than the documentation, @proddata also shared a good explanation at CrateDB need timeout to see changes from insert/update/delete queries, which may be useful.

Please let us know if this helps already, or if you think you are observing a different issue.

With kind regards,
Andreas.