Issue while inserting data with a string value greater than 32kb

CrateDB
1

We have created a table with defination 'create table TestLargeData (
id long,
name string,
primary key (name,id )
)
WITH (
“translog.durability” = ‘ASYNC’
);

’
When size of name string is greater than 32kb,the record doesn’t get inserted. It gives error as “SQLParseException[Document contains at least one immense term in field=”_id" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. … original message: bytes can be at most 32766 in length; got 34145]".

We tried the define column with INDEX OFF option, but still the issue exists.
We are not sure about how to use the analyzer option.

Could you please provide any suggestions to get over this issue?

2

You need to deactivate columnar storage to store a string with more than 32766 bytes. Also see docs:

CREATE TABLE "TestLargeData" (
    "id" long,
    name string INDEX OFF STORAGE WITH (columnstore = false)
   primary key ( id )
);

edit: this might still not work when trying to use the column in the primary key, as that also implies it needs to be indexed.