UNIQUE constraint failed: sections.indexid

[obonyojimmy]

Trying to upsert multiple rows to an embeding instance , it sometimes errors out with

UNIQUE constraint failed: sections.indexid

After which no rows get upserted afterwards. How can we mitigate this.Thank you.
Heres a sniplet of the error log:

File "/app/taskflow/artifacts/artifact.py", line 578, in add
taskflow-1  |     self.embeddings.upsert(stream(data_inputs))
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/embeddings/base.py", line 174, in upsert
taskflow-1  |     ids, _, embeddings = transform(stream(documents), buffer)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/embeddings/index/transform.py", line 76, in __call__
taskflow-1  |     ids, dimensions, embeddings = self.vectors(documents, buffer)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/embeddings/index/transform.py", line 95, in vectors
taskflow-1  |     ids, dimensions, batches, stream = self.model.index(self.stream(documents), self.batch)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/vectors/base.py", line 96, in index
taskflow-1  |     for document in documents:
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/embeddings/index/transform.py", line 183, in stream
taskflow-1  |     self.load(batch, offset)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/embeddings/index/transform.py", line 208, in load
taskflow-1  |     self.database.insert(batch, self.offset)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/database/rdbms.py", line 66, in insert
taskflow-1  |     self.loadsection(index, uid, document, tags, entry)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/database/rdbms.py", line 361, in loadsection
taskflow-1  |     self.insertsection(index, uid, text, tags, entry)
taskflow-1  |   File "/root/.local/lib/python3.10/site-packages/txtai/database/rdbms.py", line 376, in insertsection
taskflow-1  |     self.cursor.execute(Statement.INSERT_SECTION, [index, uid, text, tags, entry])
taskflow-1  | sqlite3.IntegrityError: UNIQUE constraint failed: sections.indexid

[obonyojimmy]

not sure but i think we could let sections table collumn, indexId be auto-incremental and have load_section() , insert without the offset count value provided .

from :

        CREATE TABLE IF NOT EXISTS %s (
            indexid INTEGER PRIMARY KEY,
            id TEXT,
            text TEXT,
            tags TEXT,
            entry DATETIME
        )
    """

to:

 CREATE_SECTIONS = """
        CREATE TABLE IF NOT EXISTS %s (
            indexid INTEGER PRIMARY KEY AUTOINCREMENT,
            id TEXT,
            text TEXT,
            tags TEXT,
            entry DATETIME
        )
    """