How do I update or delete a record? Are there any CRUD examples out there?

[brunolm]

I have the following code:

import json
import sys

from deeplake.core.vectorstore import VectorStore
from openai import OpenAI

client = OpenAI()

with open("data.json", "r", encoding="cp866") as f:
    json_data = json.load(f)

CHUNK_SIZE = 1000

text = json_data["textContent"]

chunked_text = []
chunked_text = [text[i : i + CHUNK_SIZE] for i in range(0, len(text), CHUNK_SIZE)]
metadata = [json_data for i in range(len(chunked_text))]


def embedding_function(texts, model="text-embedding-ada-002"):
    if isinstance(texts, str):
        texts = [texts]

    texts = [t.replace("\n", " ") for t in texts]

    return [
        data.embedding
        for data in client.embeddings.create(input=texts, model=model).data
    ]


vector_store = VectorStore(
    path="vector_store",
)


ds = vector_store.dataset
metadatas = ds.tensors["metadata"].data()["value"]
key = "uid"
val = "1337"
if not next((d for d in metadatas if d.get(key) == val), None):
    print("not found")
else:
    print("found")


vector_store.add(
    text=chunked_text,
    embedding_function=embedding_function,
    embedding_data=chunked_text,
    metadata=metadata,
)

It reads from a JSON file and adds records with vector_store.add. That much works just fine.

However, I have records that will have the same json_data.uid and I don't want to have multiple records with the same uid, I want to update the existing record.

I found in a Reddit thread that hack to know if the item already exists, but I don't know how to update or delete.

How do I update an existing record? Or how do I delete it and insert it again?

[AdkSarsen]

Hey, @brunolm! Hope you're doing awesome!

We don't support direct updates of the vectorstore items as of now, but it will come in the near future, in the next couple of releases. However, in order to update embeddings you can use vectorstore.delete to remove old items and then reupload the data.