Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document how to save and load dumps from the vector store #409

Merged
merged 2 commits into from
May 20, 2024

Conversation

wpfl-dbt
Copy link
Collaborator

Context

For LLM evaluation we need:

  • Versioned evaluation datasets, which references files and chunks the vector store
  • Versioned snapshots of the vector store that contains those referenced files and chunks

Changes proposed in this pull request

This PR adds documentation on how to save and load snapshots of the vector store so we can study static versions of it. I have tested this code, and successfully saved and loaded snapshots of the vector store.

Guidance to review

  • Node devs: how bad is my node advice

Relevant links

Things to check

  • I have added any new ENV vars in all deployed environments
  • I have tested any code added or changed
  • I have run integration tests -- NA

Copy link
Contributor

@KevinEtchells KevinEtchells left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Node advice is good, @wpfl-dbt.

NVM is great for managing different versions of Node, but not essential if this is the only place it's going to be used, and it doesn't look like it requires a specific version other than latest LTS. But it's not bad advice to have it installed anyway!

@wpfl-dbt wpfl-dbt merged commit 1148e05 into main May 20, 2024
7 checks passed
@wpfl-dbt wpfl-dbt deleted the feature/elasticdump branch May 31, 2024 11:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants