Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stabilization, ease integration, new file status tracking storage, slimmed down dependencies #17

Merged
merged 9 commits into from
Jan 26, 2024

Conversation

huanchh2
Copy link
Contributor

@huanchh2 huanchh2 commented Jan 17, 2024

5.0.0

  • Simplified Ray bootstrap, previously this was tied to FastAPI life cycle, and the only reason FASTAPI was introduced as a dep
  • Removed domain specific data model fields and revert Ray Worker to more generic form
  • Removed Python dependencies no longer needed
  • replace Clickhouse with Postgres as permanent storage to track File proessing status
  • Wired up Alembic to support Postgres migration supported
  • make repo publishable as a python package to ease integration
  • name spaced ENV variabled to be bound as configs
  • additional Make targets to support development, schema migration.. etc

@huanchh2 huanchh2 changed the title use postgres as file status tracking backing DB Stabilization, ease integration, new file status tracking storage, slimmed down dependencies Jan 19, 2024
@huanchh2 huanchh2 merged commit b3dbb74 into main Jan 26, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants