Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Task]: Specify and document a list of evaluation criteria for Transform technology #1299

Closed
1 task
acouch opened this issue Feb 21, 2024 · 4 comments · May be fixed by #1464
Closed
1 task

[Task]: Specify and document a list of evaluation criteria for Transform technology #1299

acouch opened this issue Feb 21, 2024 · 4 comments · May be fixed by #1464
Assignees
@acouch @jamesbursa
Labels
project: grants.gov Grants.gov Modernization tickets
Milestone
Search API - ELT ...

Comments

@acouch
Copy link
Collaborator

acouch commented Feb 21, 2024 •
edited by jamesbursa

Summary

Specify criteria that will allow us to compare various transform technologies (dbt, SQLMesh, custom, etc.).

As a starting point, this may include:

  • Developer experience (simplicity, quality of documentation, local development process, logs, testing support, maintainability)
  • Maturity (age, rate of releases, backing by a company)
  • Licensing & availability (open source, AWS, other)
  • Deployment model & infrastructure (containerized, serverless, patching, AWS deployment model)
  • Performance & scalability (parallel processing?)
  • Robustness (self-healing if interrupted or fails?)
  • How are source changes detected? (change data capture, insert / update / delete)
  • Architecture & modularity (can components be used separately or replaced?)
  • Batch or streaming support / full or incremental (target: 1h latency for source edits)
  • Which Extract / Load technologies are supported?
  • How are ids generated and persisted?
  • Are append-only tables supported?

Also specify what the POC for each should build, so that they are comparable.

image

Acceptance criteria

  • Criteria are published on GitBook
@acouch acouch added the project: grants.gov Grants.gov Modernization tickets label Feb 21, 2024
@acouch acouch added this to the Search API - ELT milestone Feb 21, 2024
@jamesbursa jamesbursa changed the title [DRAFT]: Create Criteria for Evaluating Transformation Toolchain [DRAFT]: Specify and document a list of evaluation criteria for Transform technology Feb 21, 2024
This was referenced Feb 21, 2024
Closed
Closed
Closed
Closed
@jamesbursa
Copy link
Collaborator

In progress on the Internal Wiki.

@sumiat sumiat removed the refinement label Mar 5, 2024
jamesbursa added a commit that referenced this issue Mar 12, 2024
@jamesbursa
[Issue #1299] add script to populate source tables with mock data
1d646e8
@jamesbursa jamesbursa mentioned this issue Mar 12, 2024
Draft
@jamesbursa jamesbursa changed the title [DRAFT]: Specify and document a list of evaluation criteria for Transform technology [Task]: Specify and document a list of evaluation criteria for Transform technology Mar 12, 2024
@acouch
Copy link
Collaborator Author

acouch commented Mar 26, 2024

I took some more notes in this doc: https://docs.google.com/document/d/1ukqfDy17LDI6eHJdOZciLL1Tx117b4xj3WBGbYe1FZE/edit#heading=h.u49mu3irmxqe adding example tables, taking a closer look at Luigi, and setting up a closer look at incremental models in dbt, sqlmesh and a custom python option

@acouch acouch mentioned this issue Mar 26, 2024
Closed
1 task
@acouch
Copy link
Collaborator Author

acouch commented Apr 1, 2024

I have done this, need to review with @jamesbursa

@acouch
Copy link
Collaborator Author

acouch commented Apr 3, 2024 •
edited

This has been completed in this working doc.

@acouch acouch closed this as completed Apr 3, 2024
@acouch acouch mentioned this issue Apr 3, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@acouch acouch

@jamesbursa jamesbursa

Labels
project: grants.gov Grants.gov Modernization tickets
Projects
Simpler Grants Sprint Planning
Status: Done
Milestone
Search API - ELT Decision
Development

Successfully merging a pull request may close this issue.

[Issue #1299] add script to populate source tables with mock data HHS/simpler-grants-gov
3 participants
@acouch @jamesbursa @sumiat