Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Epic] Capture more metadata: table count, field usage, last viewed/used_at #38229

Closed
9 tasks done
luizarakaki opened this issue Jan 29, 2024 · 1 comment
Closed
9 tasks done
Assignees
Labels
Administration/Metadata & Sync .Epic Feature Implementation or Project .Team/BackendComponents also known as BEC
Milestone

Comments

@luizarakaki
Copy link
Contributor

luizarakaki commented Jan 29, 2024

Technical doc: https://www.notion.so/metabase/Accurate-fingerprint-729a720cdd4f41029a49d647fa9583b2?pvs=4
Related to https://www.notion.so/metabase/Capture-field-and-table-usage-metadata-990e99226d234d8b916478109162cd42?pvs=4

Milestone 1: Sync table row count (Postgres only)

  1. .Team/BackendComponents no-backport
    qnkhuat
  2. .Team/BackendComponents no-backport
    qnkhuat

Milestone 2: Count field usage

  1. .Team/BackendComponents
    qnkhuat

Milestone 3: Capture last_viewed_at and last_used_at

  1. .Team/BackendComponents no-backport
    qnkhuat
  2. .Team/BackendComponents no-backport
    calherries

The use case for Milestone 3 is Auto cleanup collections
For this project, we need signal that an item (collection, question, model, dashboard) is irrelevant.
For dashboards, last_viewed_at is enough.
For questions and models, we need to know if it is used by other things (like nested questions, sandbox definition, custom field values, goals), so we are proposing a last_used_at property that registers everytime that item is used.

New technical design doc

Milestone 4: Capture view count for questions, models, and dashboards.

  1. .Team/BackendComponents no-backport
    calherries
  2. .Team/BackendComponents
    calherries
  3. .Team/BackendComponents backport no-backport
    calherries

The use case for Milestone 4 is TBD, but most likely this would be shown in collections to help users find relevant content or help rank search results.
Milestone 4 technical doc

@luizarakaki luizarakaki added Administration/Metadata & Sync .Epic Feature Implementation or Project .Team/BackendComponents also known as BEC labels Jan 29, 2024
@qnkhuat qnkhuat self-assigned this Jan 30, 2024
@qnkhuat
Copy link
Contributor

qnkhuat commented Feb 6, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Administration/Metadata & Sync .Epic Feature Implementation or Project .Team/BackendComponents also known as BEC
Projects
None yet
Development

No branches or pull requests

3 participants