Skip to content
ken farmer edited this page Aug 1, 2015 · 3 revisions

Here's the demo tests of a demo user database I'm planning to build:

run_results - all of this is in a single flat table, I'm showing this looking hierarchical just to show the different sets of columns that will all be in this table.

  - static data:
    instance_name
    database_name
    table_name
    table_partitioned           - true, false
    check_name
    check_policy_type           - quality, data-management, security, etc
    check_type                  - rule or profile(?)
    check_config
- run data:
    run_start_timestamp
    run_mode    - incremental
- run table data:
    partition key
    partition value
- run check data:
    run_check_start_timestamp
    run_check_end_timestamp
    run_check_mode              - incremental or full
    run_check_rc
    run_check_violation_cnt
    run_check_anomaly_score     - 0 to 100
    run_check_severity_score    - 0 to 100
- annotation data
    validated                   - True, False

Hypothetical database being checked:

- instance names:
    prod
    prod-failover
    staging
    test
- database names:
    westwind
- table names:
    customers
        - cols:
            cust_id
            cust_name
            cust_type
        - checks:
    assets
        - cols:
            asset_id
            cust_id
            asset_type
    asset_events
        - cols:
            cust_id
            asset_id
            event_type
    event_type
        - cols:
            event_type_id
            event_type_name
    asset_type
        - cols:
            asset_type_id
            asset_type_name
    cust_type
        - cols:
            cust_type_id
            cust_type_name