brooklyndata_dbt

• Loads Brooklyndata olist dataset(https://app.mode.com/brooklyndata/tables) to Snowflake
• Creates data models using dbt

prerequistes

• Have a snowflake account setup
• Install Snowsql: https://docs.snowflake.com/en/user-guide/snowsql-install-config
• Follow steps to configure snowsql: https://docs.snowflake.com/en/user-guide/snowsql-config
• Have Python3 installed

set up

• To create and load raw data to DB:
  • replace(<ACCOUNT_NAME>, <LOGIN_NAME>) and run:

  snowsql -a <ACCOUNT_NAME> -u <LOGIN_NAME> -f create_load_data.sql

  • input password
• install dbt

  python3 -m venv venv
  source venv/bin/activate
  pip install -r requirements.txt

• update dbt snowflake credentials in profile_credentials

run

cd gold
source ../profile_credentials

dbt run
dbt test --store-failures
dbt docs generate
dbt docs serve

results

• created resources
• data lineage