Skip to content

Load data from yandex appmetrica to Google big query

Notifications You must be signed in to change notification settings

ngkame/appmetrica_to_gbq

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Appmetrica_to_gbq loader

Load data from yandex appmetrica Logs API to Google big query Get api-key for yandex appmetrica here https://passport.yandex.ru/registration?mode=register

Create Google Big Query dataset. Get json service account for Google big query https://cloud.google.com/bigquery/docs/authentication/service-account-file and replace token.json in app folder.

Update locals. For first run edit locals.py

#Locals updates

GBQ_DATASET_NAME = name of Google Big Query dataset which you create before
FIRST_TIME_LOAD =if you load dataset first time set 'True'. If you dataset allready loaded set 'False'

DATES

  • if FIRST_TIME_LOAD=True
    'first_date': 'if then date since you load data from appmetrica in first date load'
    'firsttime_depth': 'days depth from today backwards in day count. today- firsttime_depth must be greater then first_date'

  • if FIRST_TIME_LOAD=False
    'secondtime_depth': 'days depth from today backwards in day count run at everyday'
    'secondtime_Mon_depth': 'days depth from today backwards in day count run at Monday'

    run program

    python3 appmetica_to_gbq/