Skip to content

Analysis of programmers' employment in Europe 2018-2021 using data warehouse.

Notifications You must be signed in to change notification settings

ksproska/dataWarehouse_sql_ssis

Repository files navigation

Data warehouse

Analysis of programmers' employment in Europe 2018-2021 using data warehouse.

Overview

  1. Analisys of data quality - document in polish

  2. Data normalization and inport into database using integration services, scripts used in this step, creating:

    1. Destination tables where final data is stored
    2. Library tables for asserting string attriubutes correction
    3. Temorary tables needed for normalization of data

    Other files used in this step:

    1. Source of libraries for allowed string attributes
    2. Destination of errors for different proplems that can occur during import of new data
    3. Source from which data is imported (ignoring subfolders) - file must have extension .csv and format of this file
  3. Data analysis - creating cube and graphs using multidimensional project, scripts used for creating:

    1. Group attributes for attributes with wide range of values
  4. Final analysis - standalone graphs and graphs with descriptions - document in polish

Planed normalization

image

Tables created in database

image

Integration services

Overview

image

Importing libraries

image

Data normalization, cleaning, checking correction of string attributes, import to temorary table

image

image

Creating unique dimmensions

image

Mapping keys for earnings fact

image

Multidimensional project

Final cube

image

Adding average earings measure

image

Analysis - samples

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

image

About

Analysis of programmers' employment in Europe 2018-2021 using data warehouse.

Topics

Resources

Stars

Watchers

Forks

Languages