Skip to content

🏦 Scripts for importing data from the UK Open Government data portal. For now, the scripts can import air quality, traffic and house price data.

License

Notifications You must be signed in to change notification settings

the-gamma/govuk-data-import

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data import scripts for data.gov.uk

This repository contains various scripts for importing data from various UK Open Government Data sources. This generally copies raw data into Azure blob storage and then goes over it again and inserts data into SQL database. To run the code, you need to configure a couple of keys first (see the src/config/NOTE.md file).

You will find the following in the src folder:

  • config is a folder where you need to specify Azure connection strings etc.
  • lib contains various helpers for inserting data and generating tables
  • setup.fsx starts MBrace cluster, so that we can run things nicely
  • defra.fsx imports Air Quality data from Defra
  • houses.fsx imports HM Land Registry Price Paid Data

About

🏦 Scripts for importing data from the UK Open Government data portal. For now, the scripts can import air quality, traffic and house price data.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages