Skip to content
/ EneGRy Public

Time-Series dataset combining multiple sources to explain the broader Greek energy market

License

Notifications You must be signed in to change notification settings

pdoup/EneGRy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 

Repository files navigation

EneGRy

Time-series dataset combining multiple sources to explain the broader Greek energy market

front

This repository contains a curated time-series dataset that combines daily data from the energy sector, weather data, and market data for Greece. The dataset spans from December 1st, 2020, to August 18th, 2023, and includes information on energy-related futures contracts, day-ahead energy market prices, and more.

The dataset is set to serve as a valuable resource for data analysts and scientists interested in conducting exploratory data analysis or predictive tasks. For example, the dataset can be used to predict tomorrow's energy demands or wholesale prices.

One of the key features of this dataset is that it contains data from renewable energy sources. This, along with the comprehensive daily weather condition data, makes it an excellent resource for gaining insights into the renewable energy market in Greece.

In addition to the information mentioned earlier, this dataset also incorporates information about global markets. This means that it has the potential to uncover latent relationships between the energy sector, weather data, and market data in Greece and global markets. By analyzing this dataset, data analysts and scientists can gain a deeper understanding of how global market trends and events impact the energy sector in Greece. This makes the dataset an even more valuable resource for conducting exploratory data analysis or predictive tasks.

The dataset is currently available in 3 formats: CSV, JSON and as an Excel spreadsheet

Potential Uses

  • Exploratory Data Analysis: The dataset can be used to explore trends and patterns in the energy sector, weather data, and market data for Greece.
  • Predictive Tasks: The dataset can be used to develop predictive models for forecasting energy demands or wholesale prices.
  • Renewable Energy Market Insights: The dataset contains data from renewable energy sources, making it a valuable resource for gaining insights into the renewable energy market in Greece.
  • Global Market Insights: The dataset incorporates information about global markets, allowing analysts to uncover latent relationships between the energy sector in Greece and global markets.

Data Sources and APIs

The data in this dataset was retrieved from multiple sources and APIs. These sources include:

  1. data.gov.gr
  2. admie.gr
  3. IBM Environmental Intelligence Suite APIs
  4. tradingeconomics.com
  5. transparency.entsoe.eu

Description

Click to expand
Feature Type Unit Description
temp_min int °C Minimum recorded temperature ; station LGAV, Spata, Attica, Greece
temp_max int °C Maximum recorded temperature ; station LGAV, Spata, Attica, Greece
temp_avg float °C Daily average temperature ; station LGAV, Spata, Attica, Greece
wx_phrase_most_freq string - Most prominent expected weather conditions throughout that day (e.g., Fair, Partly Cloudy, Light Rain)
dewPt_min int °C Minimum temperature at dew-point ; station LGAV, Spata, Attica, Greece
dewPt_max int °C Maximum temperature at dew-point ; station LGAV, Spata, Attica, Greece
dewPt_avg float °C Daily average temperature at dew-point ; station LGAV, Spata, Attica, Greece
heat_index_min int °C Minimum recorded HI ; station LGAV, Spata, Attica, Greece. (HI: human-perceived equivalent temperature)
heat_index_max int °C Maximum recorded HI ; station LGAV, Spata, Attica, Greece.
heat_index_avg float °C Daily average HI ; station LGAV, Spata, Attica, Greece.
rh_min int % Minimum relative-humidity ; station LGAV, Spata, Attica, Greece. Ranges from 0 to 100
rh_max int % Maximum relative-humidity ; station LGAV, Spata, Attica, Greece. Ranges from 0 to 100
rh_avg float %) Daily average relative-humidity ; station LGAV, Spata, Attica, Greece. Ranges from 0 to 100
pressure_avg float hPa/mbar Daily average atmospheric pressure ; station LGAV, Spata, Attica, Greece
vis_avg int km (kilometer) Daily average visibility ; station LGAV, Spata, Attica, Greece
wdir_avg int degrees (°) Daily average wind direction; station LGAV, Spata, Attica, Greece
wdir_cardinal_most_freq string - Daily average secondary intercardinal directions (e.g., SSW, VAR, NNW); station LGAV, Spata, Attica, Greece
gust_max int km/h Maximum recorded wind gusts; station LGAV, Spata, Attica, Greece
wspd_min int km/h Minimum wind speed ; station LGAV, Spata, Attica, Greece
wspd_max int km/h Maximum wind speed ; station LGAV, Spata, Attica, Greece
wspd_avg float km/h Daily average wind speed ; station LGAV, Spata, Attica, Greece
uv_desc_least_freq string - Least prominent ultraviolet-index for the day (e.g., Low, Moderate) ; station LGAV, Spata, Attica, Greece
uv_desc_most_freq string - Most prominent ultraviolet-index for the day (e.g., Low, Moderate) ; station LGAV, Spata, Attica, Greece
uv_index_min int scale (0-11+) Lowest recorded UV index; station LGAV, Spata, Attica, Greece
uv_index_max int scale (0-11+) Highest recorded UV index; station LGAV, Spata, Attica, Greece
clds_most_freq string - Most observed sky cloud coverage; station LGAV, Spata, Attica, Greece. More info
gas_load int MWh Total gas load on the energy grid GR
wind_power_load int MWh Load attributed to wind power generators GR
renewable_energy_load int MWh Load attributed to renewable energy sources available on the power grid GR
net_imports int MWh Total (Imported - Exported) energy balance GR
coal_load int MWh Load attributed to traditional coal-fired plants available on the power grid GR
natural_gas_load int MWh Total natural gas load on the energy grid GR
hydropower_load int MWh Load on the energy grid from hydroelectric sources GR
gross_energy_load int MWh Represents the quantity of energy necessary to satisfy domestic energy demands GR
renewable_energy_production int MWh Total power produced by renewable energy sources GR
day_ahead_market_avg_clearing_price float EUR / MWh For every market time unit (typically 1H) the day-ahead prices in each bidding zone (Currency/MWh) GR. The hourly clearing prices are aggregated to a daily average, meant to represent the daily mean wholesale price
wind_energy_index float USD Tracks the performance of publicly traded companies in the wind energy sector as well as those businesses that do not produce energy but make most of their revenues by providing goods and services to the wind energy industry.
wind_energy_index_pct_change float % Daily shift in the wind index expressed as a percentage.
wind_energy_index_change float - Daily shift in the wind index expressed as the numeric difference (current_index - previous_index).
solar_energy_index float USD Tracks the performance of publicly traded companies in the solar energy sector as well as those businesses that do not produce energy but make most of their revenues by providing goods and services to the solar energy industry.
solar_energy_index_pct_change float % Daily shift in the solar index expressed as a percentage.
solar_energy_index_change float - Daily shift in the solar index expressed as the numeric difference (current_index - previous_index).
heating_oil_futures_US float USD Heating oil, also known as No. 2 fuel oil futures.
heating_oil_futures_US_pct_change float % Daily shift in the heating oil futures contracts expressed as a percentage.
heating_oil_futures_US_change float - Daily shift in the heating oil futures contracts prices expressed as the numeric difference (current - previous).
carbon_permits_EU float EUR Sourced from the European Union Emissions Trading System (EU ETS). Allowances for carbon emissions are first allocated considering EU directives for the maximum amount of greenhouse gases that can be emitted (can be traded).
carbon_permits_EU_pct_change float % Daily shift in the allowances price for carbon emissions expressed as a percentage.
carbon_permits_EU_change float - Daily shift in the allowances price for carbon emissions expressed as the numeric difference (current - previous).
coal_futures float USD Newcastle coal futures. The standard GC Newcastle contact listed on Intercontinental Exchange (ICE) weights 1,000 metric tonnes.
coal_futures_pct_change float % Daily shift in the coal futures contracts expressed as a percentage.
coal_futures_change float - Daily shift in the coal futures contracts prices expressed as the numeric difference (current - previous).
natural_gas_eu_dutch_ttf_prices float EUR/MWh Dutch TTF Gas. European benchmark for gas prices stipulating physical delivery as part of the agreement.
natural_gas_eu_dutch_ttf_prices_pct_change float % Daily shift in the Dutch TTF Gas contracts expressed as a percentage.
natural_gas_eu_dutch_ttf_prices_change float - Daily shift in the Dutch TTF Gas contracts prices expressed as the numeric difference (current - previous).
wti_crude_oil_futures float USD/Bbl West Texas Intermediate (WTI) benchmark for US crude.
wti_crude_oil_futures_pct_change float % Daily shift in the WTI futures contracts expressed as a percentage.
wti_crude_oil_futures_change float - Daily shift in the WTI futures contracts expressed as the numeric difference (current - previous).

Citing this Dataset

If you use this dataset in your research or analysis, please cite it using the following entry:

@misc{EneGRy2023,
  title={EneGRy},
  author={Panagiotis Doupidis},
  year={2023},
  publisher={GitHub},
  howpublished={\url{https://github.com/pdoup/EneGRy}},
}

License

The data can be used as is without any warranty. Taking into account the size and factual nature of the data along with the sources, this falls under the Public Domain Dedication and License (PDDL).