This dataset contains usage statistics (page impressions and visits) for the Berlin Open Data Portal https://daten.berlin.de. Statistics are collected per month, both for the domain as such, and for all datasets (pages below /datensaetze).
Statistics are given in both CSV (split over two files) and JSON (one combined file).
Until 2019-12-31, usage statistics were collected with our internal BerlinOnline Site Statistics (BOSS) tool. As of 2020-01-01 we have stopped using BOSS on the Berlin Open Data Portal, and have replaced it with Webtrekk Analytics. Webtrekk has been in use since February 2019. While BOSS and Webtrekk provide the same metrics, the actual results differ. We have written a little bit on how and possible why BOSS and Webtrekk differ with respect to their results.
The historic BOSS data has been moved to data/historical, while the current Webtrekk data resides in data/current.
The code to extract the usage statistics is written in Ruby. It has been tested with Ruby 2.7.1.
The required gems are defined in the Gemfile. In particuler, these are:
If you have bundler, you can install the required gems as follows:
bundle install
Download here: daten_berlin_de.domain_stats.csv
Domain-wide statistics. One row per month, columns for page impressions, visits and average time spent on site (in seconds).
month,impressions,visits,visit_duration_avg_seconds
2021-04,26514,8937,147.94
2021-03,25116,8505,153.71
2021-02,20832,7212,152.06
2021-01,31221,11199,162.95
...
Download here: daten_berlin_de.page_stats.datensaetze.csv
Per-dataset statistics. One row per dataset, two columns per month (page impressions and visits).
page,2013-04-01 pi,2013-04-01 pv, ... ,2018-05-01 pi,2018-05-01 pv
liste-der-h%C3%A4ufigen-vornamen-2017,,, ... ,279,246
alkis-berlin-amtliches-liegenschaftskatasterinformationssystem,,, ... ,211,185
...
Download here: daten_berlin_de.stats.json.tgz (compressed)
The structure of the data is as follows:
/source- From which source system the statistics were generated. One of[ "Webtrekk", "Boss" ]./timestamp- when these usage statistics were generated/stats/site_uri- domain of the data portal/stats/earliest- first month for which domain-wide statistics have been collected/stats/latest- last month for which domain-wide statistics have been collected/stats/totals- domain-wide statistics/stats/totals/{MONTH}/impressions- domain-wide page impressions duringMONTH/stats/totals/{MONTH}/visits- domain-wide visits duringMONTH/stats/pages/datensaetze- statistics for individual datasets/stats/pages/datensaetze/page_uri- parent page for all datasets/stats/pages/datensaetze/earliest- first month for which dataset-specific statistics have been collected/stats/pages/datensaetze/latest- last month for which dataset-specific statistics have been collected/stats/pages/datensaetze/sub_page_counts/{MONTH}/{DATASET}/impressions- page impressions recorded for DATASET during MONTH/stats/pages/datensaetze/sub_page_counts/{MONTH}/{DATASET}/visits- visits recorded for DATASET during MONTH
{
"timestamp": "2018-06-12 14:29:47 +0200",
"stats": {
"site_uri": "daten.berlin.de",
"earliest": "2011-09-01",
"latest": "2018-05-01",
"totals": {
"2018-05": {
"impressions": 28563,
"visits": 10436
},
...
"2011-09": {
"impressions": 54454,
"visits": 23765
}
},
"pages": {
"datensaetze": {
"page_uri": "daten.berlin.de%2Fdatensaetze",
"earliest": "2013-04-01",
"latest": "2018-05-01",
"sub_page_counts": {
"2018-05": {
"liste-der-h%C3%A4ufigen-vornamen-2017": {
"impressions": 279,
"visits": 246
},
"alkis-berlin-amtliches-liegenschaftskatasterinformationssystem": {
"impressions": 211,
"visits": 185
},
...
}
}
}
}
}
}All software in this repository is published under the MIT License. All data in this repository (in particular the .csv and .json files) is published under CC BY 3.0 DE.
Dataset URL: https://daten.berlin.de/datensaetze/zugriffsstatistik-datenberlinde
This page was generated from the github repository at https://github.com/berlinonline/berlin_dataportal_usage.
2020, Knud Möller, BerlinOnline Stadtportal GmbH & Co. KG
Last changed: 2024-04-29