External Resources
Thad Guidry edited this page Dec 7, 2021
·
54 revisions
This page list tutorials and resources developed outside the OpenRefine wiki. It also reflect resources used in the OpenRefine Custom Search Engine
- OpenRefine Beginners Tutorial - University of Edinburgh - opening and uploading a spreadsheet onto OpenRefine, reconciling data, building a schema and uploading data from the spreadsheet onto Wikidata.
- Reconcile Data - Displaying HTML content from URLs within OpenRefine using IFRAMES
- Ultimate guide to data cleaning
- Converting Spreadsheets into MODSXML using Open Refine
- Putting Points on Maps Using GeoJSON Created by Open Refine
- Help me, I’m covered in bees -or- using OpenRefine to clean specimen data
- How to: combine multiple rows in a dataset where text is split across them (OpenRefine)
- Using Open Refine to Update, Clean up, and Link Your Metadata to the Wider World - Video
- How to Extract Data from Tables in PDFs with Tabula and OpenRefine
- Analyzing Usage Logs with OpenRefine for librarians using LCSH and RDF extension
- Prepare SQL query in OpenRefine part1 - part 2
- CLEAN UP: DATES AND OPENREFINE
- OPENREFINE AND MESSY LEGACY ACCESS POINTS IN AN ARCHIVISTS’ TOOLKIT DATABASE
- OpenRefine Cheat Sheets
- Getting Started with Google Refine (now OpenRefine)
- SOCIAL NETWORK ANALYSIS AND VISUALISATION FOR #RDAPLENARY 3
- Harvesting and Analyzing Tweets
- How to: clean up spreadsheet headings that run across multiple rows using Open Refine
- Creating Data from Text – Regular Expressions in OpenRefine
- Open Refine & AdWords
- An Introduction to Mapping Company Networks Using Gephi and OpenCorporates, via OpenRefine
- Calling REST services and parsing JSON with OpenRefine
- Working With Company Data
- A recipe for grabbing director information from OpenCorporates using OpenRefine
- Using OpenRefine, Excel to clean user-submitted data
- Automating Basic Research Tasks with OpenRefine and Freebase
- Archives Hub and VIAF Name Matching
- LEARNING TO OPENREFINE: FACETING AND CLUSTERING
- Cleaning Geo-Data with Open Refine
- How to Visualize Data With OpenSpending
- Diff or Chop? Github, CSV data files and OpenRefine
- Extending data with OpenRefine (ex-Google Refine)
- Unpivoting Data with Excel, Open Refine and Python
- Using OpenRefine to Clean Multiple Documents in the Same Way
- Generating Sankey Diagrams from rCharts
- OpenRefine/LODRefine – A Power Tool for Cleaning Data
- Cleaning Data with OpenRefine - a lesson from the Programming Historian
- Using OpenRefine to explore Tenders awarded in Bosnia and Herzegovina
- Using OpenRefine to explore information about UK Schools - LinkedUp DevTalk
- Cleaning up data in Google Refine | Back That Thing Up
- Ordnance Survey Linked Data and the Reconciliation API | John's Weblog
- A Wrangling Example With OpenRefine: Making "Oven Ready Data" | OUseful.Info, the blog...
- Cleaning Data with Refine | School of Data - Evidence is Power
- A Simple OpenRefine Example - Tidying Cut'n'Paste Data from a Web Page
- Questioning Election Data to See if It Has a Story to Tell | OUseful.Info, the blog...
- A Librarian's Guide to OpenRefine
- OpenRefine - list-making made easy | CS-SIS
- Geocoding Using the Google Maps Geocoder via OpenRefine | OUseful.Info, the blog...
- Evaluating the success of vocabulary reconciliation for cultural heritage collections - Hooland - 2013 - Journal of the American Society for Information Science and Technology - Wiley Online Library
- Clean and transform a messy dataset to RDF format - Screencast on Vimeo
- From Excel file to RDF with links to DBpedia and Europeana - YouTube
- Geocoding Using Google Refine and Data Science Toolkit | Matt Briney
- Grabbing Twitter Search Results into Google Refine and Exporting Conversations into Gephi | Resources | Data Driven Journalism
- LOD Refine presentation for reconciliation and data augmentation
- A short intro to OpenRefine by magdmartin
- OMG! My metadata is as fresh as the Backstreet Boys: How Google Ref...
- Patent Assignee Cleanup Using Google Refine (Open Refine) - Text Facets and Clustering
- Codesnippet: basic geoinferencing with Shapely, GeoJSON and OpenRefine
- Geocoding Using the Google Maps Geocoder via OpenRefine | Resources | Data Driven Journalism
- Open refine reconciliation service api (dc python 2013_03_05)
- Generate ADMS asset descriptions from a spreadsheet with Refine RDF | Joinup
- Xenu/ScreamingFrog/Scrutiny + Google Refine + SharedCount API = free social data for a complete domain
- First Dabblings with the Gateway to Research API Using OpenRefine | OUseful.Info, the blog...
- Appropriating IT: Glue Steps Reflexion on OpenRefine used as a glue steps between systems.
- A look at a fantastic tool for data clean-up: Google Refine A presentation for librarians on data cleaning using OpenRefine.
- Google Refine, Shawn Simister, Google (Atelier Open Data Google / Dataconnexions) A talk in Shawn Simister, developer advocate at Google. This talk was recorded during the "Atelier Open Data" hackathon held in Paris on March 14, 2012. Shawn Simister demos Google Refine, a tool for easy data cleaning and analysis.
- How to use Google Refine for data clean up and enhancement (freebase, reconcile), Description: This is a walk-through of a sample project using Google Refine - standardizing the names of cities of publication for books.
- Mining and OpenRefine(ing) JISCMail: (cluster,facet,fetch url), Description : A look at OER-DISCUSS [Listserv] JISC CETIS MASHe: a complete tutorial to scrap data from a mailing list and analyse participant and contribution.
- Finding (Nearly) Duplicate Items in a Data Column (fingerprint,ngram,cluster,facet), Description : An other great article by Tony Hirst. This tutorial will show you how to use clustering function (ngram and fingerprint) directly in your facet. Really handy.
- Chit Chat with New Datasets, Facets in OpenRefine (Was /Google Refine/) (duplicate,facet), Description : A good review of faceting capability including text, numeric, timeline customized and scatterplot facet.
- Cleaning Date with Google Refine (regex,if,split,project creation), Description : Basic tutorial to clean up some date using OpenRefine. Great example of well structure GREL syntax to build complex transformation.
- Refine your EventBrite guestlist (fetch url,API), Description : This recipe shows you how to use Google Refine to fetch details from your EventBrite account, and to explore your guest lists in detail. This tutorial show how to use the Create Project via Web Addresses (URLs)' and retrieve guest information using the EventBrite API.
- Google Refine Recipe (recipe), Description : Keith Maguire provide a list of short and sweet recipe to Capitalise the first letter, isolating value, faceted browsing or Comparing two columns with Refine. Enjoy!
- Grabbing Twitter Search Results into Google Refine And Exporting Conversations into Gephi (custom export,Gephi ,project creation,fetch url,twitter), Description : The second part of the tutorial explains how to prepare the data to import the in Gephi for data visualization purpose.
- Use Google Refine to clean your data for Fulcrum (facet,project creation,titlecase,map), Description : Fulcrum allow to create location-based data collection apps and deploy them to your mobile device. This tutorial show how to use google refine to take advantages of the data you have collected using fulcrum
- THATCamp Paris 2012 PiratePad (good practise,french), Description : PiratePad in french written during THATCamp Paris 2012 presenting a reflexion on how to use google refine or other tools to clean and work on data from a research worker perspective.
- Data Journalism Workshop - New York (video,introduction), Description : Google Hangout of HHNew York presenting Google Refine
- ABCD - Google Refine Workshop (exercise,split,history,toDate,toNumber,cluster,facet), Description : This tutorial / exercise will walk you through all google refine main functionality. Through it's exercise so you can get your hand on quickly!
- refine-stats (extension), Description : A extension for Google Refine to compute elementary statistics.
- Google Refine Uploader Extension (extension,upload,publish,CouchDB,JSON), Description :
- Data Shaping in Google Refine, Generating New Rows from Multiple Values in a Single Column (parse,JSON,fill down,transpose), Description : Great tutorial to reshape data set using transpose and fill down function. This article also introduce the split multi-valued cells function to split and transpose in one shot.
- Open Reconcile Installation and Use Tutorial (reconciliation,openreconcile), Description : A tutorial for how to install and use Open Reconcile, a JSON-based Google Refine-compatible reconciliation service
- The Semantic Puzzle | Transforming spreadsheets into SKOS with Google Refine (spreadsheet,reconciliation,rdf,skos), Description : This article go through the step to transform an Excel document to Simple Knowledge Organization System Reference (SKOS) using the RDF extension.
- Clean data is the best weapon against the monkey insurrection (split,toTitlecase,cluster,facet), Description : Entry level and fun tutorial for data journalist or open data people covering all the mains aspects to clean a data set.
- #STANBOL-594 Google Refine Reconciliation Service support - ASF JIRA (reconciliation,apache), Description : Add support for the Reconciliation Service API to the Stanbol Entityhub RESTful API The Google Refine ReconciliationServiceApi allows to reconcile String values with Entities. The Entityhub is very well suited for implementing this service as it can execute those queries very efficiently based on the SolrYard implementation.
- Capturing Interactive Data Transformation Operations using Provenance Work ows (university paper), Description : The ready availability of data is leading to the increased opportunity of their re-use for new applications and for analyses. Most of these data are not necessarily in the format users want, are usually heterogeneous, and highly dynamic, and this necessitates data transformation e\u000borts to repurpose them. Interactive data transformation (IDT) tools are becoming easily available to lower these barriers to data transformation e\u000borts. This paper describes a principled way to capture data lineage of interactive data transformation processes. We provide a formal model of IDT, its mapping to a provenance representation, and its implementation and validation on Google Refine. Provision of the data transformation process sequences allows assessment of data quality and ensures portability between IDT and other data transformation platforms. The proposed model showed a high level of coverage against a set of requirements used for evaluating systems that provide provenance management solutions.
- Google Refine + Perl (fetch url,Perl), Description : Make Google Refine and Perl transforms one-liners work together using the fetch by url (RESTful API)
- Institutional locations as Linked Data through Google Refine (reconciliation,RDF extension), Description : A complete example on how to use the RDF extension in google refine.
- University buildings as Linked Data with ScraperWiki (JSON,postal code,scaperwiki), Description : Example of unlock JSON call made via a Google Refine column transform. This post also explain how to use the value.parseJson() function
- Data-Mining My Old Radio Playlists (web scraping,cluster), Description : An example of web scraping and data analysis using google refine. In this tutorial, the cluster function is used to clean up the data set. The analysis part could also have been done in google refine using the facet option.
- Using Google Refine to clean mortgage data (split,introduction,facet,toNumber,cluster), Description : A nice tutorial explaining how to clean and facet data. This example is based on bank mortage data and show how to facet, use basic GREL function like replace, split, toNumber, if
- How to enhance your data set with freebase and google refine.The Lawrence Collection example. (reconciliation), Description : The National Library of Ireland used google refine to improve the access to the Lawrence Collection (photography collection) by using freebase reconciliation service to map where pictures have been taken!
- Looking up Images Trademarked By Companies Using OpenCorporates and Google Refine (opencorporate,reconciliation), Description :
- LOD2 extension for Grefine · GitHub (reconciliation,extension), Description : LOD2 Google Refine is a version of Google Refine, which includes some extensions to help you deal with Linked Open Data. With these extensions you can: (1) reconcile your data with DBpedia or RDF file or SPARQL endpoint; (2) to extend your reconciled data with data from DBpedia; (3) export data to RDF; (4) to extract entities from full text descriptions in your data ...
- Visualizing French Tax Data using grefine and tableau (facet,merge dataset,geolocalisation), Description : A nice tutorial mixing methodology and concrete action to gather, clean, harmonized, merge and visualize data (through tableau software)
- Keyword Research con Google Refine [Video Tutorial] (spanish,video,SEO), Description : Spanish video tutorial to find keyword using google refine
- Free Your Metadata : a Concrete Action Plan (introduction,reconciliation,facet,video), Description : 1h13 tutorial of by Free Your Metadata @ Columbia University
- Tutorial: From pdf to searchable, sortable table | Kevin Schaul (scraping,pdf), Description : Convert table pdf into csv.
- Google-Refine presentation at NICAR (introduction,good practise,cluster,facet), Description : Good introduction to grefine to navigate and clean data.
- A video tutorial to parse JSON string (export JSON,JSON,video), Description : This tutorial explain how to populate species pages in the BDRS using Google refine. A JSON string is generated from a souce, parsed and cleaned in Google refine and exported back in JSON format.
- How to: convert easting/northing into lat/long for an interactive map | Online Journalism Blog (fetch url,API,postal code), Description :
- Integrating Google Spreadsheet/Apps Script with Google Refine to update existing spreadsheets (script,google apps,google spreadsheet), Description : Use grefine to get the data, clean them and then import them to a spreadsheet doc.
- Data Clustering With The Google. (cluster), Description : Introduction starts slide 12. Presentation by Bob Lannon Senior NLP Analyst, Verilogue
- Free (and rebuild) the tweets! Export TwapperKeeper archives using Google Refine (xml,twapperkeeperrescue,google refine 2.5), Description : So here's a way you can make a copy of a Twapper Keeper archive and rebuild the data using Google Refine.
- Social Interest Positioning: Visualising Facebook Friends Likes With Data Grabbed Using Google Refine (JSON,xml,gephi,visualization,facebook), Description : Complete tuturial including, cleaning the data with grefine and visualization with Gephi.
- Using Google Refine and taxonomic databases (EOL, NCBI, uBio, WORMS) (reconciliation), Description : Tutorial to use grefine and reconciliate against 4 taxonomic databases
- Working with Organisation XML files in Google Refine : IATI Support (google refine 2.5,xml), Description : Example to open an xml file with the google refine 2.5
- Rejex: the JavaScript regular expression editor (regex), Description : Google refine support regex. This online regular expression editor is quite handy to test the expression before using it on grefine.
- Using Google Refine to add administrative geography - stevieflow (postal code,reconciliation), Description :
- Google refine extension for linkedgov.org (reconciliation,extension,linkedgov.org), Description : LinkedGov is a community project to collaboratively clean and make usable data from local authorities and other public bodies.
- Use Google Refine to Export JSON | Knight Digital Media Center (export,json), Description :
- Google Refine tips (tips), Description :
- Chapter 1. Using Google Refine to Clean Messy Data - ProPublica (facet,cluster), Description :
- Visualisation on Top 100 Chemical Companies with Google Refine and Google FusionTable tools | Data Visualisation (parse,fetch url,visualization), Description :
- How to use OpenCorporates to match companies in Google Refine on Vimeo (reconciliation), Description :
- Comparing Columns in Google Refine (compare), Description :
- Adding geographical information to a spreadsheet based on postcodes - Google Refine and APIs | Online Journalism Blog (fetch url), Description :
- Fragments: Glueing Different Data Sources Together With Google Refine (fetch url), Description :
- Merging Datasets with Common Columns in Google Refine (merge dataset), Description :
- MagdMartin'sGoogle Refine blog, Description : Blog introducing multiple recipes, tutorials and tips.
- Sliced and diced aid data with google refine (introduction), Description : How to prepare, explore and do some basic cleaning with your data using google refine
- Free Your Metadata | Reconciliation with Google refine (reconciliation), Description :
- Free Your Metadata | Cleanup using google refine (introduction,video), Description :
- Google refine basic: Full Tutorial by David Huynh (introduction), Description : A must read tutorial from the creator of google refine.
- Chuleta / Guía / Tutorial de OpenRefine (Google Refine)
- Enriqueciendo datos con OpenRefine: geocodificación de direcciones
- School of data - Limpieza de bases de datos - video
- Chuleta / Guía / Tutorial de Open Refine (Google Refine)
- Cómo usar OpenRefine para trabajar una base de datos including video tutorial
- Limpiando datos: Google Refine - Medialab-Prado Madrid
- Tutorial de OpenRefine including video tutorial
- Keyword Research con Google Refine (SEO)
- Cómo usar Google Refine en tu próxima investigación periodística
- Gobierno Vasco Irekia :: Introducción a Google Refine (Curso periodismo de datos 4/10)
- Recursos para limpiar datos con Google Refine
- Geocodificar en Colombia con OpenRefine y Google Geocoding API
- Open Refine Starter: Erste Schritte und Orientierung für Einsteiger | tobiaskut.de
- archivierte OpenRefine-Tutorials von pushthings4ward.com:
- Datenzeilen zergliedern
- Suchen und Ersetzen
- Datamining
- Doppelte Zeileneintrage in Spalten löschen
- ZEIT Online Content API anzapfen
- Spalte duplizieren
- Externe Datenspalten importieren
- Informationen in Datenzellen ergänzen
- Transponieren
- Die Text Facet Funktion
- Rechnen
- Benutzerdefinierter Datenexport
- Hintergrundrauschen ausblenden
- Die Replace Funktion
- Tutorials mit Daten aus der Geschichtswissenschaft | histHub.ch
- Tutorials mit Daten aus dem Archiv | FDMLab.Landesarchiv-BW.de
- Daten sichten, bereinigen und integrieren mit OpenRefine | OpenSchoolMaps.ch
- Exemples d'usages d'OpenRefine sur le Wiki Bibliopedia
- L'attribution d'un code de domaine aux notices en provenance du Sudoc | Punktokomo ;
- Préparer un corpus de tweets avec open/google Refine pour le visualiser dans Gephi
- Playlist YouTube dédiée à des tutoriaux avancés d'Open Refine, en français
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（1）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（2）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（３）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（４）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（5）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（6）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（7）
- 特許データのゴミ取り（名寄せ）へのOpen Refineの利用可能性（8） +Google Refineの使い方