Scottish Parliament Scraper

[ajparsons]

The Scottish Parliament is changing over to a new site, and has said they will switch off their old site (which we scrape) at some point.

The new site is : https://www.parliament.scot/chamber-and-committees/official-report/search-what-was-said-in-parliament?showPlenary=true

They said they were going to do this in June, but the new site still currently says the old site is the primary record while the new one undergoes 'final testing'.

As such, unclear if this is very pending, or given it didn't happen over the summer, might not until winter.

We should:

• Get back in touch, check on their current timeline, and if any major revisions to new site are expected (Alex)
• Estimate how long to write a new scraper based on the new site (Matthew)

[ajparsons]

Current view is that: "The web team say that they hope to turn off the old website by the end of 2023."

In practice, probably that will be the winter break (with the chance that it's not), and at the least it's not 'next week'.