You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Allow users to specify which fields they do or don't want included in the output.
Add only and except to the params hash in Authority#scrape.
Both of these should be a comma-separated list of field names.
Using only and except params at the same time throws an error.
We might need to consider how this would interact with potential options for a deep or shallow scrape, eg an option like documents: true which scrapes the contents of documents pages.
One specific use case is including or excluding personal data eg applicants' and agents' names, email addresses and phone numbers. But it'd be nicer to do that with an option like personal_data: false.
The text was updated successfully, but these errors were encountered:
True. And that's going to be a bunch of fun to code because different systems put their fields on different pages, so you'd need a data structure breaking down which systems, pages and fields correspond.
Allow users to specify which fields they do or don't want included in the output.
Add
only
andexcept
to theparams
hash inAuthority#scrape
.Both of these should be a comma-separated list of field names.
Using
only
andexcept
params at the same time throws an error.We might need to consider how this would interact with potential options for a deep or shallow scrape, eg an option like
documents: true
which scrapes the contents of documents pages.One specific use case is including or excluding personal data eg applicants' and agents' names, email addresses and phone numbers. But it'd be nicer to do that with an option like
personal_data: false
.The text was updated successfully, but these errors were encountered: