Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add image scraping support #4422

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from

Conversation

keenbed
Copy link
Contributor

@keenbed keenbed commented Jan 5, 2024

as per title

@dogwithakeyboard
Copy link
Contributor

I put together a quick image yml scraper to test and it's not showing in my scraper list. I'm getting the following in the error log when reloading the scrapers:

Error loading scraper c:\stash\scrapers\TestImage.yml: yaml: unmarshal errors:
  line 10: field Title not found in type scraper.mappedImageScraperConfig
  line 11: field Date not found in type scraper.mappedImageScraperConfig
  line 22: field Details not found in type scraper.mappedImageScraperConfig
  line 23: field Photographer not found in type scraper.mappedImageScraperConfig
  line 24: field Code not found in type scraper.mappedImageScraperConfig

I'm assuming an image scraper would be almost identical to a gallery scraper and look something like this:

name: "Test Image"
imageByURL:
  - action: scrapeXPath
    url:
      - testurl.com
    scraper: imageScraper
xPathScrapers:
  imageScraper:
    image:
      Title: //title
      Date: 
        selector: //date
        postProcess:
          - parseDate: 2006-01-02
      Studio:
        Name: //studio
      Performers:
        Name: //performer
      Tags:
        Name: //tag
      Details: //details
      Photographer: //photographer
      Code: //title

@DogmaDragon DogmaDragon linked an issue Feb 18, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

Successfully merging this pull request may close these issues.

[Feature] Image Scraping
2 participants