Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SCRAPER] - Can not import from bettybossi.ch #3593

Open
3 tasks done
FudiHub opened this issue May 13, 2024 · 1 comment
Open
3 tasks done

[SCRAPER] - Can not import from bettybossi.ch #3593

FudiHub opened this issue May 13, 2024 · 1 comment
Labels
bug: confirmed bug Something isn't working scraper

Comments

@FudiHub
Copy link

FudiHub commented May 13, 2024

First Check

  • I used the GitHub search to find a similar issue and didn't find it.
  • I have verified that this issue is not related to the underlying library hhyrsev/recipe-scrapers by 1) checking the debugger and data is returned, 2) verifying that there are errors in the log related to application level code, or 3) verified that the site provides recipe data, or is otherwise supported by hhyrsev/recipe-scrapers
  • This issue can be replicated on the demo site (https://demo.mealie.io/)

Please provide 1-5 example URLs that are having errors

I am not able to import a recipe from bettybossi.ch but json data is available.
Example-Link: https://www.bettybossi.ch/de/Rezept/ShowRezept/BB_BRUN110415_0008A-80-de
embedded tag:

<script type="application/ld+json">{"@context":"http://schema.org","author":{"name":"Betty Bossi","@type":"Organization"},"publisher":{"name":"Betty Bossi","@type":"Organization"},"image":["https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r01_v005_x0010.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r01_v004_x0020.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v003_x0020.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r01_v004_x0010.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v003_x0010.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v001_x0020.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v002_x0010.jpg","https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v001_x0010.jpg"],"name":"Sonntagszopf","description":"Knusprig und fein gebacken: So muss ein Zopf bei deinem Brunch doch sein.","keywords":"Zopfmehl, Salz, Zucker, Hefe, Butter, Milch, Eigelb, Milch","cookTime":"PT185M","prepTime":"PT15M","totalTime":"PT200M","recipeYield":"8 Personen","recipeCategory":"Brot","recipeCuisine":"Brot","recipeIngredient":["500 g Zopfmehl oder Weissmehl","1.5 TL Salz","1 TL Zucker","0.5 Würfel Hefe (ca. 20 g)","60 g Butter","3 dl Milch (300 g)","1 Eigelb","1 EL Milch oder Rahm"],"nutrition":{"calories":"311 kcal","fatContent":"9 g","carbohydrateContent":"46 g","proteinContent":"10 g","servingSize":"100 g","@type":"NutritionInformation"},"suitableForDiet":["https://schema.org/VegetarianDiet"],"recipeInstructions":[{"position":1,"text":"Mehl, Salz und Zucker in einer Schüssel mischen. Hefe zerbröckeln, daruntermischen. Butter in Würfel schneiden, mit der Milch beigeben, mischen, zu einem weichen, glatten Teig kneten. Teig zugedeckt bei Raumtemperatur ca. 2 Std. aufs Doppelte aufgehen lassen.","@type":"HowToStep"},{"position":2,"text":"Teig in zwei Portionen teilen, zu je ca. 70 cm langen Strängen formen, die an den Enden dünner werden. Stränge zu einem Zopf flechten, auf ein mit Backpapier belegtes Blech legen. Eigelb und Milch verrühren, Zopf damit bestreichen und nochmals ca. 30 Min. aufgehen lassen.\nOfen auf 200 Grad vorheizen. Zopf nochmals mit Ei bestreichen.","@type":"HowToStep"},{"position":3,"text":"Backen: ca. 35 Min. in der unteren Hälfte des Ofens.","@type":"HowToStep"}],"datePublished":"2013-02-15","aggregateRating":{"ratingCount":56,"reviewCount":66,"ratingValue":4.61,"worstRating":1,"bestRating":5,"@type":"AggregateRating"},"video":[{"name":"Rosen-Zopf","description":"Sonntagszopf","thumbnailUrl":"https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v003_x0020_n001.jpg","contentUrl":"https://youtu.be/ulK_k3HEjh4","uploadDate":"2013-02-15","@type":"VideoObject"},{"name":"Sechsstrang-Zopf","description":"Sonntagszopf","thumbnailUrl":"https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v003_x0020_n002.jpg","contentUrl":"https://youtu.be/7NR5wq77xSI","uploadDate":"2013-02-15","@type":"VideoObject"},{"name":"Zweistrang-Zopf","description":"Sonntagszopf","thumbnailUrl":"https://www.bettybossi.ch/rdbimg/bb_brun110415_0008a/bb_brun110415_0008a_r02_v003_x0020_n003.jpg","contentUrl":"https://youtu.be/5nqHbAfrI44","uploadDate":"2013-02-15","@type":"VideoObject"}],"@type":"Recipe"}</script><meta name=robots content="max-image-preview:large">

Please provide your logs for the Mealie container docker logs <container-id> > mealie.logs

INFO     2024-05-13T16:36:14 - Application startup complete.
INFO     2024-05-13T16:36:14 - Uvicorn running on http://0.0.0.0:9000 (Press CTRL+C to quit)
INFO     2024-05-13T16:36:15 - [10.10.10.105:57964] 304 Not Modified "GET /g/home/r/create/url?recipe_import_url=https%3A%2F%2Fwww.bettybossi.ch%2Fde%2FRezept%2FShowRezept%2FBB_BRUN110415_0008A-80-de&use_keywords=1 HTTP/1.1"
INFO     2024-05-13T16:36:15 - [10.10.10.105:57964] 200 OK "GET /api/users/self HTTP/1.1"
INFO     2024-05-13T16:36:15 - [10.10.10.105:57964] 200 OK "GET /api/groups/cookbooks?page=1&perPage=-1&orderBy=position&orderDirection=asc HTTP/1.1"
INFO     2024-05-13T16:36:15 - [10.10.10.105:57970] 200 OK "GET /api/organizers/tags?page=1&perPage=-1&orderBy=name&orderDirection=asc HTTP/1.1"
INFO     2024-05-13T16:36:15 - HTTP Request: GET https://www.bettybossi.ch/de/Rezept/ShowRezept/BB_BRUN110415_0008A-80-de "HTTP/1.1 200 OK"
INFO     2024-05-13T16:36:16 - HTTP Request: GET https://www.bettybossi.ch/de/Rezept/ShowRezept/BB_BRUN110415_0008A-80-de "HTTP/1.1 200 OK"
INFO     2024-05-13T16:36:16 - [10.10.10.105:57969] 400 Bad Request "POST /api/recipes/create-url HTTP/1.1"
INFO     2024-05-13T16:36:18 - HTTP Request: GET https://www.bettybossi.ch/de/Rezept/ShowRezept/BB_BRUN110415_0008A-80-de "HTTP/1.1 200 OK"
INFO     2024-05-13T16:36:19 - HTTP Request: GET https://www.bettybossi.ch/de/Rezept/ShowRezept/BB_BRUN110415_0008A-80-de "HTTP/1.1 200 OK"
INFO     2024-05-13T16:36:19 - [10.10.10.105:57969] 400 Bad Request "POST /api/recipes/create-url HTTP/1.1"

Deployment

Docker (Linux)

@FudiHub FudiHub added bug Something isn't working scraper triage labels May 13, 2024
@hay-kot
Copy link
Collaborator

hay-kot commented May 31, 2024

Looks like it's an issue with redirection happening. Did a cursory look with curl and couldn't get to the actual HTML.

CleanShot 2024-05-31 at 09 00 53@2x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug: confirmed bug Something isn't working scraper
Projects
None yet
Development

No branches or pull requests

2 participants