Replies: 5 comments
-
interesting, using chat GPT for that would probably work. Many people who self host prefer to have everything run locally on their device so the ideal solution would have some kind of pre-trained model available directly in the application that is specialised for these kinds of tasks and can run on a lighter infrastructure but I am not sure if AI is advanced enough for that. Do you know any more about this or want to figure it out? Could you also post a few examples of image to json conversions that chat GPT can handle and which promts you used so I can get a feel of how good it is. maybe integrating with open AI as a optional component would be something useful for people. |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
I forced it to insert all ingredients and steps. Sadly Dall-e seems to be down, otherwise it would have added a tasty image.
|
Beta Was this translation helpful? Give feedback.
-
that looks really cool, I have no idea when I will be able to work on this but if anyone wants to pick it up I suggest to implement it in a way that a user can add an API token to OpenAI (or oauth or something) and then add a special page to the ImportView that allows images to be send to OpenAI. The response can either be directly or parsed into the format returned by recipe-scrapers or a special scraper could be build to then push the recipe into the normal parsing flow as any normally URL imported recipe is. |
Beta Was this translation helpful? Give feedback.
-
Open AIs ChatGPT integration would be helpful for my use case as well. I am not using images, but recipes published on Instagram (please don't judge me 😅) in instructered plain text. And I want these out of the walled garden in a more usable interface. I had success by manually using ChatGPT 3.5 to convert the plain text into JSON and then importing the generated JSON to tandoor. If this workflow could be automated (ideally, provide link or plain text) this would be great. |
Beta Was this translation helpful? Give feedback.
-
Hi all! I just installed tandoor via docker/portainer. It works really nice.
I was looking into tandoor because a friend showed me crouton app, which can import recipes from a smartphone photo. I would like something similar and it probably requires AI to identify ingredients and amounts in recipe photo and text.
So far I was able to do it with OpenAI/ChatGPT. It can read photos. It can also convert a spoken explanation of a recipe into a nicely structured and written recipe. It can even generate a photo from the written recipe.
I got stuck with Tandoor in the import section. I asked ChatGPT to format the recipe as JSON, tried pasting that in source import, but that didn't work.
I'm reasonably fluid in Python, I never worked with Django, and I know very little of the Tandoor architecture and roadmap. What would be a good way to integrate an AI API into the source?
https://platform.openai.com/docs/api-reference/making-requests
Beta Was this translation helpful? Give feedback.
All reactions