Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Web handler parse content from limited html element #9188

Closed
ZoranPandovski opened this issue May 9, 2024 · 0 comments · Fixed by #9190
Closed

[Bug]: Web handler parse content from limited html element #9188

ZoranPandovski opened this issue May 9, 2024 · 0 comments · Fixed by #9190
Assignees
@ZoranPandovski
Labels
bug Something isn't working

Comments

@ZoranPandovski
Copy link
Member

ZoranPandovski commented May 9, 2024 •
edited

Currently, the Web handler handles a limited set of HTML elements and ignores types such as div, span, and table. It would be better to re-write get_readable_text_from_soup helper function and use library as hmlt2text to parse the content.
@ZoranPandovski ZoranPandovski added the bug Something isn't working label May 9, 2024
@ZoranPandovski ZoranPandovski self-assigned this May 9, 2024
@ZoranPandovski ZoranPandovski mentioned this issue May 10, 2024
Merged
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ZoranPandovski ZoranPandovski

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Verify web mindsdb/mindsdb
1 participant
@ZoranPandovski