Releases: danieldotnl/ha-multiscrape
v7.0.2 Separate http settings for form submit and scrape requests
Update: Breaking change
In this release, the http request settings for submitting a form are different from those for scraping. Before this release some of the setting were shared. If you need specific settings for form_submit (like headers or verify_ssl), you can specify those under the form_submit part of your configuration.
Changes
- Separate http settings for form submit and scrape request @danieldotnl (#353)
- Update dev environment @danieldotnl (#352)
- Update lint.yml to python 3.12 @danieldotnl (#349)
Contributors
Assets 2
v7.0.1 Fix for missing trigger services
Changes
- Create a trigger service for each configuration. @danieldotnl (#351)
- Upgrade dev container to python 3.12 + prep pytest @danieldotnl (#350)
- Update dependency homeassistant to v2024.4.0 @renovate (#347)
- Update dependency ruff to v0.3.5 @renovate (#344)
Contributors
Assets 2
v7.0.0 Scrape service with response
New services!
This major release contains 2 brand new services that should make figuring out your configuration and css selectors much easier!
It makes use of the new functionality in Home Assistant that services can now provide a response. To make this possible, significant refactoring was required.
multiscrape.get_content
This service retrieves the content of the website you want to scrape. It shows the same data for which you had to enable log_response and open the page_soup.txt file.
multiscrape.scrape
This does what it says. It scrapes based on a configuration you can provide in the service data. It is ideal for quickly trying out multiple css selectors, or to scrape data in an automation that you only need when running that automation.
A nice detail is that both services accept exactly the same configuration as you provide in your configuration yaml. Even the form_submit features are supported! However, there is a small but important caveat. Read more about it in the readme.
Changes
- Update readme and version for release with new services @danieldotnl (#343)
- Add service icons for hassfest validation @danieldotnl (#342)
- Update actions/setup-python action to v5.1.0 @renovate (#341)
- Update dependency homeassistant to v2024.3.3 @renovate (#339)
- Update dependency ruff to v0.3.4 @renovate (#338)
- Update dependency homeassistant to v2024.3.1 - autoclosed @renovate (#321)
- Update dependency ruff to v0.3.3 @renovate (#322)
- Implement service for scraping @danieldotnl (#335)
- Update dependency pip to v24 @renovate (#326)
- Update dependency colorlog to v6.8.2 @renovate (#323)
- Update release-drafter/release-drafter action to v6 @renovate (#324)
- Update dependency homeassistant to v2024.1.3 @renovate (#318)
- Update dependency ruff to v0.1.13 @renovate (#317)
- Vscode task to upgrade dependencies @danieldotnl (#316)
- Update dependency homeassistant to v2024.1.2 @renovate (#314)
Contributors
Assets 2
Fix issue with headers when using form_submit
Changes
- Fix issue in creating renderers for dictionaries with templates @danieldotnl (#313)
Contributors
Assets 2
Support for templates in request headers
Contributors
Assets 2
🌈v6.7.6: Upgrade lxml (required for HA 2024.1)
Changes
- Update manifest.json to prevent conflicts with HA (fix for 2024.1) @hmmbob (#306)
- Remove dependabot as we are using renovate instead @danieldotnl (#305)
- Update dependency homeassistant to v2023.12.4 @renovate (#300)
- Upgrade lxml and beautifulsoup versions to latest @danieldotnl (#304)
- Update dependency ruff to v0.1.9 @renovate (#299)
Contributors
Assets 2
Parse template results into their own data type
Changes
- Configure Renovate @renovate (#295)
- Also parse value_templates on scraped data @danieldotnl (#296)
- Bump ruff from 0.1.6 to 0.1.8 @dependabot (#293)
- Bump colorlog from 6.7.0 to 6.8.0 @dependabot (#286)
- Bump actions/setup-python from 4.7.1 to 5.0.0 @dependabot (#289)
- Bump github/codeql-action from 2 to 3 @dependabot (#294)
- Bump homeassistant from 2023.11.2 to 2023.12.3 @dependabot (#292)
- Bump ruff from 0.1.4 to 0.1.6 @dependabot (#282)
- Bump homeassistant from 2023.10.5 to 2023.11.2 @dependabot (#280)
- Bump ruff from 0.1.1 to 0.1.4 @dependabot (#277)
- Update pip requirement from <23.3,>=21.0 to >=21.0,<23.4 @dependabot (#268)
- Bump homeassistant from 2023.9.0 to 2023.10.5 @dependabot (#273)
- Bump actions/checkout from 4.0.0 to 4.1.1 @dependabot (#270)
- Bump ruff from 0.0.287 to 0.1.1 @dependabot (#272)
- Bump actions/setup-python from 4.7.0 to 4.7.1 @dependabot (#262)
- Validate on master branch @danieldotnl (#247)
- Bump homeassistant from 2023.8.4 to 2023.9.0 @dependabot (#244)
- Bump actions/checkout from 3.5.2 to 4.0.0 @dependabot (#240)
- Update pip requirement from <23.2,>=21.0 to >=21.0,<23.3 @dependabot (#242)
- Bump ruff from 0.0.286 to 0.0.287 @dependabot (#243)
- Bump actions/setup-python from 4.6.1 to 4.7.0 @dependabot (#241)
- Add release drafter config @danieldotnl (#245)
Contributors
Assets 2
Support for dictionaries and other types in attributes
I am very motivated by coffee!! If you are enjoying this multiscrape custom component, please consider to:
Changes
- Attributes set by a value_template are now parsed into their type, e.g. dictionary
📦 Dependencies
- Bump actions/checkout from 3 to 4 (#237) @dependabot
- Bump crazy-max/ghaction-github-labeler from 4.1.0 to 4.2.0 (#232) @dependabot
- Bump flake8 from 6.0.0 to 6.1.0 in /.github/workflows (#229) @dependabot
- Bump black from 23.3.0 to 23.7.0 in /.github/workflows (#221) @dependabot
- Bump pip from 23.1.2 to 23.2.1 in /.github/workflows (#228) @dependabot
Contributors
Assets 2
Fix icon in binary_sensor
If you are enjoying this multiscrape custom component, please consider to:
Changes
- Fix issue with setting icon in binary_sensor (#227) @danieldotnl
Contributors
Assets 2
Fix multiscrape does not start in 2023.7.1
Changes
- Integrate fix registering service schema with wrong name (#217) @danieldotnl (Fix #215)
📦 Dependencies
- Bump release-drafter/release-drafter from 5.23.0 to 5.24.0 (#212) @dependabot
- Bump reorder-python-imports from 3.9.0 to 3.10.0 in /.github/workflows (#211) @dependabot
- Bump pre-commit from 3.3.1 to 3.3.3 in /.github/workflows (#210) @dependabot