[#425] Extend harvester to support include/exclude filtering by tags #427
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
After Travis stopped supporting Open Source projects we decided to move to GitHub Actions, which has turned out to be excellent. The workflow uses two jobs, one for basic syntax checking with Flake8 and a matrix of test run using the supported CKAN versions (not master yet, more on this later). The tests run inside a Docker Container pre-configured with a CKAN dev install (currently the openknowledge/ckan-dev images are used). Additionally all services are also Dockerized, using ckan/ckan-solr-dev and ckan/postgres-dev and the standard redis image.
Fix last harvest time to avoid timeouts
Add flake8 step to Github Actions workflow
Optimize last error free job
…dis_key check that redis key is available before running .strptime
`run_test` command is actually spelled as `run-test`
Should never be necessary in data.gov, but for upstream.
Bug/clean harvest info
Fix harvest extras for packages
|
It looks interesting, but test are failing |
…vailable use render_jinja2 for when it is available for ckan core <= 2.9.4
…-error remove force_import_val
Makes the test independent of the test execution order Prevents the test from failing on a server that is not freshly installed
…e-and-fixes-timeout-calculation Improve test coverage and fixes timeout calculation
…ry-command-keep-latest-objects Add option keep-current to clearsource_history command
Futureproof version check to work also on 3.0+
…icial/ckanext-harvest into GovDataOfficial-release-version-1-3-4
…hub.com/scottlimmer/ckanext-harvest into feature/425-tags-filter-include-exclude � Conflicts: � CHANGELOG.rst
|
Is anybody still working on this issue? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Added ability to include/exclude filter by tags as per organization/groups.
PR includes logic, CHANGELOG, README, tests