- add sendgrid email option to config and messaging (345)
- include global id fields in hashing (344)
- preserve global id's in output (342)
- ignore the forklift hash field if it already exists (343)
- add ability to send lift report to slack (9123575)
- add --profile switch to build command (7dbbf3d)
- add
Pallet.process_on_fail(6354f54) - add ability to ignore changes in requires processing (0488862)
- add build cli command (c66bbce)
- add changeDetectionTables config value and associated docs (6cd30c9)
- add check for Pro license and email on error (b13ee91), closes #312
- add machine name to global error email (1dc7560)
- add pallet arg to gift-wrap and tweak signature (be80b99), closes #307
- add server start/stop errors to ship reports (4ce1bd8), closes #279
- allow configuration of the standalone logging level (1aa61f8)
- add change detection implementation (6644df8)
- log (debug) message when data is not found during build (fcee3e0)
- post shipping report to slack (f947f96)
- raise custom exception rather than return None (a0e6ecf)
- allow for UNC pallet paths (f2c69e4)
- create safe access middle man (6526091)
- don't fix every source name (2f6b32c)
- explicitly specify no test for change detection append (b435f11)
- fix bug preventing the detection of casing schema changes (70be5a5), closes #277
- fix mocked method name (7ff5f87)
- handle errors posting report to slack (fb7af5a)
- handle mis-matching crates between pallet and packing list (f8d853b)
- handle missing changeDetectionTables config value (50913ba)
- handle more database sources name formats (663fcc0)
- fix int string concat (e3158da)
- log actual services being shut down during gift-wrap ship (dcabf4d)
- make sure text is actually text (d284f27)
- method syntax (c8bc253)
- prevent change detection from skipping initial data import (14d7421)
- stringify exception for crate exception message (24f118e)
- perf: remove unnecessary call to exists (85919f4)
- make append more flexible with differing schemas (3d76902), closes /github.com/agrc/forklift/blob/d442f7b7d866527ab886fbd2db82e1afa7af7072/src/forklift/core.py#L90
- fix missing imports (eb8fa51)
- remove duplicate check for pallet success (3f8a5cd)
- remove the creation of "gift-wrapped" subfolder (733af00)
- show message and set default (d4ca151)
- smarter skipping of shape, shape length and oid fields during compare (552f04c)
- tweak slack ship report for server start/stop errors (89abc68)
- use geographic transformation environment in change detection (d442f7b)
- slack: appended fields need to to_text (987b97f)
- use correct prop name for pallet result and message (e91ed19)
- use status color for pallet message in ship report
- update ship report with correct pallet status
- allow shipping of pallets that did not lift all crates successfully #294
- replace flake8 and pep8 with pylint
- add init_standalone to allow pallets to be run more easily outside of forklift
- add packing slip to report email
- add forklift version to email
- disable ssl cert validation to gis servers
- show pallet import errors in report
- show git update errors in report
- apply create results to packing slip for use in ship
- show post_copy_process and ship times in ship report
- feat: allow for non github repos
- feat: create cli option for gift-wrapping data
- feat: implement special-delivery command lift
- docs: location for user install
- docs: markdown lint fixes
- fix: CVE-2018-18074 More information
- fix: return unhandled crate exceptions as strings
- fix: update version of pytest-cov
- fix: url creation based on shorthand
- fix: use PAT, dict syntax, and log repo name without token
- Better requests to ArcGIS Server and handling of errors.
- Docs: Better getting started steps.
- Removed multiprocess for git-update. Forklift was randomly hanging on git-update.
- Make default warehouse location consistent with other default paths.
- Account for
ERRORresult in crate report. - Allow pallets that don't have any crates to copy data to dropoff by overriding
requires_processing.
- Added
--send-emailsoverride option for both lift and ship commands. - Added
ERRORas a possible result type for crates. - Removed unused crate property,
source_primary_key - BREAKING CHANGE: Split up lift and ship to be independent commands.
- Replaced arcgis server env variables with config.json properties to allow for managing a silo'd architecture or multiple machines not in a cluster
- Replaced env variables with config.json properties for consistency.
- Ship now shuts down the entire ArcGIS Server machine rather than specific services. It also now does this one machine at time to minimize downtime.
- Removed static data processing since it can now be accomplished by dropping the data into the dropoff folder.
- Removed tox because it's incompatible with conda.
- Enhanced the remove repo command to also delete the repository folder from disk (#134).
- Removed the check for python version 3.
- Switched from nose to pytest for running tests.
- Add support for m & z values in the destination geometry (#223).
- Add new crate warning type (
UPDATED_OR_CREATED_WITH_WARNINGS) to address the issue of processing crates with warnings. NowWARNINGmeans there was a warning and the data was not updated andUPDATED_OR_CREATED_WITH_WARNINGSmeans there was a warning and the data was updated (or created). - Add
Crate.was_updated()method to save code in pallets when you want to check to see if the data for a crate was updated.
- Fix unicode bug with
-hhelp CLI option. - Fix bug in timeout code.
- Increase timeout value.
- Try to enforce running only on python 3.
- Add a timeout on http requests to avoid infinite hanging requests.
- Better management of parallel processes.
- Add process time per pallet to report (#215).
- Implement
--skip-copyparameter toliftallowing the user to skip copying data tocopyDestinations.
- Fix bug in
list-palletscommand. Thanks @joshgroeneveld!
- Parallelize the starting & stopping of ArcGIS Server services (#118).
- Parallelize git_update (#204).
- Fix the thin red line showing up at the top of successful report emails.
- Add warning to reports for duplicate features (#185) and empty destinations (#197).
- Give static copy errors their own line on the report.
- Add hostname to report email subject and body (#182).
- Fixed a bug causing errors when trying to delete the scratch database a6941b1ff3757267d69ec04cdf12488b1d77aa2c
- Added a sample batch file (
run_forklift.bat) that can be used with Windows Scheduler. - Fixed a bug caused by creating standalone tables with templates (#197).
- Added the ability to update the ArcGIS Server credentials in
LightSwitch(PR #200).
- Fixed bug that prevented pallets that through errors during
pallet.build()from showing up in the report. - Update tests and associated data for Pro 2.0.
Pallet.buildis now called on all pallets even when only a single pallet is run #186*.lockfiles are ignored when copying from staging tocopy_datadestinations.- Removed the deletion of the scratch GDB from the end of the forklift process. ArcGIS Pro was having issues with this and it's already being removed at the beginning of the process.
- Upgraded to python 3.5. Now requires running from within the ArcGIS Pro Conda environment (PR #187).