TRAC D.A.P. 0.5.29

TRAC D.A.P. 0.5.29 is a maintenance release for 0.5 series, it includes security and compliance updates to cover the latest vulnerabilities reported via NVD. It also includes a back-port of support for Pandas 2.0 and 2.1, which will be included in the upcoming 0.6 series.

Currently there are no plans to support Python 3.12 or Java LTS 21 in the 0.5 series, support for both will be included in the upcoming 0.6 series. However this release is still compatible with Python 3.7, which is now EOL. Support for Python 3.7 is already dropped in Apache Arrow since version 13 and so will be dropped in the 0.6 series of TRAC D.A.P.

TRAC D.A.P. 0.6.0 RC 2

The second RC for the 0.6 series adds signifcant updates in the storage layer, as well as some refactoring of the core TRAC services:

• Azure runtime storage plugin (fsspec)
• Azure platform storage plugin
• GCP runtime storage plugin (Arrow native, fsspec)
• GCP platform storage plugin (for testing only, using GCP v2 APIs)
• Update to Apache Arrow version 13
• Update core dependencies to latest stable (Netty, gRPC)
• Refactor and simplify API for metadata batch writes

The API change for metadata batch writes is a breaking change to the metadata API. It only affects batch writes, all other metadata operations and other APIs are unaffected.

TRAC D.A.P. 0.6.0 RC 1

The TRAC D.A.P. 0.6 series includes a significant update to the storage layer, to allow for running on multiple cloud targets with substantially the same storage implementation. This RC previews the storage layer updates.

Included in RC 1 is the HTTP download API for FILE objects, which allows files stored in TRAC to be downloaded with regular HTTP requests. It is intended for providing permanent links to resources, and to let downloads be managed by the browser rather than relying on JavaScript and the web API bindings library.

TRAC D.A.P. 0.5.28

TRAC D.A.P. 0.5.28 adds a fix for data-conformance of all-null data when using third-party storage plugins.

Version 0.5.28 is metadata-compatible with versions 0.5.0 and later.

TRAC D.A.P. 0.5.27

TRAC D.A.P. 0.5.27 is a point release to back-port several minor fixes and incremental features from the upcoming 0.6 release to the 0.5.x series.

• Handle paths longer than the Windows max path length in the model loader on Windows
• Add a readOnly option for local storage (intended for use with the build in web server)
• Fix log rotation settings in the default platform config files
• Add EXISTS operation to the metadata search API
• Add isLatestObject and isLatestTag to tag headers returned from the metadata service
• Fix model error reporting on Python versions 3.7 and 3.8
• More meaningful error reporting in local dev mode for inconsistent graph errors

Version 0.5.27 is metadata-compatible with versions 0.5.0 and later.

TRAC D.A.P. 0.5.25

TRAC D.A.P. 0.5.25 is a point release that adds a number of requested features:

• Range API for data download with offset / limit parameters
• Optional labels for model input / output schemas
• Improved JSON upload performance (using Jackson ByteBuffer feeder for streaming upload)

Version 0.5.25 is metadata-compatible with versions 0.5.0 and later.

TRAC D.A.P. 0.5.24

TRAC D.A.P. 0.5.24 rolls up several optimizations, including improvements to both the memory footprint and execution time for complex flows. There are also fixes in the shim loading mechanism and guard rails for dangerous functions.

• Actors engine is now multi-threaded, each actor is allocated to an event loop
• Dedicated event loops for model execution and data read/write (data is written while execution continues)
• Improved memory eviction - data / models are evicted from memory when they are no longer live in a flow
• Fix for shim loading multiple model versions when there is more than one root package
• Fix for shim loading unqualified relative imports (mimic Python behaviour in the IDE)
• Allow dangerous functions during import for shim-loaded models (required for some 3rd party libraries)

Version 0.5.24 is metadata-compatible with versions 0.5.0 and later.

TRAC D.A.P. 0.5.23

TRAC D.A.P. 0.5.23 is a patch release to fix an issue with with protected functions.

Version 0.5.23 is metadata-compatible with versions 0.5.0 and later.

TRAC D.A.P. 0.5.22

TRAC D.A.P. 0.5.22 introduces a new security feature to prevent model code from calling dangerous functions such as exec(), eval() and sys.exit() when running on the platform. There are also a number of improvements in error handling and logging to provide more meaningful error information to users.

Version 0.5.22 is metadata-compatible with versions 0.5.0 and later.

TRAC D.A.P. 0.5.21

TRAC D.A.P. 0.5.21 focuses on optimising the platform APIs, especially the data API. There are also improvements in model error reporting.

• gRPC compression is enabled on all services, applied automatically based on message size
• Compression available in the web API using the "trac" transport with the option compress: true
• Default settings in the data service have been tuned to maximize throughput
• Platform config option added to limit the maximum downloadable file size
• Simplified parts of the data pipeline to give more predictable performance
• Make model errors visible on the platform with details of the file, line number and statement

Version 0.5.21 is metadata-compatible with versions 0.5.0 and later.