v6.5.1

[6.5.1] - 2023-12-06

Fixed

• Upgrade logback-classic to 1.4.14.
• Upgrade wiremock-jre8 to 2.35.1.

[6.5.0] - 2023-12-06

Changed

• Update dependency on idlab-functions-java to 1.3.1. This implies three things:
  • The namespace for IDLab functions FnO descriptions changed, so RMLMapper loads the old and the new one to remain compatible;
  • All tests in RMLMapper use the new namespace;
  • Stateful functions use a more compact and efficient state.
• Update dependency on function-agent-java to 1.2.0, the first version released on Maven Central.
• Upgraded rdf4j-client dependency to version 4.3.8
• Compile regex patterns for RDF4J store only once for performance.

Fixed

• Setting option disable-automatic-eof-marker in a configuration file has no effect (see GitLab issue #269).
• Start adhering to Keep a Changelog from now on (Improvements -> Changed).
• Compatibility issue with old IDLab functions FnO descriptions (see GitLab issue #270)

[6.4.0] - 2023-11-14

Added

• Test handling Windows CRLF line ending for CSV files (issue #201)
• Added test for empty column handling in csv logical source files (issue #159)

Improvements

• Tests: let Java handle temporary files.
• pom: upgrade maven-surefire-plugin to 3.2.2
• pom: upgrade nexus-staging-maven-plugin to 1.6.13
• pom: upgrade json-path to 2.8.0
• pom: upgrade logback-classic to 1.4.11
• resources: rml-ldes: avoid symlinks
• pom: upgrade RDB connectors (postgresql 42.6.0, mssql-jdbc 12.4.2.jre11, ojdbc11 23.3.0.23.09, mysql-connector-j 8.2.0)

Changed

• Use the DataIO library to handle access to files.
• Requires Java 17 language level.
• Refactoring to use interfaces where possible (e.g. ArrayList -> List).

Fixed

• Test cases: add array initializers to avoid bugs.
• Use correct prefix for EventStreamTargets in tests.
• Refactoring of Executor: code deduplication
• Document --disable-automatic-eof-marker option.

v6.3.0

Improvements

• Add support for detecting additions, modifications, and deletions in a Knowledge Graph with FnO functions.
• Verify LDES EventStreamTarget output for additions, modifications, and deletions.
• Added RML-LDES test-cases.
• Added test for mapping with CSV file where column does not match header

Changed

• Build Docker image in two stages, reducing the final image size.
• LDES EventStreamTarget properties are now all optional.

Fixed

• Don't close output streams that don't need closing.
• Add url decoders to file paths so special characters and spaces work.
• Test cases: add array initializers to avoid bugs.

v6.2.2

Fixed

• Fixed self-joins with join conditions (internal issue #199)
• Upgrade to rdfhdt to 3.0.10 (issue #215)
• Improve docs on deduplication (issue #214)
• Handle plain old Java Arrays as well for FnO return values
• Update dependency to idlab-functions-java, fixing issue #218

Changed

• Dockefile: switched to Eclipse OpenJDK Docker base image because OpenJDK is deprecated
• CI: dropped GitHub release automation
• CI: verify if token is valid

v6.2.1

Fixed

• Updated idlab-functions-java to v1.0.0

v6.2.0

Fixed

• Updated function-agent-java to v1.1.0
• Updated grel-functions-java to v0.9.1
• Updated idlab-functions-java to v0.3.1
• Updated junit to 5.9.1
• Updated testcontainers to 1.17.6
• Updated logback to 1.4.5
• Updated Saxon-HE to 11.4
• Updated postgresql to 42.5.1
• Detect non existing files early (issue 223)
• Subject of LDES event stream has wrong IRI (internal GitLab issue #253)
• MS SQLServer JDBC driver was only for tests on classpath (internal GitLab issue #255)
• Normalising Double numbers from RDBs went wrong (internal GitLab issue #256, GitHub issue #206)

Changed

• tree:view and ldes:retentionPolicy are omitted when generating LDES metadata.

Added

• A new Maven profile no-buildnumber disables using and updating buildNumber.properties.
• Mocked DBpedia Spotlight service (issue #250)
• Update dynamic-loading in README.md

v6.1.3

Fixed

• Reraise execeptions from executor, so that CLI exits with non-zero exit code in the event of errors in execution (issue 194)

v6.1.2

Changed

• Require Java 11+
• Port all tests to Junit 5
• Database tests are executed with a fresh instance of the required database in a Docker container
• Update of function libraries IDLab functions, GREL functions, Function Agent
• Removed need for (deprecated) SecurityManager

Fixed

• Dropped dependency on Guava
• Dropped explicit dependency on Jetty
• Dropped dependency on mariaDB4j
• RDF4JStore had wrong regex to check for Literals when they have a language tag or data type.
• Updated RDF4J to 4.2.1
• Updated Jena to 4.6.1
• Updated indirect dependencies to Xerces 2.12.2
• Updated mysql-connector-java to 8.0.31
• Updated postgresql to 42.5.0
• Updated mssql-jdbc to 11.2.1.jre11
• Updated com.fasterxml.jackson.core.* dependencies to 2.14.0
• Updated jsoup to 1.15.3
• Updated opencsv to 5.7.1
• Updated poi-ooxml to 5.2.3
• Updated testcontainers to 1.17.5
• Updated mybatis to 3.5.11
• Updated ojdbc8 21.6.0.0.1 to ojdbc11 21.7.0.0
• Force Wiremock to use commons-fileupload 1.4
• Main: Output paths can again be fully relative
• Dropped dependency on com.spotify.docker-client (issue 231)
• Running multiple pipelines should no longer interfere with each other (issue 245)
• NamedNodeGenerator now checks if the given IRI is valid (issue 249)

Added

• pom.xml: Added Testcontainers library dependencies for databases we test on
• pom.xml: Added JUnit5 dependencies
• Check for changelog changes in a separate lint stage during CI.

v6.0.0

Changed

• Run all tests in parallel on CI infrastructure
• Upgrade Function Agent to v0.1.0

Fixed

• Upgrade postgresql JDBC driver to 42.3.3
• Rename logback.xml to logback-test.xml in test resources (see issue 240)
• If exception occurs while mapping data, already processed data gets written to output file
• Properly close resources such as input streams
• Github release notes are now properly extracted
• Discard UTF Byte-Order-Marks (BOM) (see issue 171)
• Dropped lib directory for functions as we now use a separate FnO Function Agent

Added

• Add support for WoT OAuth2 Security Scheme (see issue 212)
• IDLabFunctions: added functions lookup and lookupWithDelimiter
• IDLabFunctionsTest: added unit tests for lookup functions
• IDLabFunctionsTest: relocate csv files used by tests for lookup function
• IDLabFunctions: silence stack trace
• CSVW: filter out rows with a comment prefix
• Output file path now gets checked before the mapping
• .gitignore: ignore vscode files
• pom.xml: add Saxon-HE v11.3 dependency
• XMLRecord: adjusted to use Saxon
• XMLRecordFactory: adjusted to use Saxon
• SaxNamespaceResolver: added class for resolving namespaces in Saxon. This fixes (#154)[https://github.com//issues/154].
• Added unit tests for XPath 2/3 expressions and functions
• Loggers across the codebase have been updated to use parameterized strings
• Add support for WoT OAuth2 Security Scheme (see issue 212)
• Integration of independent function handler

v5.0.0

⚠️ ⚠️ ⚠️

This is the last release supporting the old execute() method in the Executor!
The current executeV5() method will become execute() in the next 5.1.X release

⚠️ ⚠️ ⚠️

Added

• Add support for LDES Logical Target
• Add support for generating unique reproducible IRIs for LDES
• TestCore: enable debug logs when VERBOSE env variable is set (see issue 230)

Changed

• Write LDES state to disk when mapping execution is complete.
• Upgrade postgresql JDBC driver to 42.3.2 (see issue 146)
• Switched to fork of ODFtoolkit (see issue 237)

Fixed

• Clarified Readme for quick start
• No cartesian product when referring to the same logical source (see issue 28])
  • If you still want the cartesian product, update your mappings to refer to different logical sources with the same contents
• Upgraded jetty-server and jetty-security to 9.4.44.v20210927
• Upgraded wiremock-jre8 to 2.32.0
• Upgraded ch.qos.logback to 1.2.10
• Upgraded commons-cli to 1.5.0
• Upgraded com.jayway.jsonpath to 2.7.0
• Upgraded ch.vorburger.mariaDB4j to 2.5.3
• Upgraded com.microsoft.sqlserver to 10.2.0.jre8
• Upgraded com.fasterxml.jackson.core to 2.13.1
• Upgraded org.jsoup to 1.14.3
• Upgraded org.apache.poi to 5.0.0
• Resources: functions_grel: use xsd:integer (see issue 234)
• Print error if referenceformulation is unsupported

v4.15.0

Fixed

• Bump buildnumber during release (see issue 227)
• Always include xml: prefix (see issue 144)
• normalizeDate function uses wrong pattern (see issue 228)
• CI: only publish -all.jar releases on Github (see issue 145)
• CI: make use of templates

Changed

• CSVRecordFactory: Replace Apache CSV library with OpenCSV to be able to differentiate between empty string and null (see issue 140)
• CI: use Gitlab's own mirror feature instead of mirroring in a CI job.
• CI: enforce CHANGELOG updates.
• Added functions to normalize dates and datetimes.

Added

• JSONRecordFactory: support JSONL files (see issue 221).