Changes for 3.5

New in 3.5.1

• Log4j was upgraded to version 2.16.0
• OpenRefine is compatible with Java versions 8 to 17 (#4106)

New features

• Wikidata support has been generalized to arbitrary Wikibase instances. (#1640)
• The cross function now accepts implicit project and column names (#2504)
• The left panel can be collapsed (#1038) and resized (#2771)
• Support for more Wikidata constraints was added (multi-value, difference within range, conflicts with, and citation needed constraints) (#2354)
• Splitting multi-valued cells is now possible by transition between uppercase/lowercase (#2238)
• When importing multiple archive files, importers can store the filename of the archive file each row was extracted from (#1963)
• It is now possible to go to a page of the project table directly (#2638)
• The pagination sizes offered by the UI can now be configured by setting the ui.browsing.pageSize preference to values such as [100,500,1000,2000] (#2624)
• Format detection at the import stage was improved (#2805, #2800)
• The split/join multivalued cells dialogs now remember the last separator used (#2197)
• The forEach GREL function works on JSON objects (#3149)
• A new GREL function wholeText can be used to extract all the text inside an XML element (including in its children) (#3180)
• A dialog to confirm the removal of starred expressions was added (#501)
• HTTP host validation was added (#3288)
• The Wikibase extension can now be used to add BCE dates (#3816)
• The common cell transforms can be run on a selection of columns easily (#1843)
• Greater numbers of rows per page can now be selected (#3249) (after 3.5-beta1)

Incompatible changes

• The behavior of the unescape function has changed in CSV mode. Previously it would not remove the first and last quote characters from a string, due to a bug in the supporting library. Now it correctly removes these quotes. unescape("mystring", "csv") would return "mystring" previously, but now will return mystring.
• The export format for Wikibase dates was adapted to match that of Wikibase itself. For instance, a year precision date was exported as +1883-01-01T00:00:00Z before and is now represented as 1883-00-00T00:00:00Z. Therefore re-uploading statements with dates could potentially create duplicate statements. (#3694)
• The behaviour of the reconciliation operation has changed: cells which could not be reconciled due to a service or network error are simply left unreconciled, instead of being identical to reconciled cells with no candidates (#3369) (after 3.5-beta1)
• Google authentication was fixed (#3991) (after 3.5-beta1)

Bug fixes

• The fields of the form to connect to a SQL database better adapt to the type of database selected (#2615)
• A bug in the way blank and error values are counted in text facets in records mode has been fixed (#2588)
• Unescaped tabs in JSON files no longer result in a truncated import (#1164)
• Plurals in translated UI text are now supported (#2700)
• Encoding issues for the HTML exporter have been fixed (#1197)
• Exporting a project to Google Drive uses the correct content type (#2797)
• Import of dates from ODS files has been fixed (#2224)
• HTTP errors are correctly reported when creating a project from a URL (#2837)
• The form to add a new reconciliation is submitted when pressing Enter (#2905)
• Dates are correctly imported from XLS files (#1908)
• The service panel in the reconciliation dialog closes properly when a service is picked or deleted (#2913, #1658 #3632)
• Format detection was improved (#2850)
• The Import project UI is properly validated before being submitted (#2369)
• The "Back" button in the importer configuration view displays correctly (#2980)
• The number of clustering options displayed in the clustering dialog is capped to make sure they are displayed after a reasonable amount of time (#695)
• GREL function sort works on arrays which contain null values (#3152)
• Removing a reconciliation service no longer selects it for reconciliation (#2910)
• Pressing Enter in the dialog to add a column of entity identifiers from reconciled values submits the form (#3163)
• The GREL uniques function now preserves order (#3235)
• The fingerprint clusterer treats Unicode whitespace as blanks (#3282)
• Error reporting when reconciliation services fail to provide type guesses has been improved (#3173)
• The phonetic GREL function reports incompatible arguments better (#3330)
• Resizing the expression editor now works correctly (#3565)
• Links in GREL function descriptions are now correctly rendered (#3579)
• The positioning of reconciliation previews was fixed (#3028)
• The fetching of proposed properties in the data extension dialog was fixed for services supporting CORS only (#3672)
• The facet panel is shown when a new facet is created (#2891)
• Exporting projects with non-ASCII characters in their name has been fixed (#3724)
• Invalid format constraints on Wikibase properties no longer breaks schemas (#3274)
• Rotation support in the scatterplot facet was fixed (#3344)
• Querying SQLite databases was fixed (#3605) (after 3.5-beta1)
• Clustering dialog now shows duplicate whitespace clearly (#4004) (after 3.5-beta1)
• A bug in the import of Google Sheets was fixed (#3800) (after 3.5-beta1)
• A bug in the "Use values as identifiers" operation was fixed, preventing the same reconciliation object to be assigned to multiple unrelated rows. (#3785) (after 3.5-beta1)
• The deprecated reconciliation service for Wikidata was replaced by a maintained one (#4205) (after 3.5-beta1)
• A useless waiting time before creating a batch of new items on Wikibase was removed (#4226) (after 3.5-beta1)
• A potential vulnerability in the allocation of file names during import was fixed (#3043) (after 3.5-beta1)
• The memory setting for the CLI on Windows and UNIX was fixed to also set the initial heap size (#4265) (after 3.5-beta2)

For developers

• We have switched from using archive utilities from Apache Ant to Apache Commons (#2690)
• We got rid of some unnecessary dependencies (#3957, #2961)