0.6 API Updates - Mandatory notNull flag in field schemas

[martin-traverse]

notNull was added to field schemas as an optional flag during the 0.5 series. If it is omitted, the default behaviour is to respect the businessKey flag.

For 0.6 notNull will become mandatory, so if businessKey = true then you must also set notNull = true. The change needs to be made in the .proto file for schema definitions, and in the schema validator in the validation library. We could also modify the ArrowSchema class that converts schemas between TRAC / Arrow formats, although this is not essential and leaving the existing logic may improve compatability with 0.5 metadata.

This change does not impact the model API, which will still set a default value for notNull if it is not provided.

[martin-traverse]

This change has been de-scoped for the 0.6 release series, to avoid breaking changes in the platform API at the current time. However, it still needs to be addressed before the 1.0 release.