Skip to content

Latest commit

 

History

History
110 lines (77 loc) · 4.06 KB

CHANGELOG.md

File metadata and controls

110 lines (77 loc) · 4.06 KB
Raw

Changelog

v0.5.1 (2023-02-17)

Bug Fixes

  • Fixed incorrect results from group normalization

v0.5.0 (2023-02-16)

Enhancements

  • Bump Nx dependency
  • Update documentation to account for channels last default
  • Improve error message in compilation/build errors for models
  • Remove deprecated transform

Deprecations

  • Deprecate Axon.Loop.handle/4

v0.4.1 (2023-01-21)

Bug Fixes

  • Fixed a shape mismatch when training with certain optimizers

v0.4.0 (2023-01-19)

Enhancements

  • Add Axon.pop_nodes/2 for popping nodes off of a graph
  • Update Axon.freeze/2 and Axon.unfreeze/2 for manipulating frozen portions of Axon graph
  • Add Axon.Loop.monitor/5 for firing events based on loop state criteria
  • Add Axon.Loop.kino_vega_lite_plot/4 for producing Kino plots during training
  • Add Axon.Schedules.linear_decay/1
  • Performance boosts to Axon.Loop which prevent compilation cache misses in most Axon training and evaluation loops
  • Add global event counts for more correct filtering during Axon loops
  • Use layer state to manage dropout keys, making training more deterministic when starting from the same key
  • Make building Axon models fully deterministic
  • Add a bidirectional combinator

Bug Fixes

  • Fix issue with namespaced stateful models not updating correctly during training
  • Fix bug in Axon.Loop.early_stop/3 which incorrectly tracked progress and would not early stop loop
  • Fix bug in Axon.Loop.reduce_lr_on_plateau/3 which incorrectly tracked progress and would not reduce learning rate
  • Fix bug in Axon.Layers.conv_transpose/4 when using channels last

v0.3.1 (2022-12-07)

Enhancements

  • Relax Kino dependency

v0.3.0 (2022-10-27)

Enhancements

  • Add filters and events to validation loop event handler
  • Add Axon.Losses.cosine_similarity/2
  • Add Axon.Activations.log_sumexp/2
  • Add mermaid rendering with Axon.Display.as_graph/2
  • Add a number of guides to documentation
  • Use stateless RNGs for initialization and dropout layers
  • Include stacktraces in compilation errors to improve error messages
  • Update Axon data structure to reduce size of copies
  • Change channels default to last for performance reasons
  • Add initial implementation of Loss scaling to Axon API

Bug fixes

  • Fix issue with Axon.get_output_shape/2 returning container shapes
  • Fix implementation bugs with Axon.group_norm/3
  • Fix issue with Axon.Loop.from_state/2 not allowing resumption of loops from states
  • Fix issue with validation loop not populating metrics correctly

v0.2.0 (2022-08-13)

Enhancements

  • Add support for optional inputs
  • Add support for non-finite float metrics
  • Add support for containers as inputs
  • Allow custom activation functions in Axon.activation
  • Add utilities for debugging model execution
  • Add graph manipulation API
  • Add lazy model compilation in the form of Axon.build and Axon.compile. Lazy model compilation removes eager shape calculations in favor of forcing initialization functions to accept an input template. This allows the creation of more complex models without needing to know complex shape logic
  • Add top_k_categorical_accuracy metric
  • Update default model inspection
  • Add Axon.Display.as_table/2
  • Add support for stateful learning rate in optimizers
  • Add Axon.Loop.reduce_lr_on_plateau event handler
  • Update RNN output format to mirror Elixir's convention

Bug Fixes

  • Fix bug in Axon.resize methods. Methods other than nearest produced invalid results
  • Fix bug with feature_group_size in Axon.conv. Axon.conv parameters did not appropriately initialize according to specified feature_group_size
  • Fix bug in layer name serialization. Axon.serialize did not appropriately freeze names when serializing, which results in deserialization failures when the model is deserialized outside the same process that serialized it

Deprecations

  • Deprecate Axon.input/3
  • Deprecate Axon.init/4
  • Deprecate Axon.Recurrent

v0.1.0 (2022-06-16)

First release.