v0.9.0

Notable Changes

• 🕵️ Auto runtime detection: AIKit will now automatically check your CPU and GPU capabilities, and automatically choose the most optimized runtime. With this change, there is no differentiation for runtimes avx, avx2, and avx512. They can still be used to skip installing the cuda runtime libraries for slimmer images.
• 💿 Pre-made models will now include CUDA libraries by default, and CUDA specific images will not be updated anymore. Thanks to auto runtime detection if a compatible GPU is not found, it will fallback to the most optimized CPU runtime.
• ⎈ Helm chart for Kubernetes is now available!
• 🚀 New pre-made models are now available: Gemma 1.1 2B Instruct and Codestral 22B.
• ✨ Updated LocalAI to v2.16.0.
• 🦥 Updated Unsloth to May 2024 release.

Features

• add phi3 model (#210) #210 (Sertaç Özercan)
• helm chart (#240) #240 (Sertaç Özercan)
• add codestral (#253) #253 (Sertaç Özercan)

Bug Fixes

• allow list api.scorecard.dev (#229) #229 (Sertaç Özercan)
• gpu detect (#238) #238 (Sertaç Özercan)
• release pr workflow (#243) #243 (Sertaç Özercan)
• chart appversion (#245) #245 (Sertaç Özercan)

Documentation

• doc deprecated models (#212) #212 (Sertaç Özercan)
• fix new row in table (#215) #215 (Sertaç Özercan)
• add model name (#217) #217 (Sertaç Özercan)
• new logo (#218) #218 (Sertaç Özercan)
• update helm chart (#247) #247 (Sertaç Özercan)
• helm chart (#248) #248 (Sertaç Özercan)
• update llama.cpp (#252) #252 (Sertaç Özercan)

Continuous Integration

• allow helm.sh for release (#258) #258 (Sertaç Özercan)

Chores

• deps: Bump golang from b03f3ba to d0902ba (#221) #221 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.15 to 1.7.16 (#222) #222 (dependabot[bot])
• deps: Bump the actions-all group with 5 updates (#224) #224 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.13.1 to 0.13.2 (#223) #223 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#226) #226 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#228) #228 (dependabot[bot])
• deps: Bump golang from d0902ba to 6d71b7c (#227) #227 (dependabot[bot])
• deps: Bump golang from 6d71b7c to 5c56bd4 (#233) #233 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.63.2 to 1.64.0 (#231) #231 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#230) #230 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.16 to 1.7.17 (#232) #232 (dependabot[bot])
• update to localai v2.16.0 (#225) #225 (Sertaç Özercan)
• remove runtime (#237) #237 (Sertaç Özercan)
• update unsloth to may 2024 release (#239) #239 (Sertaç Özercan)
• add gemma 1.1 model (#149) #149 (Sertaç Özercan)
• deps: Bump the actions-all group with 4 updates (#251) #251 (dependabot[bot])
• Prepare v0.9.0 release (#254) #256,#254 (github-actions[bot])

Reverts

• runtime removal (#249) #249 (Sertaç Özercan)

v0.8.0

Notable Changes

• 🦙🦙🦙 LLama 3 fine tune support!
• 🦙🦙🦙 Llama 3 pre-made models are now available!

Features

• llama3 8b instruct pre-made model (#197) #197 (Sertaç Özercan)
• llama3 70b pre-built models (#200) #200 (Sertaç Özercan)
• finetune llama3 support (#207) #207 (Sertaç Özercan)

Documentation

• release process (#192) #192 (Sertaç Özercan)
• fix release (#193) #193 (Sertaç Özercan)
• update readme and quickstart with llama3 (#198) #198 (Sertaç Özercan)

Tests

• update gpu test for llama3 (#204) #204 (Sertaç Özercan)
• update gpu test for llama3 (#205) #205 (Sertaç Özercan)
• update gpu test for llama3 (#206) #206 (Sertaç Özercan)

Continuous Integration

• update self hosted update models (#201) #201 (Sertaç Özercan)
• update models - disable mixtral (#202) #202 (Sertaç Özercan)
• remove gha cache for update-models-self (#203) #203 (Sertaç Özercan)

Chores

• deps: Bump google.golang.org/grpc from 1.63.0 to 1.63.2 (#194) #194 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#195) #195 (dependabot[bot])
• deps: Bump golang from 48b942a to b03f3ba (#196) #196 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#208) #208 (dependabot[bot])

v0.7.2

Bug Fixes

• address GO-2024-2687 (#191) #191 (Sertaç Özercan)

Documentation

• update readme and website (#171) #171 (Sertaç Özercan)
• k8s finetune build (#175) #175 (Sertaç Özercan)
• finetune update (#176) #176 (Sertaç Özercan)
• add finetune demo (#177) #177 (Sertaç Özercan)
• add finetune demo (#178) #178 (Sertaç Özercan)
• add announcement bar to website (#179) #179 (Sertaç Özercan)

Chores

• deps: Bump golang from 6699d28 to d996c64 (#172) #172 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.13 to 1.7.14 (#173) #173 (dependabot[bot])
• deps: Bump the actions-all group with 5 updates (#174) #174 (dependabot[bot])
• deps: Bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /website (#180) #180 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#182) #182 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.13.0 to 0.13.1 (#183) #183 (dependabot[bot])
• deps: Bump express from 4.18.2 to 4.19.2 in /website (#184) #184 (dependabot[bot])
• deps: Bump the actions-all group with 1 update (#185) #185 (dependabot[bot])
• deps: Bump golang from d996c64 to 48b942a (#186) #186 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.14 to 1.7.15 (#189) #189 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.62.1 to 1.63.0 (#188) #188 (dependabot[bot])
• deps: Bump github/codeql-action from 3.24.9 to 3.24.10 in the actions-all group (#187) #187 (dependabot[bot])
• bump localai v2.12.3 (#190) #190 (Sertaç Özercan)

v0.7.1

Notable Changes

• 🎵 Fine Tuning support!
• 📂 Ability to use local files for creating model images for inference

Demo of fine-tuning and inference using fine-tuned model: https://www.youtube.com/watch?v=FZuVb-9i-94

Features

• add finetuning support (#162) #162 (Sertaç Özercan)

Bug Fixes

• debug and config space (#154) #154 (Sertaç Özercan)

Continuous Integration

• add retry to trivy (#150) #150 (Sertaç Özercan)
• finetune test (#151) #151 (Sertaç Özercan)
• don't fail on prune (#165) #165 (Sertaç Özercan)
• fix release ldflags (#168) #168 (Sertaç Özercan)
• fix release ldflags (#169) #169 (Sertaç Özercan)
• prerelease enable push (#170) #170 (Sertaç Özercan)

Chores

• deps: Bump the actions-all group with 5 updates (#152) #152 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.13.0-rc2 to 0.13.0-rc3 (#153) #153 (dependabot[bot])
• deps: Bump golang from 925fe3f to 6699d28 (#159) #159 (dependabot[bot])
• deps: Bump the actions-all group with 1 update (#158) #158 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.13.0-rc3 to 0.13.0 (#157) #157 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.62.0 to 1.62.1 (#156) #156 (dependabot[bot])
• deps: Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#161) #161 (dependabot[bot])
• deps: Bump follow-redirects from 1.15.5 to 1.15.6 in /website (#164) #164 (dependabot[bot])
• update localai to v2.10.0 (#163) #163 (Sertaç Özercan)

Documentation

• update readme (#166) #166 (Sertaç Özercan)
• fix readme links (#167) #167 (Sertaç Özercan)

v0.7.0

⚠️ This release is missing important metadata information. Please use v0.7.1 instead.

v0.6.2

Notable Changes

• 🆕 Update to LocalAI v2.9.0

Continuous Integration

• update egress policy (#137) #137 (Sertaç Özercan)
• update egress for hf (#138) #138 (Sertaç Özercan)
• update egress for deb (#139) #139 (Sertaç Özercan)

Chores

• deps: Bump the actions-all group with 3 updates (#135) #135 (dependabot[bot])
• deps: Bump golang from 53048e8 to 874c267 (#136) #136 (dependabot[bot])
• update localai v2.8.2 (#140) #140 (Sertaç Özercan)
• bump buildkit 0.13 rc1 (#141) #141 (Sertaç Özercan)
• deps: Bump the actions-all group with 2 updates (#143) #143 (dependabot[bot])
• deps: Bump golang from 874c267 to 925fe3f (#142) #142 (dependabot[bot])
• update localai v2.9.0 (#145) #145 (Sertaç Özercan)
• deps: Bump github.com/moby/buildkit from 0.13.0-rc1 to 0.13.0-rc2 (#147) #147 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.61.1 to 1.62.0 (#146) #146 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#148) #148 (dependabot[bot])

v0.6.1

Notable Changes

• 🆕 Update to LocalAI v2.8.0

Documentation

• update misc (#125) #125 (Sertaç Özercan)

Continuous Integration

• fix copa patch conditionals (#118) #118 (Sertaç Özercan)
• set egress policy (#119) #119 (Sertaç Özercan)
• fix copa patched tag (#133) #133 (Sertaç Özercan)
• use trivy binary for patch images (#134) #134 (Sertaç Özercan)

Chores

• deps: Bump google.golang.org/grpc from 1.60.1 to 1.61.0 (#122) #122 (dependabot[bot])
• deps: Bump golang from adf7ccb to 47fa179 (#120) #120 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#121) #121 (dependabot[bot])
• deps: Bump the go_modules group across 1 directories with 1 update (#128) #128 (dependabot[bot])
• deps: Bump golang from 47fa179 to c62751a (#129) #129 (dependabot[bot])
• deps: Bump github.com/containerd/containerd from 1.7.12 to 1.7.13 (#131) #131 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#130) #130 (dependabot[bot])
• update localai v2.8.0 (#132) #132 (Sertaç Özercan)

v0.6.0

Notable Changes

• 🐍 Support for mamba backend
• 🆕 Update to LocalAI v2.6.1
• 🕸️ Documentation website: https://sozercan.github.io/aikit/

What's Changed

• [StepSecurity] ci: Harden GitHub Actions by @step-security-bot in #97
• chore(deps): Bump golang from 6ac4c35 to adf7ccb by @dependabot in #98
• chore: update localai v2.6.0 by @sozercan in #99
• ci: add gh release action by @sozercan in #100
• ci: group github actions for dependabot by @sozercan in #107
• chore(deps): Bump the actions-all group with 5 updates by @dependabot in #108
• chore(deps): Bump github.com/opencontainers/image-spec from 1.1.0-rc5 to 1.1.0-rc.6 by @dependabot in #106
• chore: update localai v2.6.1 by @sozercan in #110
• feat: add mamba backend by @sozercan in #109
• chore: move docs to website by @sozercan in #111
• docs: reenable docs deploy by @sozercan in #112
• docs: add categories by @sozercan in #113
• ci: ignore website by @sozercan in #114
• docs: misc updates by @sozercan in #115
• docs: misc updates by @sozercan in #116
• docs: fix edit link by @sozercan in #117

Full Changelog: v0.5.2...v0.6.0

v0.5.2

Notable Changes

• 🅿️ Added Phi 2 to pre-made models

What's Changed

• docs: update readme with table by @sozercan in #82
• chore(deps): Bump golang from 836698d to 6ac4c35 by @dependabot in #83
• test: add gpu test by @sozercan in #84
• test: add gpu agent by @sozercan in #85
• chore(deps): Bump actions/upload-artifact from 4.0.0 to 4.1.0 by @dependabot in #87
• chore(deps): Bump github/codeql-action from 3.22.12 to 3.23.0 by @dependabot in #86
• chore(deps): Bump github.com/containerd/containerd from 1.7.11 to 1.7.12 by @dependabot in #88
• test: update gpu test by @sozercan in #89
• ci: change gpu test to matrix by @sozercan in #90
• ci: patch model images by @sozercan in #91
• ci: update patch models by @sozercan in #92
• ci: fix sd test by @sozercan in #93
• feat: add phi2 model by @sozercan in #95
• docs: add license to readme by @sozercan in #96

Full Changelog: v0.5.1...v0.5.2

v0.5.1

Notable Changes

• ✨ Support for LocalAI v2.5.1

What's Changed

• ci: free space on update-models by @sozercan in #74
• ci: free space on update-models take 2 by @sozercan in #75
• ci: staging registry input for update-models by @sozercan in #76
• ci: doc update-image runner limitation by @sozercan in #77
• chore(deps): Bump actions/dependency-review-action from 3.1.4 to 3.1.5 by @dependabot in #79
• chore(deps): Bump docker/metadata-action from 5.4.0 to 5.5.0 by @dependabot in #78
• chore: update to localai v2.5.1 by @sozercan in #80
• chore(deps): Bump golang from 1e3c713 to 836698d by @dependabot in #81

Full Changelog: v0.5.0...v0.5.1