0.7.9

What's Changed

• align dep versions for fs2, guava and djl by @shuttie in #1307
• Expose redis train store TTL to config by @shuttie in #1308

Dependencies

• Update sbt to 1.10.0 by @scala-steward in #1306
• Update log4cats-core, log4cats-slf4j to 2.7.0 by @scala-steward in #1305
• Update scala-library to 2.13.14 by @scala-steward in #1304
• Update guava to 33.2.0-jre by @scala-steward in #1303
• Update circe-core, circe-generic, ... to 0.14.7 by @scala-steward in #1301
• Update logback-classic to 1.5.6 by @scala-steward in #1298
• Update jcl-over-slf4j to 2.0.13 by @scala-steward in #1297
• Update onnxruntime to 1.17.3 by @scala-steward in #1295
• Update sentry-logback to 7.8.0 by @scala-steward in #1294
• Update pulsar-client, pulsar-client-admin to 3.2.2 by @scala-steward in #1290
• Update scalafmt-core to 3.8.1 by @scala-steward in #1287
• Update tokenizers to 0.27.0 by @scala-steward in #1285
• Update api to 0.27.0 by @scala-steward in #1284
• Update rocksdbjni to 9.0.1 by @scala-steward in #1299
• Update commons-io to 2.16.1 by @scala-steward in #1293

Full Changelog: 0.7.8...0.7.9

0.7.8

Bugfixes

• fix slash and semicolon field value crashes by @shuttie in #1280
• add retry in case of broken iterator for kinesis by @shuttie in #1283

What's Changed

• add jvm21 and mac-m1 to CI by @shuttie in #1274
• ci: bump redis to 7.2.4 by @shuttie in #1277
• ci: bump localstack to 3.2.0 by @shuttie in #1276
• bump kinesis-mock to 0.4.6 by @shuttie in #1275
• Update rocksdbjni to 9.0.0 by @scala-steward in #1278
• update http4s to 1.0.0-m41 by @shuttie in #1281

Full Changelog: 0.7.7...0.7.8

0.7.7

Bugfixes

• fix native memleak in model cache by @shuttie in #1259
• add guards for closed booster by @shuttie in #1266
• fix CI for redis 7.2+ due to client|setinfo being blocked by @shuttie in #1267

Docs

• • warmup reference by @vgoloviznin in #1236

Other

• Update docs by @vgoloviznin in #1221
• Docs update by @vgoloviznin in #1235
• Doc update by @vgoloviznin in #1237
• Update lucene-analysis-common, ... to 9.9.2 by @scala-steward in #1240
• Update scalafmt-core to 3.8.0 by @scala-steward in #1244
• Update scalatest to 3.2.18 by @scala-steward in #1245
• Update jcl-over-slf4j to 2.0.12 by @scala-steward in #1246
• Update sbt to 1.9.9 by @scala-steward in #1249
• Update rocksdbjni to 8.10.2 by @scala-steward in #1250
• Update kafka-clients to 3.7.0 by @scala-steward in #1252
• Update scala-library to 2.13.13 by @scala-steward in #1253
• Update sentry-logback to 7.5.0 by @scala-steward in #1256
• Update logback-classic to 1.5.3 by @scala-steward in #1258
• Update pulsar-client, pulsar-client-admin to 3.2.0 by @scala-steward in #1243
• Update kinesis, s3 to 2.23.21 by @scala-steward in #1247
• Update pulsar-client, pulsar-client-admin to 3.2.1 by @scala-steward in #1265
• Update sentry-logback to 7.6.0 by @scala-steward in #1264
• Update s3 to 2.25.3 by @scala-steward in #1263
• Update cats-effect to 3.5.4 by @scala-steward in #1262
• Update rocksdbjni to 8.11.3 by @scala-steward in #1261
• Update lucene-analysis-common, ... to 9.10.0 by @scala-steward in #1260
• Update kinesis to 2.25.15 by @scala-steward in #1273
• Update lettuce-core to 6.3.2.RELEASE by @scala-steward in #1271
• Update guava to 33.1.0-jre by @scala-steward in #1270
• Update sbt-assembly to 2.2.0 by @scala-steward in #1269
• Update onnxruntime to 1.17.1 by @scala-steward in #1251
• Update scallop to 5.1.0 by @scala-steward in #1272

Full Changelog: 0.7.6...0.7.7

0.7.6

Major changes

• support query+item scoped rates by @shuttie in #1227
• support custom eval metric names by @shuttie in #1230
• API Warmup support by @shuttie in #1233
• GCP Memstore redis: add extra toggle to disable CLIENT TRACKING cache invalidation by @shuttie in #1231

What's Changed

• clamp xgboost weights to 31 by @shuttie in #1223
• Update rocksdbjni to 8.10.0 by @scala-steward in #1224
• doc: remove relative_number as superceded by regular number by @shuttie in #1228
• do not allow to use reserved feature names used by rocksdb backend by @shuttie in #1229
• fix match error on analytics payload with unknown feature type by @shuttie in #1232

Full Changelog: 0.7.5...0.7.6

0.7.5

Major changes

• Unbiased LTR support for XGBoost/LightGBM by @shuttie in #1214
• speed-up the NDCG calculation on eval by @shuttie in #1215
• document a train-test splitting strategy by @shuttie in #1216

Bugfixes

• fix validate crash on clicks on non-existent ranking by @shuttie in #1192

Dependencies

• Update logback-classic to 1.4.13 by @scala-steward in #1189
• Update logback-classic to 1.4.14 by @scala-steward in #1193
• Update kinesis to 2.21.42 by @scala-steward in #1199
• Update kinesis, s3 to 2.21.46 by @scala-steward in #1212
• Update jcl-over-slf4j to 2.0.11 by @scala-steward in #1211
• Update rocksdbjni to 8.9.1 by @scala-steward in #1209
• Update pulsar-client, pulsar-client-admin to 3.1.2 by @scala-steward in #1207
• Update sentry-logback to 7.2.0 by @scala-steward in #1205
• Update lettuce-core to 6.3.1.RELEASE by @scala-steward in #1204
• Update tokenizers to 0.26.0 by @scala-steward in #1201
• Update kafka-clients to 3.6.1 by @scala-steward in #1196
• Update commons-io to 2.15.1 by @scala-steward in #1194
• Update sbt to 1.9.8 by @scala-steward in #1210
• Update hnswlib-core to 1.1.2 by @scala-steward in #1202
• Update lucene-analysis-common, ... to 9.9.1 by @scala-steward in #1206
• Update api to 0.26.0 by @scala-steward in #1200
• Update guava to 33.0.0-jre by @scala-steward in #1203
• Update s3 to 2.23.3 by @scala-steward in #1213
• migrate to http4s ember backend by @shuttie in #1217
• uap-parser and circe-yaml upgrade by @shuttie in #1218
• Update mapdb to 3.1.0 by @shuttie in #1219
• update http4s to M40 by @shuttie in #1220

Full Changelog: 0.7.4...0.7.5

0.7.4

Major changes

• fix crash in divers feature when data is yet missing in redis by @shuttie in #1172
• rocksdb state store impl by @shuttie in #1180
• add support for custom loggers by @shuttie in #1183
• add check for data=out on sort by @shuttie in #1185
• fix file backend options are not used in init, trigger a rocksdb compaction on end by @shuttie in #1184
• add check for termfreq command that out file does not exist by @shuttie in #1186

Dependencies

• Update s3 to 2.21.25 by @scala-steward in #1168
• Update lettuce-core to 6.2.7.RELEASE by @scala-steward in #1166
• Update sentry-logback to 6.34.0 by @scala-steward in #1176
• Update lettuce-core to 6.3.0.RELEASE by @scala-steward in #1175
• Update onnxruntime to 1.16.3 by @scala-steward in #1174
• Update sbt-assembly to 2.1.5 by @scala-steward in #1173

Full Changelog: 0.7.3...0.7.4

0.7.3

What's Changed

• fix: Metarank gets killed (oomkiller): not closed outputstream in binary format with compress enabled by @tomsquest in #1150

Dependencies

• Doc update by @vgoloviznin in #1036
• Doc update by @vgoloviznin in #1068
• Update kinesis, s3 to 2.20.142 by @scala-steward in #1119
• Update scalafmt-core to 3.7.14 by @scala-steward in #1118
• Update sbt-scalafmt to 2.5.2 by @scala-steward in #1117
• Update sentry-logback to 6.29.0 by @scala-steward in #1116
• Update rocksdbjni to 8.3.3 by @scala-steward in #1122
• Update scala-library to 2.13.12 by @scala-steward in #1123
• Update scalatest to 3.2.17 by @scala-steward in #1124
• Update s3 to 2.20.145 by @scala-steward in #1125
• Update cross-encoders.md by @vgoloviznin in #1132
• Stabledoc by @vgoloviznin in #1133
• Update sbt-assembly to 2.1.3 by @scala-steward in #1127
• Update onnxruntime to 1.16.0 by @scala-steward in #1128
• Update sbt to 1.9.6 by @scala-steward in #1130
• Update api to 0.24.0 by @scala-steward in #1134
• Update commons-io to 2.14.0 by @scala-steward in #1136
• Update sentry-logback to 6.30.0 by @scala-steward in #1137
• Update kafka-clients to 3.6.0 by @scala-steward in #1138
• Update lucene-analysis-common, ... to 9.8.0 by @scala-steward in #1139
• Update rocksdbjni to 8.5.4 by @scala-steward in #1140
• Update kinesis to 2.20.162 by @scala-steward in #1143
• Update cats-effect to 3.5.2 by @scala-steward in #1141
• Update tokenizers to 0.24.0 by @scala-steward in #1135
• Update sbt-assembly to 2.1.4 by @scala-steward in #1155
• Update scalafmt-core to 3.7.15 by @scala-steward in #1154
• Update sbt to 1.9.7 by @scala-steward in #1153
• Update pulsar-client, pulsar-client-admin to 3.1.1 by @scala-steward in #1152
• Update commons-io to 2.15.0 by @scala-steward in #1151
• Update onnxruntime to 1.16.1 by @scala-steward in #1147
• Update s3 to 2.21.2 by @scala-steward in #1149
• Update sentry-logback to 6.32.0 by @scala-steward in #1148
• Update api to 0.25.0 by @scala-steward in #1156
• Update guava to 32.1.3-jre by @scala-steward in #1146
• Update tokenizers to 0.25.0 by @scala-steward in #1157
• Update scallop to 5.0.1 by @scala-steward in #1160
• Update sentry-logback to 6.33.1 by @scala-steward in #1161
• Update kinesis to 2.21.17 by @scala-steward in #1162
• Update rocksdbjni to 8.6.7 by @scala-steward in #1163
• Update onnxruntime to 1.16.2 by @scala-steward in #1164
• Update scalafmt-core to 3.7.16 by @scala-steward in #1165

Full Changelog: 0.7.2...0.7.3

0.7.2

Major changes

• support for Redis TTLs by @shuttie in #1114
• use DJL tokenizers for HF tokenization support by @shuttie in #1112

Fixes

• set default api timeout to 5 minutes by @shuttie in #1113

Docs

• Added inference model overview by @vgoloviznin in #1039
• Fix/api doc update by @vgoloviznin in #1035
• doc: add note on db config for redis by @shuttie in #1115

Dependencies

• Update onnxruntime to 1.15.0 by @scala-steward in #1040
• Update commons-io to 2.12.0 by @scala-steward in #1041
• Update lucene-analysis-common, ... to 9.6.0 by @scala-steward in #1043
• Update sbt to 1.8.3 by @scala-steward in #1045
• Update scalatest to 3.2.16 by @scala-steward in #1046
• Update cats-effect to 3.4.11 by @scala-steward in #1049
• Update sentry-logback to 6.21.0 by @scala-steward in #1052
• Update scalafmt-core to 3.7.4 by @scala-steward in #1053
• Fix/api doc update by @vgoloviznin in #1067
• dependency updates by @shuttie in #1111

Full Changelog: 0.7.1...0.7.2

0.7.1

Important changes

• Embedding API by @shuttie in #1016
• Dont compute unused features by @shuttie in #1031

Bugfixes

• unbreak e2e tests for kafka by @shuttie in #1018
• create dir when not-exists for mapdb by @shuttie in #1019
• use ubuntu mirror for ci by @shuttie in #1020
• fix crash on scalar codec with long numeric lists by @shuttie in #1021
• fix flaky FileFreqEstimatorTest by @shuttie in #1022
• file cts should accept only bin files by @shuttie in #1023
• fix crash on reopening existing file state db by @shuttie in #1024
• add took field to all api responses by @shuttie in #1025
• expose all bi/cross encoder features in the /inference endpoint by default by @shuttie in #1026
• make lm.backend and lm.weights optional by @shuttie in #1027
• implement file-based model store by @shuttie in #1028
• expose /inference api by @shuttie in #1029
• unbreak mpnet onnx inference by @shuttie in #1030
• ignore missing cache files by @shuttie in #1032
• TermFreqDict gzipped file loading by @shuttie in #1033
• add warning for single cts dataset by @shuttie in #1034

Dependencies

• Update pulsar-client, pulsar-client-admin to 2.11.1 by @scala-steward in #1007
• Update api to 0.22.0 by @scala-steward in #1003
• Update rocksdbjni to 8.1.1.1 by @scala-steward in #1015
• Update s3 to 2.20.48 by @scala-steward in #1008
• Update logback-classic to 1.4.7 by @scala-steward in #1010
• Update api to 0.22.1 by @scala-steward in #1009
• Update sentry-logback to 6.18.1 by @scala-steward in #1013
• Update cats-effect to 3.4.10 by @scala-steward in #1014

Full Changelog: 0.7.0...0.7.1

0.7.0

New features

• Semantic content recommendations by @shuttie in #969
• Qdrant support for recommendations vector knn search by @shuttie in #971
• Bi-encoder feature extractor by @shuttie in #981
• explicit relevance judgments support by @shuttie in #983
• BM25 field matching support by @shuttie in #987
• Cross-encoder support by @shuttie in #1002

Minor changes

• Docs update by @vgoloviznin in #853
• Doc update by @vgoloviznin in #855
• Fix link by @vgoloviznin in #857
• New release by @vgoloviznin in #862
• Fixes #963 by @vgoloviznin in #964
• Doc update by @vgoloviznin in #965
• Fixes for api doc by @vgoloviznin in #972
• trim to top-N items for diversity extractor by @shuttie in #979
• fix utf8 handling when run in docker by @shuttie in #980
• merge biencoder and field_match by @shuttie in #982
• fix(doc): typo in cli.md by @tomsquest in #986
• onnx embedding support for field_match by @shuttie in #989
• use PrintProgress for autofeature status line by @shuttie in #991
• Fix autofeature on explicit judgements by @shuttie in #992
• add field split strategy by @shuttie in #993
• fix native memory leak in ONNX inference by @shuttie in #994
• fix crash on analytics payload generation for biencoder schema by @shuttie in #995
• emit user/info train events only when needed by @shuttie in #996
• BM25 should count doc freq, not field freq by @shuttie in #997
• Caching support for embeddings by @shuttie in #998
• show progress for embedding cache loading by @shuttie in #1001
• support RFC4180 CSV double-quotes by @shuttie in #1000

Dependencies

• Update kinesis, s3 to 2.20.21 by @scala-steward in #967
• scalafmt 3.7.3 by @shuttie in #999
• Update sentry-logback to 6.17.0 by @scala-steward in #990
• Update rocksdbjni to 8.0.0 by @scala-steward in #985
• less frequent dep update for aws-sdk by @shuttie in #975
• Update s3 to 2.20.27 by @scala-steward in #978
• Update jcl-over-slf4j to 2.0.7 by @scala-steward in #977
• Update sentry-logback to 6.16.0 by @scala-steward in #976
• Update logback-classic to 1.4.6 by @scala-steward in #973

New Contributors

• @tomsquest made their first contribution in #986

Full Changelog: 0.6.4...0.7.0