Skip to content

Latest commit

 

History

History
384 lines (249 loc) · 16 KB

CHANGELOG.md

File metadata and controls

384 lines (249 loc) · 16 KB
Raw

NEXT_VERSION_TYPE=MAJOR|MINOR|PATCH

NEXT_VERSION_DESCRIPTION_BEGIN

NEXT_VERSION_DESCRIPTION_END

15.1.0 (17-03-2022)

  • Upgrade dependency versions:
  • org.springframework:spring-jdbc: 5.3.2 -> 5.3.16
  • org.springframework:spring-tx: 5.3.2 -> 5.3.16
  • org.slf4j:slf4j-api:1.7.30 -> 1.7.36

15.0.1 (11-11-2021)

  • db-queue-scheduler library link added into the README.md file

15.0.0 (15-10-2021)

This release brings dynamic configuration of almost all queue settings. There are many breaking changes related to queue configuration.

new features

  • Added method QueueService#updateQueueConfigs. Use this method to change queue settings in runtime.
  • Added class QueueConfigsReloader. Configure this class to track queue properties changes and reload queue configuration in runtime.

breaking changes

  1. Settings in QueueSettings class are moved into several classes:
  • ProcessingSettings - contains threadCount and processingMode
  • PollSettings - contains betweenTaskTimeout, noTaskTimeout and fatalCrashTimeout
  • FailureSettings - containsretryType and retryInterval
  • ReenqueueSettings - renamed from ReenqueueRetrySettings
  • ExtSettings - wrapper for additionalSettings map
  1. Default values are removed from all settings classes. In order to maintain backward compatibility in your code, use next settings:
  • ProcessingSettings - .withProcessingMode(ProcessingMode.SEPARATE_TRANSACTIONS).withThreadCount(1)
  • PollSettings - .withFatalCrashTimeout(Duration.ofSeconds(1))
  • FailureSettings - .withRetryInterval(Duration.ofMinutes(1)).withRetryType(FailRetryType.GEOMETRIC_BACKOFF)
  • ReenqueueSettings - .withRetryType(ReenqueueRetryType.MANUAL).withInitialDelay(Duration.ofSeconds(1L)).withArithmeticStep(Duration.ofSeconds(2L)).withGeometricRatio(2L)

  1. QueueConfigsReader#parse do not accept arguments. Paths to properties must be specified in constructor. Default values are removed from settings classes, so use special constructor which provides default builders for settings classes.

  2. QueueService#resizePool is removed and should be replaced by QueueService#updateQueueConfigs.

14.0.0 (04-10-2021)

breaking changes Changed semantic of QueueService#start. Now it must be called once at start of application to initialize queues. To unpause task processing use QueueService#unpause instead of QueueService#start. new features

  • Added method QueueService#resizePool to dynamically allocate or dispose threads for particular queue.
  • Added method QueueService#unpause and QueueService#unpause(QueueId) to continue tasks processing which have been paused by QueueService#pause method.

13.1.0 (26-08-2021)

  • The repository moved yoomoney-tech -> yoomoney

13.0.1 (04-08-2021)

  • Fix library modules publishing

13.0.0 (30-07-2021)

breaking changes:

  • QueueProducer#enqueue returns EnqueueResult object which contains shard identifier along with sequence id.

new features:

12.1.0 (09-06-2021)

  • Add support of h2 database. Thanks to @izebit.

12.0.0 (28-04-2021)

The library is divided into two modules:

  • db-queue-core - base functionality
  • db-queue-spring - Spring related functionality

Now it is possible to provide various database access implementations on top of db-queue-core module. You can implement a custom DatabaseAccessLayer to achieve this. A default implementation for Spring is called SpringDatabaseAccessLayer and is located in the db-queue-spring module. ru.yoomoney.tech:db-queue artifact still provides the same functionality as it includes ru.yoomoney.tech:db-queue-core and ru.yoomoney.tech:db-queue-spring artifacts.

There are several breaking changes in this release. To migrate to a new version you must do the following changes:

  • Change imports of DAO classes and interfaces to ru.yoomoney.tech.dbqueue.spring.dao
  • Parametrize QueueShard over SpringDatabaseAccessLayer class
  • Construct SpringDatabaseAccessLayer and pass it to QueueShard constructor

11.0.3 (22-04-2021)

  • Added library-project-plugin.

11.0.2 (04-02-2021)

  • Update artifact-release-plugin
  • Disable Oracle tests #10

11.0.1 (02-02-2021)

  • Adjust version

11.0.0 (01-02-2021)

  • Fix links to java classes in README.md
  • Upgrade to Spring Boot 2.4.1
  • Release via ru.yoomoney.gradle.plugins.artifact-release-plugin
  • Rebranding Yandex.Money to YooMoney
  • Changed package names to ru.yoomoney.tech.dbqueue instead of ru.yandex.money.common.dbqueue

8.4.0 (20-05-2020)

  • Oracle support
  • Customization of id field in QueueTableSchema
  • Seconds granularity in task processing time
  • Id generation in QueueDao via separate sequences which can be specified in QueueLocation.Builder.withIdSequence(String) or id-sequence in file config.

8.3.3 (30-04-2020)

8.3.2 (27-02-2020)

  • Don't add bitbucket pull request link into changelog.md on release

8.3.1 (07-02-2020)

  • Rename jenkins job file

8.3.0 (04-02-2020)

8.2.0 (03-02-2020)

  • Update gradle version 4.10.2 -> 6.0.1

8.1.1 (01-12-2019)

  • Generic support added for Task#builder(QueueShardId) method.
  • Changed EnqueueParams#withExtData(Map) method's logic. Now all entries of given map are drained to EnqueueParams#extData field

8.1.0 (14-11-2019)

Sorting by field next_process_at has been added to the request for selecting the next task from the queue. It`s a hint to force Postgres to use an existed index instead of a sequential scan. This makes the task selection query run faster increase up to 5 times.

8.0.1 (08-11-2019)

8.0.0 (28-10-2019)

This version is a major redesign of queue configuration.

  • Deleted spring package
  • Changed entry point to QueueService instead of QueueExecutionPool
  • Renamed and deleted columns, for backward compatibility look at QueueTableSchema and EnqueueParams#getExtData
  • Deleted actor and log_timestamp columns
  • Renamed task column to payload
  • Renamed create_time column to created_at
  • Renamed process_time column to next_process_at
  • Support for arbitrary task data via QueueTableSchema#getExtFields
  • Support for relational databases with FOR UPDATE SKIP LOCKED feature
  • Updated example configuration in README.md

7.1.0 (14-08-2019)

  • В QueueLoop добавлен метод для прекращения работы цикла обработки задач

7.0.1 (11-06-2019)

  • Поправил javadoc'и для корректной сборки

7.0.0 (10-06-2019)

Добавлен новый способ вернуть задачу в очередь: TaskExecutionResult#reenqueue(), который использует стратегию переоткладывания, заданную в конфигурации очереди с помощью свойств reenqueue-retry-*. По-умолчанию используется стратегия manual, для которой требуется явно задавать задержку с помощью вызова TaskExecutionResult#reenqueue(Duration). Например, в случае, если задержка вычисляется относительно некоторого события.

Для поддержания использования стратегии переоткладывания, в таблицу для очередей добавлено новое поле reenqueue_attempt, служащее для подсчета количества попыток отложить задачу. Существующее поле attempt, как и ранее, будет использовано для подсчета неуспешных попыток обработать задачу. Стоит отметить, что поведение, при котором для TaskExecutionResult#reenqueue(Duration) поле attempt обнулялось, сохранится и для нового TaskExecutionResult#reenqueue(). Новое поле reenqueue_attempt инкрементируется для обоих случаев.

Также в таблицу для очередей добавлено новое поле total_attempt, служащее для подсчета количества всех попыток выполнить задачу - как успешных (с reenqueue), так и нет. Поле инкрементируется при выборе задачи и не сбрасывается при reenqueue. Новое поле может быть использовано для сбора статистики.

Новые поля доступны через сущности Task и TaskRecord.

NB: migration guide

Для перехода на версию 7.0.0 требуется добавить поля reenqueue_attempt и total_attempt во все таблицы БД, которые хранят задачи для очередей:

ALTER TABLE table_name ADD COLUMN reenqueue_attempt INTEGER;
ALTER TABLE table_name ADD COLUMN total_attempt INTEGER;

6.1.4 (10-06-2019)

  • Сборка и публикация артефакта под Java 11

6.1.3 (14-05-2019)

  • Добавлен репозиторий с Gradle плагинами

6.1.2 (24-04-2019)

  • Сборка проекта под Java 11

6.1.1 (04-04-2019)

В случае, если задача ставится в очередь до того, как полностью поднялся spring-контекст очередей, внутри SpringTransactionalProducer лениво создавался TransactionalProducer со всеми полями null. Таким образом очередь работать не будет.

Добавлен явный контроль полей TransactionalProducer на requireNonNull, чтобы вызывающий поток падал с исключением, а сам producer лениво не созадавался, пока контекст очередей не поднят. Тогда при следущем вызове enqueue очередь заработает.

6.1.0 (19-03-2019)

  • Переход на platformLibraryProjectVersion 3 версии

6.0.5 (12-11-2018)

  • Синхронизация тегов

6.0.4 (12-11-2018)

  • Проверка синхронизации

6.0.3 (11-11-2018)

  • Починил публикацию на bintray #2

6.0.2 (11-11-2018)

  • Починил публикацию на bintray

6.0.1 (11-11-2018)

  • Исправил сборку на github

6.0.0 (11-11-2018)

  • Переход на spring boot 2.1
  • Публичный релиз библиотеки

5.0.0 (28-08-2018)

  • correlationId переименован в traceInfo

4.0.0 (13-08-2018)

Изменён способ конфигурирования шардов БД.

В предыдущей версии шарды были общими для всех очередей и идентичными между Producer и Consumer в пределах одной очереди. Теперь используемые шарды задаются в каждом из QueueShardRouter и могут быть различными для Producer и Consumer.

Примеры новой конфигурации в тестах: example.ManualConfiguration и example.SpringAutoConfiguration

3.1.0 (03-08-2018)

  • Добавлена возможность будить поток разбора задача посредством QueueExecutionPool#wakeup

3.0.3 (19-06-2018)

  • Поддержка обновления контекста

3.0.2 (21-05-2018)

  • Добавил QueueStatisticsDao.getJdbcTemplate()

3.0.1 (30-11-2017)

  • Fix bug: if queue thread-count set greater than 1 than execution pool starts only one thread for queue processing

3.0.0 (27-09-2017)

  • QueueLocation replaced with QueueId wherever possible in order to identify particular queue.
  • QueueDao instances are directly passed to SpringQueueInitializer instead of retrieving it from SpringQueueCollector.

2.0.0 (04-09-2017)

  • Removed TaskExecutionResult#fail(delay)
  • Removed QueueSettings.AdditionalSetting
  • Changed signature QueueDao#reenqueue
  • Changed signature QueueActorDao#reenqueue
  • Replaced AdditionalSetting#RETRY_FIXED_INTERVAL_DELAY with QueueSettings#getRetryInterval
  • Added QueueSettings#getRetryInterval and QueueConfigsReader#SETTING_RETRY_INTERVAL
  • Renamed TaskRetryType#FIXED_INTERVAL to TaskRetryType#LINEAR_BACKOFF
  • Renamed QueueConfigsReader#VALUE_TASK_RETRY_TYPE_FIXED_INTERVAL to QueueConfigsReader#VALUE_TASK_RETRY_TYPE_LINEAR
  • Changed value of QueueConfigsReader#VALUE_TASK_RETRY_TYPE_LINEAR to "linear"

1.0.0 (01-09-2017)

  • Stable version

0.0.11 (29-08-2017)

  • Add callback telling that SpringQueueConsumer and SpringQueueConsumer are initialized
  • Fixed passing null property file to QueueConfigsReader

0.0.10 (27-08-2017)

  • Added ThreadLifecycleListener#executed to measure overall queue performance.
  • Specifying ThreadLifecycleListener per queue

0.0.9 (26-08-2017)

  • Fixed ability to disable queue processing via thread count
  • Renamed ThreadLifecycleListener#crashedOnPickedTask to ThreadLifecycleListener#crashed
  • Constructors of builder classes are made private
  • Return value of QueueProducer#enqueue changed to primitive
  • Added reenqueue by actor via QueueActorDao#reenqueue

0.0.8 (24-08-2017)

Renamed classes:

  • Queue -> QueueConsumer
  • Enqueuer -> QueueProducer
  • ShardRouter -> QueueShardRouter
  • QueueThreadLifecycleListener -> ThreadLifecycleListener
  • QueueAction -> TaskExecutionResult
  • PayloadTransformer -> TaskPayloadTransformer

0.0.7 (24-08-2017)

  • Upgrade Spring to 4.3.7

0.0.6 (24-08-2017)

  • Same queue names in different tables are forbidden
  • Reading configuration from file (QueueConfigsReader)

0.0.5 (20-08-2017)

  • Translated README to English

0.0.1 (08-08-2017)

  • Initial version