v3.1.2

PIPs

• PIP-318: Support not retaining null-key message during topic compaction by @coderzc in #21578

Broker

• Fixed ServiceUnitStateChannel monitor to tombstone only inactive bundle states by @heesung-sn in #21721
• Fix typo in the config key by @coderzc in #21690
• Record GeoPersistentReplicator.msgOut before producer#sendAsync by @nodece in #21673
• Print recoverBucketSnapshot log if cursorProperties are empty by @coderzc in #21651
• Support not retaining null-key message during topic compaction by @coderzc in #21601
• Delete topic timeout due to NPE by @poorbarcode in #21595
• Duplicate LedgerOffloader creation when namespace/topic policies are updated by @shibd in #21591
• Fix issue with consumer read uncommitted messages from compacted topic by @coderzc in #21571
• Fix create topic with different auto creation strategies causes race condition by @mattisonchao in #21545
• Fix orphan scheduled task for ledger create timeout check by @poorbarcode in #21542
• Fix thousands orphan PersistentTopic caused OOM by @poorbarcode in #21540
• Fix unfinished callback when deleting managed ledger by @mattisonchao in #21530
• Fix setReplicatedSubscriptionStatus incorrect behavior by @liudezhi2098 in #21510
• Fix failure while creating non-durable cursor with inactive managed-ledger by @rdhabalia in #21508
• Fix PulsarService/BrokerService shutdown when brokerShutdownTimeoutMs=0 by @lhotari in #21496
• Do not write replicated snapshot marker when the topic which is not enable replication by @liangyepianzhou in #21495
• Avoid pass null role in MultiRolesTokenAuthorizationProvider by @mattisonchao in #21486
• Fix the deadlock when using BookieRackAffinityMapping with rackaware policy by @erobot in #21481
• Fix issue with consumer read uncommitted messages from compacted topic by @coderzc in #21465
• Fix resource_quota_zpath by @AnonHxy in #21461
• Fix namespace bundle stuck in unloading status by @mattisonchao in #21445
• Ignore individual acknowledgment for CompactorSubscription when an entry has been filtered. by @coderzc in #21434
• Fix MultiRoles token provider NPE when using anonymous clients by @Technoboy- in #21429
• Fix heartbeat namespace create event topic and cannot delete heartbeat topic by @TakaHiR07 in #21360
• Fix heartbeat namespace create transaction internal topic by @TakaHiR07 in #21348
• Fix unload operation stuck when use ExtensibleLoadManager by @Demogorgon314 in #21332
• Fix lookup heartbeat and sla namespace bundle when using extensible load manager(#21213) by @Demogorgon314 in #21314
• Fix thread safe issue with RangeCache.put and RangeCache.clear by @lhotari in #21302
• use ConcurrentHashMap in ServiceUnitStateChannel and avoid recursive update error by @heesung-sn in #21282
• Fix inconsistent topic policy by @mattisonchao in #21255
• Let the producer request success at the first time if the previous one is inactive by @poorbarcode in #21220
• Fix lookup heartbeat and sla namespace bundle when using extensible load manager by @Demogorgon314 in #21213
• Avoid record inactiveproducers when deduplication is disable by @lifepuzzlefun in #21193
• Make specified producer could override the previous one by @poorbarcode in #21155
• Rackaware policy is ineffective when delete zk rack info after bkclient initialize by @TakaHiR07 in #20944
• Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin by @tuteng in #20939

Client

• Fix inconsistent API annotations of getTopicName by @liangyepianzhou in #21620
• Fix print error log 'Auto getting partitions failed' when expend partition by @hanmz in #21485
• Avert extensive time consumption during table view construction by @liangyepianzhou in #21270

Transaction

• OpRequestSend reuse problem cause tbClient commitTxnOnTopic timeout unexpectedly by @TakaHiR07 in #21505
• Ack all message ids when ack chunk messages with transaction by @liangyepianzhou in #21268

CI and Test

• Fix LocalBookkeeperEnsemble resource leak in tests by @lhotari in #21407
• Add new CI unit test group "Broker Group 4" with cluster migration tests by @lhotari in #21391
• Fix resource leaks with Pulsar Functions tests by @lhotari in #21378
• Fix some resource leaks in compaction tests by @lhotari in #21374
• Fix a resource leak in ClusterMigrationTest by @lhotari in #21366
• Fix docker image building by releasing more disk space before building by @lhotari in #21365
• Fix flaky CompactionTest.testDispatcherMaxReadSizeBytes by @lhotari in #21329
• Fix flaky test NarUnpackerTest by @lhotari in #21328
• Fix zookeeper related flacky test by @horizonzy in #21310
• fix flaky test PatternTopicsConsumerImplTest by @poorbarcode in #21222

Security

• Upgrade rabbitmq client to address CVE-2023-46120 by @liangyepianzhou in #21619
• Upgrade Zookeeper to 3.8.3 to address CVE-2023-44981 by @lhotari in #21398
• Upgrade Netty to 4.1.100 to address CVE-2023-44487 by @lhotari in #21397
• Upgrade Jetty to 9.4.53 to address CVE-2023-44487 by @lhotari in #21395
• Fix MultiRoles token provider when using anonymous clients by @merlimat in #21338
• Add OWASP Dependency Check suppressions by @lhotari in #21281
• Upgrade snappy-java to 1.1.10.5 by @lhotari in #21280

Build

• Fix Stage Docker images fail on M1 Mac by @AnonHxy in #21659
• Fix apt download issue in building the docker image by @lhotari in #21489
• Rename schema_example.conf to schema_example.json by @poorbarcode in #21447
• Upgrade Lombok to 1.18.30 to support compiling with JDK21 by @lhotari in #21278

Others

• [offload] Don't cleanup data when offload met MetaStore exception by @zymap in #21686
• [proxy] Move status endpoint out of auth coverage by @mattisonchao in #21428
• [auto-recovery] Migrate the replication testing from BookKeeper to Pulsar by @horizonzy in #21340
• [bk-client] Fix bk client MinNumRacksPerWriteQuorum and EnforceMinNumRacksPerWriteQuorum not work problem by @horizonzy in #21327
• [sql] Support UUID for json and avro by @liangyepianzhou in #21267
• [log] fix the vague response if topic not found by @poorbarcode in #20932