24.8.11 Altinity Stable Pre-release

[Enmk]

Based on upstream's v24.8.11.5-lts

Bug Fixes (user-visible misbehavior in an official stable release)

• Fix advanced SSL configuration for Keeper's internal communication (Fix advanced SSL configuration for Keeper's internal communication ClickHouse/ClickHouse#72730 and Update NuRaft ClickHouse/ClickHouse#72584 by @antonio2368 via 24.8 Backport of #72730 - Fix advanced SSL configuration for Keeper's internal communication #579)
• Fix for S3 Express Disk Initialization Issue (Fix for S3 Express Disk Initialisation Issue ClickHouse/ClickHouse#73777 by @stamsekar via 24.8 Backport of #73777 - Fix for S3 Express Disk Initialisation Issue #580)

Performance improvements

• Add support for parquet bloom filters (Add parquet bloom filters support ClickHouse/ClickHouse#62966 by @arthurpassos via 24.8.8 Backport of #62966 - Add parquet bloom filters support #556)
• Optimized thread creation in the ThreadPool to minimize lock contention. (Thread pool: move thread creation out of lock ClickHouse/ClickHouse#68694 by @filimonov via 24.8.8 Backport PR #68694 Thread pool: move thread creation out of lock #573)
• Adaptive mark_segment_size for parallel replicas (Adaptive mark_segment_size for parallel replicas ClickHouse/ClickHouse#68424, Fix parallel replicas protocol after #68424 ClickHouse/ClickHouse#69744 by @nickitat via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)

Improvements

• Added a new set of metrics for Thread Pool introspection, providing deeper insights into thread pool performance and behavior. (Thread pool metrics ClickHouse/ClickHouse#68674 by @filimonov via 24.8.8 Backport PR #68674 Thread pool metrics #567)
• Support for Parquet page V2 on native reader (Support for Parquet page V2 on native reader ClickHouse/ClickHouse#70807 by @arthurpassos via 24.8.8 Backport of #70807 parquet page header v2 native reader #558)
• Fix the issue where ClickHouse in Docker containers printed "get_mempolicy: Operation not permitted" into stderr due to restricted syscalls. (ClickHouse#70900 by @filimonov via 24.8 Backport of #70900 - make numactl respect EPERM error, when get_mempolicy is is restricted by seccomp #568)
• Support more advanced SSL options for Keeper internal communication (ClickHouse#69582 by @antonio2368 via 24.8 Backport of #69582 - Support more advanced SSL options for Keeper internal communication #566)
• Read output_format_compression_level on Parquet output (Compression level for parquet output format ClickHouse/ClickHouse#73651 and Set parquet compression level only if compression codec supports it ClickHouse/ClickHouse#74659 by @arthurpassos via 24.8 Backport of #73651and #74659 - Compression level for parquet output format #593)
• Rework parallel replicas settings (Rework parallel replicas settings ClickHouse/ClickHouse#63151 by @alexey-milovidov via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)

New features

• Push external user roles from query originator to other nodes in cluster. Helpful when only originator has access to the external authenticator (like LDAP). (Passing external user roles from query originator to other nodes ClickHouse/ClickHouse#70332, Fix exception in RemoteQueryExecutor when user does not exist locally ClickHouse/ClickHouse#72759, by @zvonand via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)

Build/Testing/Packaging Improvement

• Port CI/CD to Altinity's infrastructure
• Fixed tests
• Changed version number generation

[altinity-robot]

This is an automated comment for commit ddf159e with description of existing statuses. It's updated for the latest CI running

❌ Click here to open a full report in a separate page

Check name	Description	Status
Integration tests	The integration tests report. In parenthesis the package type is given, and in square brackets are the optional part/total tests	❌ failure
Sign aarch64	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	❌ error
Sign release	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	❌ error
Stateful tests	Runs stateful functional tests for ClickHouse binaries built in various configurations -- release, debug, with sanitizers, etc	❌ error
Stateless tests	Runs stateless functional tests for ClickHouse binaries built in various configurations -- release, debug, with sanitizers, etc	❌ error

Successful checks

Check name	Description	Status
Builds	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	✅ success
Compatibility check	Checks that clickhouse binary runs on distributions with old libc versions. If it fails, ask a maintainer for help	✅ success
Docker keeper image	The check to build and optionally push the mentioned image to docker hub	✅ success
Docker server image	The check to build and optionally push the mentioned image to docker hub	✅ success
Install packages	Checks that the built packages are installable in a clear environment	✅ success
Ready for release	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	✅ success
Stress test	Runs stateless functional tests concurrently from several clients to detect concurrency-related errors	✅ success