mpm_event module to improve apache scalability #3516
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
athithyaaselvam
requested review from
wing2fly,
amitsrivastava,
ranade1,
Harshg999 and
agl29
athithyaaselvam
force-pushed
the
apache_lb_bottleneck
branch
2 times, most recently
from
ae299f5 to
1a4eb49
Compare
amitsrivastava
approved these changes
Nov 1, 2023
wing2fly
requested changes
Nov 3, 2023
athithyaaselvam
force-pushed
the
apache_lb_bottleneck
branch
from
1a4eb49 to
836ce1f
Compare
wing2fly
approved these changes
Nov 17, 2023
athithyaaselvam
force-pushed
the
apache_lb_bottleneck
branch
from
836ce1f to
291e832
Compare
athithyaaselvam
force-pushed
the
apache_lb_bottleneck
branch
from
291e832 to
d020171
Compare
athithyaaselvam
added a commit
that referenced
this pull request
Feb 5, 2024
Change-Id: I2ec0dbe6c07a0c510a5f9c43a1b389630464d625 Co-authored-by: Athithyaa Selvam <aselvam@cloudera.com> (cherry picked from commit 10a46d1)
Alterrien
pushed a commit
to Alterrien/hue
that referenced
this pull request
Dec 19, 2024
Change-Id: I2ec0dbe6c07a0c510a5f9c43a1b389630464d625 Co-authored-by: Athithyaa Selvam <aselvam@cloudera.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
This pull request addresses the throttling of concurrent connections (approximately at 200 simultaneous threads) by the Apache load balancer when directing traffic to the Hue server. The scalability of the Apache load balancer is enhanced by implementing the mpm_event module.
How was this patch tested?
The patch underwent stress testing using Jmeter.
Tests were conducted on both Redhat8 and Centos7 systems with varying computational capacities and node configurations.
Below is a sample result from a Redhat 8 machine:
Default Apache Configurations:
The test concluded in roughly 10 minutes, although it was anticipated to run for over 3 hours. This early completion was due to the Apache Load Balancer throttling connections, preventing responses from the Hue server.
With mpm_event Configuration Changes and an Extended KeepAliveTimeout:
The test had a duration of approximately 1 hour and 40 minutes (was manually killed). Remarkably, none of the 1000 concurrent threads were terminated, and all received responses from the Hue server.
The error rate with the default Apache load balancer configuration stood at 18%. However, after implementing the mpm_event module configurations, the error rate significantly dropped to around 2%.
Please review Hue Contributing Guide before opening a pull request.