Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DEMO] A/B test demonstration #101

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from
Draft

[DEMO] A/B test demonstration #101

wants to merge 5 commits into from

Conversation

matt-bernhardt
Copy link
Member

@matt-bernhardt matt-bernhardt commented Aug 28, 2023

This PR is meant to demonstrate how an A/B testing framework might function within our Rails applications. It is only a demonstration.

Developer

  • All new ENV is documented in README
  • All new ENV has been added to Heroku Pipeline, Staging and Prod
  • ANDI or Wave has been run in accordance to
    our guide and
    all issues introduced by these changes have been resolved or opened as new
    issues (link to those issues in the Pull Request details above)
  • Stakeholder approval has been confirmed (or is not needed)

Code Reviewer

  • The commit message is clear and follows our guidelines
    (not just this pull request message)
  • There are appropriate tests covering any new functionality
  • The documentation has been updated or is unnecessary
  • The changes have been verified
  • New dependencies are appropriate or there were no changes

Requires database migrations?

NO

Includes new or updated dependencies?

YES

@mitlib mitlib temporarily deployed to timdex-ui-pi-ab-test-bahpibact August 28, 2023 19:59 Inactive
@matt-bernhardt matt-bernhardt changed the title A/B test demonstration [DEMO] A/B test demonstration Aug 28, 2023
@matt-bernhardt matt-bernhardt marked this pull request as draft August 28, 2023 20:00
@mitlib mitlib temporarily deployed to timdex-ui-pi-ab-test-buqsdckwb September 1, 2023 21:34 Inactive
@matt-bernhardt matt-bernhardt force-pushed the ab-test branch 3 times, most recently from cc4fc0f to 5a7c840 Compare January 10, 2024 20:35
@matt-bernhardt matt-bernhardt force-pushed the ab-test branch 3 times, most recently from 7170de9 to 63c21fa Compare February 29, 2024 19:19
@matt-bernhardt matt-bernhardt force-pushed the ab-test branch 3 times, most recently from 0b28cac to 947d918 Compare March 7, 2024 19:44
This sets up a simple UI experiment, defining an alternative set of styles for the search form.

The search form starts in the _form.html.erb partial, with most users getting a "standard" class - the experimental group would get the "alt" class, which is rendered differently.

The experiment ends when a user reaches a search results page (i.e, they submitted the form and thus got results).

Curious folks can force themselves into one or the other pool by using a querystring such as

?ab_test[ui_colors]=alt
or
?ab_test[ui_colors]=standard
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants