Skip to content

[DEMO] A/B test demonstration #101

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
matt-bernhardt wants to merge 5 commits into
base: main
Choose a base branch
from
Draft

[DEMO] A/B test demonstration #101

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
62cdc5e
Adds split gem with dashboard and redis
matt-bernhardt Aug 28, 2023
3def803
Implement a first experiment
matt-bernhardt Aug 28, 2023
a91906b
Minimal cancan implementation
matt-bernhardt Sep 1, 2023
022a407
Second experiment
matt-bernhardt Jan 8, 2024
5c1c7a7
Refactor second experiment to use outbound beacon to conclude experim…
matt-bernhardt Jan 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,9 @@ yarn-debug.log*
# Ignore master key for decrypting credentials and more.
/config/master.key

# Ignore local Redis databases
dump.rdb

.DS_Store
.vscode/
.yardoc
2 changes: 2 additions & 0 deletions Gemfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ ruby '3.4.10'

gem 'addressable'
gem 'bootsnap', require: false
gem 'cancancan'
gem 'crawler_detect'
gem 'graphql'
gem 'graphql-client'
Expand All @@ -23,6 +24,7 @@ gem 'redis'
gem 'scout_apm'
gem 'sentry-rails'
gem 'sentry-ruby'
gem 'split', require: 'split/dashboard'
gem 'sprockets-rails'
gem 'stimulus-rails'
gem 'turbo-rails'
Expand Down
184 changes: 114 additions & 70 deletions Gemfile.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,66 +12,66 @@ GEM
specs:
action_text-trix (2.1.19)
railties
actioncable (8.1.3)
actionpack (= 8.1.3)
activesupport (= 8.1.3)
actioncable (8.1.3.1)
actionpack (= 8.1.3.1)
activesupport (= 8.1.3.1)
nio4r (~> 2.0)
websocket-driver (>= 0.6.1)
zeitwerk (~> 2.6)
actionmailbox (8.1.3)
actionpack (= 8.1.3)
activejob (= 8.1.3)
activerecord (= 8.1.3)
activestorage (= 8.1.3)
activesupport (= 8.1.3)
actionmailbox (8.1.3.1)
actionpack (= 8.1.3.1)
activejob (= 8.1.3.1)
activerecord (= 8.1.3.1)
activestorage (= 8.1.3.1)
activesupport (= 8.1.3.1)
mail (>= 2.8.0)
actionmailer (8.1.3)
actionpack (= 8.1.3)
actionview (= 8.1.3)
activejob (= 8.1.3)
activesupport (= 8.1.3)
actionmailer (8.1.3.1)
actionpack (= 8.1.3.1)
actionview (= 8.1.3.1)
activejob (= 8.1.3.1)
activesupport (= 8.1.3.1)
mail (>= 2.8.0)
rails-dom-testing (~> 2.2)
actionpack (8.1.3)
actionview (= 8.1.3)
activesupport (= 8.1.3)
actionpack (8.1.3.1)
actionview (= 8.1.3.1)
activesupport (= 8.1.3.1)
nokogiri (>= 1.8.5)
rack (>= 2.2.4)
rack-session (>= 1.0.1)
rack-test (>= 0.6.3)
rails-dom-testing (~> 2.2)
rails-html-sanitizer (~> 1.6)
useragent (~> 0.16)
actiontext (8.1.3)
actiontext (8.1.3.1)
action_text-trix (~> 2.1.15)
actionpack (= 8.1.3)
activerecord (= 8.1.3)
activestorage (= 8.1.3)
activesupport (= 8.1.3)
actionpack (= 8.1.3.1)
activerecord (= 8.1.3.1)
activestorage (= 8.1.3.1)
activesupport (= 8.1.3.1)
globalid (>= 0.6.0)
nokogiri (>= 1.8.5)
actionview (8.1.3)
activesupport (= 8.1.3)
actionview (8.1.3.1)
activesupport (= 8.1.3.1)
builder (~> 3.1)
erubi (~> 1.11)
rails-dom-testing (~> 2.2)
rails-html-sanitizer (~> 1.6)
activejob (8.1.3)
activesupport (= 8.1.3)
activejob (8.1.3.1)
activesupport (= 8.1.3.1)
globalid (>= 0.3.6)
activemodel (8.1.3)
activesupport (= 8.1.3)
activerecord (8.1.3)
activemodel (= 8.1.3)
activesupport (= 8.1.3)
activemodel (8.1.3.1)
activesupport (= 8.1.3.1)
activerecord (8.1.3.1)
activemodel (= 8.1.3.1)
activesupport (= 8.1.3.1)
timeout (>= 0.4.0)
activestorage (8.1.3)
actionpack (= 8.1.3)
activejob (= 8.1.3)
activerecord (= 8.1.3)
activesupport (= 8.1.3)
activestorage (8.1.3.1)
actionpack (= 8.1.3.1)
activejob (= 8.1.3.1)
activerecord (= 8.1.3.1)
activesupport (= 8.1.3.1)
marcel (~> 1.0)
activesupport (8.1.3)
activesupport (8.1.3.1)
base64
bigdecimal
concurrent-ruby (~> 1.0, >= 1.3.1)
Expand Down Expand Up @@ -104,6 +104,7 @@ GEM
bootsnap (1.24.6)
msgpack (~> 1.2)
builder (3.3.0)
cancancan (3.6.1)
capybara (3.40.0)
addressable
matrix
Expand All @@ -113,6 +114,7 @@ GEM
rack-test (>= 0.6.3)
regexp_parser (>= 1.5, < 3.0)
xpath (~> 3.2)
cgi (0.5.2)
climate_control (1.2.0)
concurrent-ruby (1.3.8)
connection_pool (3.0.2)
Expand Down Expand Up @@ -142,13 +144,17 @@ GEM
faraday-net_http (3.4.4)
net-http (~> 0.5)
ffi (1.17.4-aarch64-linux-gnu)
ffi (1.17.4-aarch64-linux-musl)
ffi (1.17.4-arm-linux-gnu)
ffi (1.17.4-arm-linux-musl)
ffi (1.17.4-arm64-darwin)
ffi (1.17.4-x86_64-darwin)
ffi (1.17.4-x86_64-linux-gnu)
ffi (1.17.4-x86_64-linux-musl)
fiber-storage (1.0.1)
globalid (1.4.0)
activesupport (>= 6.1)
graphql (2.6.6)
graphql (2.6.7)
base64
fiber-storage
logger
Expand Down Expand Up @@ -176,7 +182,7 @@ GEM
jbuilder (2.15.1)
actionview (>= 7.0.0)
activesupport (>= 7.0.0)
json (2.21.1)
json (2.21.2)
language_server-protocol (3.17.0.6)
lint_roller (1.1.0)
llhttp (0.6.2)
Expand All @@ -203,10 +209,11 @@ GEM
ruby-progressbar
mocha (3.1.0)
ruby2_keywords (>= 0.0.5)
msgpack (1.8.3)
msgpack (1.8.4)
mustermann (3.1.1)
net-http (0.9.1)
uri (>= 0.11.1)
net-imap (0.6.4.1)
net-imap (0.6.6)
date
net-protocol
net-pop (0.1.2)
Expand All @@ -218,21 +225,32 @@ GEM
nio4r (2.7.5)
nokogiri (1.19.4-aarch64-linux-gnu)
racc (~> 1.4)
nokogiri (1.19.4-aarch64-linux-musl)
racc (~> 1.4)
nokogiri (1.19.4-arm-linux-gnu)
racc (~> 1.4)
nokogiri (1.19.4-arm-linux-musl)
racc (~> 1.4)
nokogiri (1.19.4-arm64-darwin)
racc (~> 1.4)
nokogiri (1.19.4-x86_64-darwin)
racc (~> 1.4)
nokogiri (1.19.4-x86_64-linux-gnu)
racc (~> 1.4)
nokogiri (1.19.4-x86_64-linux-musl)
racc (~> 1.4)
openssl (4.0.2)
parallel (2.1.0)
parser (3.3.12.0)
ast (~> 2.4.1)
racc
pg (1.6.3)
pg (1.6.3-aarch64-linux)
pg (1.6.3-aarch64-linux-musl)
pg (1.6.3-arm64-darwin)
pg (1.6.3-x86_64-darwin)
pg (1.6.3-x86_64-linux)
pg (1.6.3-x86_64-linux-musl)
pp (0.6.4)
prettyprint
prettyprint (0.2.0)
Expand All @@ -246,6 +264,10 @@ GEM
rack (3.2.6)
rack-attack (6.8.0)
rack (>= 1.0, < 4)
rack-protection (4.2.1)
base64 (>= 0.1.0)
logger (>= 1.6.0)
rack (>= 3.0.0, < 4)
rack-session (2.1.2)
base64 (>= 0.1.0)
rack (>= 3.0.0)
Expand All @@ -254,20 +276,20 @@ GEM
rack-timeout (0.7.0)
rackup (2.3.1)
rack (>= 3)
rails (8.1.3)
actioncable (= 8.1.3)
actionmailbox (= 8.1.3)
actionmailer (= 8.1.3)
actionpack (= 8.1.3)
actiontext (= 8.1.3)
actionview (= 8.1.3)
activejob (= 8.1.3)
activemodel (= 8.1.3)
activerecord (= 8.1.3)
activestorage (= 8.1.3)
activesupport (= 8.1.3)
rails (8.1.3.1)
actioncable (= 8.1.3.1)
actionmailbox (= 8.1.3.1)
actionmailer (= 8.1.3.1)
actionpack (= 8.1.3.1)
actiontext (= 8.1.3.1)
actionview (= 8.1.3.1)
activejob (= 8.1.3.1)
activemodel (= 8.1.3.1)
activerecord (= 8.1.3.1)
activestorage (= 8.1.3.1)
activesupport (= 8.1.3.1)
bundler (>= 1.15.0)
railties (= 8.1.3)
railties (= 8.1.3.1)
rails-dom-testing (2.3.0)
activesupport (>= 5.0.0)
minitest
Expand All @@ -282,9 +304,9 @@ GEM
rack
railties (>= 7.2)
semantic_logger (>= 5.1)
railties (8.1.3)
actionpack (= 8.1.3)
activesupport (= 8.1.3)
railties (8.1.3.1)
actionpack (= 8.1.3.1)
activesupport (= 8.1.3.1)
irb (~> 1.13)
rackup (>= 1.0.0)
rake (>= 12.2)
Expand All @@ -293,7 +315,7 @@ GEM
zeitwerk (~> 2.6)
rainbow (3.1.1)
rake (13.4.2)
rbs (4.0.3)
rbs (4.1.1)
logger
prism (>= 1.6.0)
tsort
Expand All @@ -302,8 +324,8 @@ GEM
prism (>= 1.6.0)
rbs (>= 4.0.0)
tsort
redis (5.4.1)
redis-client (>= 0.22.0)
redis (6.0.0)
redis-client (= 0.30.1)
redis-client (0.30.1)
connection_pool
regexp_parser (2.12.0)
Expand Down Expand Up @@ -334,6 +356,8 @@ GEM
rubocop-ast (>= 1.44.0, < 2.0)
ruby-progressbar (1.13.0)
ruby2_keywords (0.0.5)
rubystats (0.4.1)
matrix
rubyzip (3.4.1)
sassc (2.4.0)
ffi (~> 1.9)
Expand Down Expand Up @@ -361,8 +385,22 @@ GEM
bigdecimal
concurrent-ruby (~> 1.0, >= 1.0.2)
logger
simplecov (1.0.2)
simplecov (1.0.3)
simplecov-lcov (0.9.0)
sinatra (4.2.1)
logger (>= 1.6.0)
mustermann (~> 3.0)
rack (>= 3.0.0, < 4)
rack-protection (= 4.2.1)
rack-session (>= 2.0.0, < 3)
tilt (~> 2.0)
split (4.0.5)
bigdecimal
cgi
matrix
redis (>= 4.2)
rubystats (>= 0.3.0)
sinatra (>= 1.2.6)
sprockets (4.2.2)
concurrent-ruby (~> 1.0)
logger
Expand All @@ -372,9 +410,13 @@ GEM
activesupport (>= 6.1)
sprockets (>= 3.0.0)
sqlite3 (2.9.5-aarch64-linux-gnu)
sqlite3 (2.9.5-aarch64-linux-musl)
sqlite3 (2.9.5-arm-linux-gnu)
sqlite3 (2.9.5-arm-linux-musl)
sqlite3 (2.9.5-arm64-darwin)
sqlite3 (2.9.5-x86_64-darwin)
sqlite3 (2.9.5-x86_64-linux-gnu)
sqlite3 (2.9.5-x86_64-linux-musl)
stimulus-rails (1.3.4)
railties (>= 6.0.0)
strscan (3.1.8)
Expand Down Expand Up @@ -413,15 +455,15 @@ GEM

PLATFORMS
aarch64-linux
arm64-darwin-22
arm64-darwin-23
arm64-darwin-24
arm64-darwin-25
x86_64-darwin-19
x86_64-darwin-20
x86_64-darwin-21
x86_64-darwin-22
aarch64-linux-gnu
aarch64-linux-musl
arm-linux-gnu
arm-linux-musl
arm64-darwin
x86_64-darwin
x86_64-linux
x86_64-linux-gnu
x86_64-linux-musl

DEPENDENCIES
addressable
Expand All @@ -430,6 +472,7 @@ DEPENDENCIES
better_errors
binding_of_caller
bootsnap
cancancan
capybara
climate_control
crawler_detect
Expand Down Expand Up @@ -460,6 +503,7 @@ DEPENDENCIES
sentry-ruby
simplecov
simplecov-lcov
split
sprockets-rails
sqlite3
stimulus-rails
Expand All @@ -474,4 +518,4 @@ RUBY VERSION
ruby 3.4.10p104

BUNDLED WITH
2.6.9
2.7.2
4 changes: 4 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -210,3 +210,7 @@ If you prefer an editor other than VSCode, you can manage [Dev Containers from t
[DevPod](https://github.com/loft-sh/devpod) is also something to consider. It provides a VScode-via-web-browser-in-a-box
as well as allowing you to use whatever editor you want and only using DevPod to start/stop the containers and run your
terminals. Local for editor, DevPod managed Dev Container for everything else.

### A/B testing, the Split gem, and Redis

This application has the capability of supporting A/B testing of new features using the [Split](https://github.com/splitrb/split) gem. When running locally, this means you'll need access to a Redis instance - which can be achieved on a Mac by Homebrew. Full details can be found in the Split documentation.
Loading
Loading