[Bootcamp] [Experimentation] Plan scotty.lol dogfooding and feedback

[rajgodse]

Task Brief

Software products in the real world have their impact on user experience tested prior to launch. Informal dogfooding of scotty.lol has helped us add important commands and highlight the importance of features like autocomplete.

scotty.lol should have incorporate formal methods for measuring user experience. This task has a committee member plan out what experimentation for scotty.lol should look like.

Expected Deliverables

• Detailed plan of experimentation form, methods, and expected outcomes.
• Definition of key metrics to track search engine performance and data collection methods (automated/from users).
• (Stretch) Automate tracking of key metrics, set up alerts for regressions in key metrics.

Estimated Completion Time

2 hours (not including stretch)

Reviewers

@rajgodse @hdavidethan @anudaweerasinghe