James & Paul interview Hannah Tickle, an experienced CRO and testing leader who’s currently the Experimentation Team Lead at Trainline.
Watch the video
Listen on your favourite player
The episode discusses the role of experimentation in ecommerce, the importance of ownership of within organisations, and the impact of hypotheses, testing speed, and data analysis.
Hannah shares insights on building a culture of test & learn, and the benefits of using a custom testing stack. She also touches on the challenges of incorporating user feedback and the importance of understanding the limitations of qualitative research.
Key take aways;
- True experimentation is essential for ecommerce businesses to improve strategic planning and prioritise product development.
- Testing should be centralised to ensure accessibility and consistency.
- Strong hypotheses are data-backed and focus on testing concepts rather than specific things.
- Testing should be fast, light, and big, with a focus on impactful changes rather than small tweaks.
- Understanding and analysing data is crucial for effective CRO, and it’s important to consider both quantitative and qualitative feedback.
- Building a culture of experimentation requires consistency, responsiveness, and support from senior leadership.
Tune in to for advice from a highly respected ecommerce experimentation leader.
Make sure you’re following Inside Commerce on LinkedIn and have subscribed to the Inside Commerce newsletter.
Discussion guide
- 00:00 Introduction and Setting the Scene
- 02:25 The Role of Experimentation in E-commerce
- 05:34 Centralising Experimentation for Accessibility and Consistency
- 09:51 Creating Strong Hypotheses for Effective Testing
- 16:19 The Importance of Testing Fast, Light, and Big
- 32:39 Building a Culture of Experimentation
- 37:32 Interesting and Impactful Tests
- 41:40 Incorporating User Feedback
Want to suggest a topic or guest for a future episode? Contact us via the website or on LinkedIn.