尊敬的 微信汇率:1円 ≈ 0.046166 元 支付宝汇率:1円 ≈ 0.046257元 [退出登录]
SlideShare a Scribd company logo
Mobile A/B Testing: Best Practices,
Pretotyping and Why It's a Good
Alternative to App Prototyping
Lina Danilchik
Marketing Manager Senior ASO consultant
Maggie Ngai
Pretotyping. What is it?
Pretotype is an image that conveys the idea of a product.
Mobile app title, icon, description and screenshots designed to reflect its
setting and features together make up an app’s pretotype.
What can serve as app pretotypes?
How publishers
validate app ideas
via pretotyping
Once you’re ready with your app’s
pretotypes – several versions of app
title, description, icon & screenshots –
proceed to validating your app idea with
the help of a third-party A/B testing
platform.
How mobile A/B
testing works together
with pretotyping
A/B Testing Capabilities for Mobile
App Idea Validation
Test your mobile
app idea
Test mobile game
setting
Compare a few mobile
app concepts
Validate or
prioritize app
features
Decide on targeting
& positioning
Test your app idea
and decide if you
should build it
Compare a few app concepts & select the best
one
Decide on targeting
and positioning
Decide on localization
Feature validation: prioritize your app features
Test mobile game setting
Test mobile game styles and characters
Main metrics to rely
on when running A/B
tests on SplitMetrics
7 Biggest Mistakes in Mobile A/B Testing
Mistake №2
Finishing an experiment before
7 days have passed
Mistake №1
Finishing an experiment before you
get the right amount of traffic
7 Biggest Mistakes in Mobile A/B Testing
Mistake №4
Your banner ads have the same design
as one of the app store visual assets
Mistake №3
Testing too small changes
in design
7 Biggest Mistakes in Mobile A/B Testing
Mistake №5
Testing several hypotheses at once
7 Biggest Mistakes in Mobile A/B Testing
Mistake №6
Misinterpreting the situation when two
variations are the same but you get a
winner
Mistake №7
Getting upset when a new variation
loses to the current one
Thank you!
If you have any questions, feel free to reach out to us on LinkedIn or via email:
lina.d@splitmetrics.com & maggie.ngai@phiture.com

More Related Content

What's hot

Optimizely Partner Ecosystem
Optimizely Partner EcosystemOptimizely Partner Ecosystem
Optimizely Partner Ecosystem
Optimizely
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
Optimizely
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO
 
Getting Started with Server-Side Testing
Getting Started with Server-Side TestingGetting Started with Server-Side Testing
Getting Started with Server-Side Testing
Optimizely
 
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
Optimizely
 
The anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia WorkshopThe anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia Workshop
Eduardo Shiota Yasuda
 
MAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth CultureMAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth Culture
Grow.co
 
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance EdgeAhead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Optimizely
 
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing PagesTest for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
Optimizely
 
Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10
Optimizely
 
Preparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO DesignPreparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO Design
Raven Tools
 
Retain or Die: The Retention Playbook
Retain or Die: The Retention PlaybookRetain or Die: The Retention Playbook
Retain or Die: The Retention Playbook
Optimizely
 
Product Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of ProductsProduct Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of Products
Product School
 
How To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American ExpressHow To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American Express
Product School
 
MAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During ActivationMAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During Activation
Grow.co
 
Optimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABCOptimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABC
Optimizely
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
Janessa Lantz
 
Workshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureWorkshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization Culture
Optimizely
 
Website Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessWebsite Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure Success
Optimizely
 
Cox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsCox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple Brands
Optimizely
 

What's hot (20)

Optimizely Partner Ecosystem
Optimizely Partner EcosystemOptimizely Partner Ecosystem
Optimizely Partner Ecosystem
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Getting Started with Server-Side Testing
Getting Started with Server-Side TestingGetting Started with Server-Side Testing
Getting Started with Server-Side Testing
 
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
7 Habits of Highly Effective Personalisation Organisations | Optimizely ANZ W...
 
The anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia WorkshopThe anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia Workshop
 
MAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth CultureMAU Vegas 2016 — How to Build an Internal Growth Culture
MAU Vegas 2016 — How to Build an Internal Growth Culture
 
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance EdgeAhead of the Curve: How 23andMe Improved UX with Performance Edge
Ahead of the Curve: How 23andMe Improved UX with Performance Edge
 
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing PagesTest for Success: A Guide to A/B Testing on Emails & Landing Pages
Test for Success: A Guide to A/B Testing on Emails & Landing Pages
 
Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10Optimizely X Seminar Amsterdam Nov 10
Optimizely X Seminar Amsterdam Nov 10
 
Preparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO DesignPreparing for a Website Redesign | SEO Design
Preparing for a Website Redesign | SEO Design
 
Retain or Die: The Retention Playbook
Retain or Die: The Retention PlaybookRetain or Die: The Retention Playbook
Retain or Die: The Retention Playbook
 
Product Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of ProductsProduct Analytics 101 by Pendo VP of Products
Product Analytics 101 by Pendo VP of Products
 
How To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American ExpressHow To Launch A Product No Matter Where You Work By PM From American Express
How To Launch A Product No Matter Where You Work By PM From American Express
 
MAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During ActivationMAU Vegas 2016 — Tackling Retention During Activation
MAU Vegas 2016 — Tackling Retention During Activation
 
Optimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABCOptimizely Experience - LA - Disney-ABC
Optimizely Experience - LA - Disney-ABC
 
4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing4 Steps Toward Scientific A/B Testing
4 Steps Toward Scientific A/B Testing
 
Workshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization CultureWorkshop 6: Build Your Organization's Optimization Culture
Workshop 6: Build Your Organization's Optimization Culture
 
Website Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure SuccessWebsite Redesigns: Why they Fail and How to Ensure Success
Website Redesigns: Why they Fail and How to Ensure Success
 
Cox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple BrandsCox Automotive: Testing Across Multiple Brands
Cox Automotive: Testing Across Multiple Brands
 

Similar to Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture

Mobile Usability Overview
Mobile Usability OverviewMobile Usability Overview
Mobile Usability Overview
rsimiele
 
Mob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewMob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) Overview
Stephen King
 
Mobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation SlidesMobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation Slides
SlideTeam
 
Apps are destroyed in these ways....
Apps are destroyed in these ways....Apps are destroyed in these ways....
Apps are destroyed in these ways....
Rapidsoft Technologies
 
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into RealityA Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
IndianAppDevelopers
 
Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...
Aravind Krishnaswamy
 
Competitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptxCompetitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptx
ComboApp, Inc
 
Industry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile ApplicationIndustry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile Application
IndianAppDevelopers
 
One-Pager: App Intelligence
One-Pager: App IntelligenceOne-Pager: App Intelligence
One-Pager: App Intelligence
Wes McCabe
 
Benefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For StartupsBenefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For Startups
Rosalie Lauren
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
Swarnendu De
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
Innofied Solution
 
Testing Mobile Apps
Testing Mobile AppsTesting Mobile Apps
Testing Mobile Apps
Suresh Kumar
 
10 stages of mobile app development process 2022
10 stages of mobile app development process 202210 stages of mobile app development process 2022
10 stages of mobile app development process 2022
SynapseIndia
 
Sayanti Mondal CV
Sayanti Mondal CVSayanti Mondal CV
Sayanti Mondal CV
Sayanti Mondal
 
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.comPhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN WebAndAppsDevelopment
 
7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps
99tests
 
How much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar questionHow much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar question
New Generation Applications
 
App Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdfApp Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdf
lubnayasminsebl
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting
UserTesting
 

Similar to Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture (20)

Mobile Usability Overview
Mobile Usability OverviewMobile Usability Overview
Mobile Usability Overview
 
Mob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) OverviewMob4Hire Mobile App Usability (MobExperience) Overview
Mob4Hire Mobile App Usability (MobExperience) Overview
 
Mobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation SlidesMobile App Development Proposal Template PowerPoint Presentation Slides
Mobile App Development Proposal Template PowerPoint Presentation Slides
 
Apps are destroyed in these ways....
Apps are destroyed in these ways....Apps are destroyed in these ways....
Apps are destroyed in these ways....
 
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into RealityA Guide for Anyone Who Wants to Turn App Development Idea into Reality
A Guide for Anyone Who Wants to Turn App Development Idea into Reality
 
Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...Are you a lean mobile startup? Applying lean startup principles to mobile app...
Are you a lean mobile startup? Applying lean startup principles to mobile app...
 
Competitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptxCompetitive analysis for mobile apps.pptx
Competitive analysis for mobile apps.pptx
 
Industry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile ApplicationIndustry Experts on How to Build Really Good Mobile Application
Industry Experts on How to Build Really Good Mobile Application
 
One-Pager: App Intelligence
One-Pager: App IntelligenceOne-Pager: App Intelligence
One-Pager: App Intelligence
 
Benefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For StartupsBenefits & Best Practices to Develop Minimum Viable Product For Startups
Benefits & Best Practices to Develop Minimum Viable Product For Startups
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
 
Top 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developersTop 10 questions to answer before you hire mobile app developers
Top 10 questions to answer before you hire mobile app developers
 
Testing Mobile Apps
Testing Mobile AppsTesting Mobile Apps
Testing Mobile Apps
 
10 stages of mobile app development process 2022
10 stages of mobile app development process 202210 stages of mobile app development process 2022
10 stages of mobile app development process 2022
 
Sayanti Mondal CV
Sayanti Mondal CVSayanti Mondal CV
Sayanti Mondal CV
 
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.comPhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
PhoenixGMN - How To Go About An App Idea - Guide by SuperHitApps.com
 
7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps7 Factors to Consider While Developing Mobile Apps
7 Factors to Consider While Developing Mobile Apps
 
How much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar questionHow much does it cost to develop an app? - The million dollar question
How much does it cost to develop an app? - The million dollar question
 
App Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdfApp Testing Tools and Frameworks A Comparative Analysis.pdf
App Testing Tools and Frameworks A Comparative Analysis.pdf
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting
 

More from SplitMetrics

Conversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycleConversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycle
SplitMetrics
 
How to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testingHow to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testing
SplitMetrics
 
The impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search AdsThe impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search Ads
SplitMetrics
 
Apple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASOApple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASO
SplitMetrics
 
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
SplitMetrics
 
How to Create High Converting App Previews
How to Create High Converting App PreviewsHow to Create High Converting App Previews
How to Create High Converting App Previews
SplitMetrics
 
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQFirst Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
SplitMetrics
 
Apple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQApple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQ
SplitMetrics
 
All You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweakAll You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweak
SplitMetrics
 
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyerApple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
SplitMetrics
 
ASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweakASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweak
SplitMetrics
 

More from SplitMetrics (11)

Conversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycleConversion optimization with A/B testing throughout app lifecycle
Conversion optimization with A/B testing throughout app lifecycle
 
How to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testingHow to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testing
 
The impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search AdsThe impact of COVID-19 on Apple Search Ads
The impact of COVID-19 on Apple Search Ads
 
Apple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASOApple Search Ads (RU): advantages, strategies, correlation with ASO
Apple Search Ads (RU): advantages, strategies, correlation with ASO
 
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
Apple Search Ads - Keyword expansion with discovery campaigns & Performance b...
 
How to Create High Converting App Previews
How to Create High Converting App PreviewsHow to Create High Converting App Previews
How to Create High Converting App Previews
 
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQFirst Look at Apple Search Ads Benchmarks by SearchAdsHQ
First Look at Apple Search Ads Benchmarks by SearchAdsHQ
 
Apple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQApple Search Ads Scaling and Optimization by SearchAdsHQ
Apple Search Ads Scaling and Optimization by SearchAdsHQ
 
All You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweakAll You Need to Know About ASA Keywords by AppTweak
All You Need to Know About ASA Keywords by AppTweak
 
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyerApple Search Ads for Gaming / Non-Gaming by AppsFlyer
Apple Search Ads for Gaming / Non-Gaming by AppsFlyer
 
ASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweakASA Influence on Organic Ranking by AppTweak
ASA Influence on Organic Ranking by AppTweak
 

Recently uploaded

Day 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio FundamentalsDay 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio Fundamentals
UiPathCommunity
 
Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2
DianaGray10
 
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My IdentityCNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
Cynthia Thomas
 
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched ContentDiscover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
ScyllaDB
 
CTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database MigrationCTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database Migration
ScyllaDB
 
Demystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through StorytellingDemystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through Storytelling
Enterprise Knowledge
 
DynamoDB to ScyllaDB: Technical Comparison and the Path to Success
DynamoDB to ScyllaDB: Technical Comparison and the Path to SuccessDynamoDB to ScyllaDB: Technical Comparison and the Path to Success
DynamoDB to ScyllaDB: Technical Comparison and the Path to Success
ScyllaDB
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
AlexanderRichford
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving
 
New ThousandEyes Product Features and Release Highlights: June 2024
New ThousandEyes Product Features and Release Highlights: June 2024New ThousandEyes Product Features and Release Highlights: June 2024
New ThousandEyes Product Features and Release Highlights: June 2024
ThousandEyes
 
ScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking ReplicationScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking Replication
ScyllaDB
 
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
anilsa9823
 
APJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes WebinarAPJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes Webinar
ThousandEyes
 
Real-Time Persisted Events at Supercell
Real-Time Persisted Events at  SupercellReal-Time Persisted Events at  Supercell
Real-Time Persisted Events at Supercell
ScyllaDB
 
ScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDCScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDC
ScyllaDB
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - MydbopsMySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
Mydbops
 
Facilitation Skills - When to Use and Why.pptx
Facilitation Skills - When to Use and Why.pptxFacilitation Skills - When to Use and Why.pptx
Facilitation Skills - When to Use and Why.pptx
Knoldus Inc.
 
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
zjhamm304
 
TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...
TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...
TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...
TrustArc
 
From NCSA to the National Research Platform
From NCSA to the National Research PlatformFrom NCSA to the National Research Platform
From NCSA to the National Research Platform
Larry Smarr
 

Recently uploaded (20)

Day 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio FundamentalsDay 2 - Intro to UiPath Studio Fundamentals
Day 2 - Intro to UiPath Studio Fundamentals
 
Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2Communications Mining Series - Zero to Hero - Session 2
Communications Mining Series - Zero to Hero - Session 2
 
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My IdentityCNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
CNSCon 2024 Lightning Talk: Don’t Make Me Impersonate My Identity
 
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched ContentDiscover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
 
CTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database MigrationCTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database Migration
 
Demystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through StorytellingDemystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through Storytelling
 
DynamoDB to ScyllaDB: Technical Comparison and the Path to Success
DynamoDB to ScyllaDB: Technical Comparison and the Path to SuccessDynamoDB to ScyllaDB: Technical Comparison and the Path to Success
DynamoDB to ScyllaDB: Technical Comparison and the Path to Success
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
 
New ThousandEyes Product Features and Release Highlights: June 2024
New ThousandEyes Product Features and Release Highlights: June 2024New ThousandEyes Product Features and Release Highlights: June 2024
New ThousandEyes Product Features and Release Highlights: June 2024
 
ScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking ReplicationScyllaDB Tablets: Rethinking Replication
ScyllaDB Tablets: Rethinking Replication
 
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
 
APJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes WebinarAPJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes Webinar
 
Real-Time Persisted Events at Supercell
Real-Time Persisted Events at  SupercellReal-Time Persisted Events at  Supercell
Real-Time Persisted Events at Supercell
 
ScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDCScyllaDB Real-Time Event Processing with CDC
ScyllaDB Real-Time Event Processing with CDC
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - MydbopsMySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
 
Facilitation Skills - When to Use and Why.pptx
Facilitation Skills - When to Use and Why.pptxFacilitation Skills - When to Use and Why.pptx
Facilitation Skills - When to Use and Why.pptx
 
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
 
TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...
TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...
TrustArc Webinar - Your Guide for Smooth Cross-Border Data Transfers and Glob...
 
From NCSA to the National Research Platform
From NCSA to the National Research PlatformFrom NCSA to the National Research Platform
From NCSA to the National Research Platform
 

Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture

  • 1. Mobile A/B Testing: Best Practices, Pretotyping and Why It's a Good Alternative to App Prototyping Lina Danilchik Marketing Manager Senior ASO consultant Maggie Ngai
  • 2. Pretotyping. What is it? Pretotype is an image that conveys the idea of a product.
  • 3. Mobile app title, icon, description and screenshots designed to reflect its setting and features together make up an app’s pretotype. What can serve as app pretotypes?
  • 4. How publishers validate app ideas via pretotyping Once you’re ready with your app’s pretotypes – several versions of app title, description, icon & screenshots – proceed to validating your app idea with the help of a third-party A/B testing platform.
  • 5. How mobile A/B testing works together with pretotyping
  • 6. A/B Testing Capabilities for Mobile App Idea Validation Test your mobile app idea Test mobile game setting Compare a few mobile app concepts Validate or prioritize app features Decide on targeting & positioning
  • 7. Test your app idea and decide if you should build it
  • 8. Compare a few app concepts & select the best one
  • 11. Feature validation: prioritize your app features
  • 12. Test mobile game setting
  • 13. Test mobile game styles and characters
  • 14. Main metrics to rely on when running A/B tests on SplitMetrics
  • 15. 7 Biggest Mistakes in Mobile A/B Testing Mistake №2 Finishing an experiment before 7 days have passed Mistake №1 Finishing an experiment before you get the right amount of traffic
  • 16. 7 Biggest Mistakes in Mobile A/B Testing Mistake №4 Your banner ads have the same design as one of the app store visual assets Mistake №3 Testing too small changes in design
  • 17. 7 Biggest Mistakes in Mobile A/B Testing Mistake №5 Testing several hypotheses at once
  • 18. 7 Biggest Mistakes in Mobile A/B Testing Mistake №6 Misinterpreting the situation when two variations are the same but you get a winner Mistake №7 Getting upset when a new variation loses to the current one
  • 19. Thank you! If you have any questions, feel free to reach out to us on LinkedIn or via email: lina.d@splitmetrics.com & maggie.ngai@phiture.com
  翻译: