Aaron Ginn from StumbleUpon.com
\nOctober 10th, 2013 @ Miami Science Museum \/ Refresh Miami<\/p>\n
Most important metrics?
\nNumber of installations.
\nRevenues.<\/p>\n
Types of metrics:
\n– Quantitatie vs -Qualitative.<\/p>\n
Idea:
\n– On Wizard, let them know how to be in touch for Tech Support
\nvia @frostwire and facebook.com\/FrostWire Official.
\nTask for Marcelina to design that screen on the wizard.<\/p>\n
QUANTITATIVE<\/b>
\nThe funnel (Pirate Metric)
\nAcquisition > Activations > Retention > Referral > Revenue.<\/p>\n
QUALITATIVE<\/b>
\nUser Testing (In Progress)
\nSurveys
\nStudy Groups
\nUser Interviews<\/p>\n
—<\/b><\/p>\n
Stages for companies:<\/b><\/p>\n
Early Stage<\/b>\u00a0involves discovery, validation. Then get Seeded out of pocket and angels.
\nQualitative metrics help here.<\/p>\n
Later Stage <\/b>creation and building – Series A, profitability.
\nQuantitative metrics.<\/p>\n
During creation, you want to start doing A\/B to grow and see what works.<\/p>\n
PRODUCT DASHBOARD<\/b>
\nEngagement
\nUser’s worth (LTV)
\nGrowth rate<\/p>\n
Qualities of a Good Metric<\/b>
\nMeasurements that are aggressively attacking your product.<\/p>\n
Actionable<\/b> – short feedback loop.
\nProduct Centric <\/b>– attack core assumptions of your product
\nRatio <\/b>– Compare against competitors performance, industry numbers.
\nExplainable – <\/b>simpler the better
\nTimeless<\/b>
\n(Checkout “Flurry” reports<\/p>\n
Key Metrics per business<\/b><\/p>\n
Marketplace: fulfillment rate, WOW (week over week) growth on both sides, % repeat purchase<\/p>\n
Social Product: DAU\/MAU, WOW daily registration, % ad impressions<\/p>\n
B2B – sales funnel metrics, LTV<\/p>\n
B2C – sales funnel metrics, LTV, WOW growth<\/p>\n
LTV = churn * avg revenue per customer<\/p>\n
Virality = measure the share cycle time is important. The faster, the deeper impact at sub-levels. Time between invites and activations.
\nLook for vitality equations.<\/p>\n
Create your own AARRR<\/b><\/p>\n
Acquisition – Number of new downloads, newsletter signups, twitter followers, Facebook page likes, community forum signups,\u00a0Number of displays of our thank you page
\nActivation – Number of first uses. Displays of our promotions.
\nRetention – Number of sessions, Number of core actions, Newsletter unsubscribes, Facebook unlikes
\nReferral – Measure social activity, buzz, cult (pictures, fan art)
\nRevenue – Daily reports from all revenue channels (some hourly)<\/p>\n
Qualitative Testing Schedule<\/b><\/p>\n
One user a day. Watch them.
\nTwo user sessions a month.
\nThree usability studies a month.<\/p>\n
Important Factors in Quantitative Testing<\/b>
\nis it Statistically Significant<\/b>?
\nsample size.
\nsensitivity of the test.
\nduration of the test.
\nvelocity. How many tests can you run in a period, pretty important. You need to test and get results as fast as possible, to learn more and more.
\nconversion.<\/p>\n
Good habits<\/b>
\nTest the hell out of MVPs.
\nKill tech that slows you down.
\nValidate Instrumentation First. (make sure your test is running well)
\nThe Goal is testing velocity.
\nThink about your next developer\/employee.<\/p>\n
Tools we use<\/b>
\nQualitative Testing Tools:<\/b>
\nFT User Researcher
\nUserTesting.com
\nMouseOver Videos
\nUser Studies<\/p>\n
Quantitative Testing Tools<\/b>
\nAB testing
\nDaily metrics emails
\nProduct dashboards
\nTeam metrics<\/p>\n
Rapid A\/B Testing Workflow<\/b><\/p>\n
Test Iteration Implementations -> Rapid implementations.
\nFull Implementations -> Winner only (clean losers)
\nCode Fragmentation -> Clean unused test code.<\/p>\n
Branch Based Workflow <\/b>(git based)<\/p>\n
Test Iteration Implementation -> Rapid
\nFull Impl -> Winner only<\/p>\n
What will we do differently after this?<\/b>
\nAdded some new metrics I was missing thanks to this in relationship to acquisition and activations.
\nWill try new tools like UserTesting.com
\nWill look at what tech might be slowing us down.
\nWill not build more visualization tools of test data.<\/p>\n","protected":false},"excerpt":{"rendered":"
Aaron Ginn from StumbleUpon.com October 10th, 2013 @ Miami Science Museum \/ Refresh Miami Most important metrics? Number of installations. Revenues. Types of metrics: – Quantitatie vs -Qualitative. Idea: – On Wizard, let them know how to be in touch for Tech Support via @frostwire and facebook.com\/FrostWire Official. Task for Marcelina to design that screen […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1],"tags":[378,1354,1351,1353,1148,1352],"class_list":["post-3175","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-entrepreneurs","tag-entrepreneurship","tag-lean-startup","tag-metrics","tag-statistics","tag-testing"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5Unzf-Pd","jetpack-related-posts":[{"id":844,"url":"https:\/\/www.gubatron.com\/blog\/image-metrics-demo-the-most-amazing-facial-animation-tech-so-far\/","url_meta":{"origin":3175,"position":0},"title":"Image Metrics Demo – The most amazing Facial Animation Tech so far","author":"gubatron","date":"September 5, 2008","format":false,"excerpt":"It's official, I'm retarded compared to the guys that built this technology.","rel":"","context":"In "Geeklife"","block_context":{"text":"Geeklife","link":"https:\/\/www.gubatron.com\/blog\/category\/geeklife\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3064,"url":"https:\/\/www.gubatron.com\/blog\/new-frostwire-for-android-1-0-8-out\/","url_meta":{"origin":3175,"position":1},"title":"New FrostWire for Android 1.0.8 out","author":"gubatron","date":"June 1, 2013","format":false,"excerpt":"A new FrostWire for Android is out on Google Play. In this release we improved our search algorithm to include relevant search results that were being hidden in previous versions. We've also made use of Square's Picasso Image loading\/caching library for displaying all the images on the user interface, resulting\u2026","rel":"","context":"In \"Android\"","block_context":{"text":"Android","link":"https:\/\/www.gubatron.com\/blog\/tag\/android\/"},"img":{"alt_text":"Screenshot of the new FrostWire for Android navigation menu","src":"https:\/\/frostwire.files.wordpress.com\/2013\/05\/468570_620137218016084_1578847253_o.png?w=350&h=200&crop=1","width":350,"height":200},"classes":[]},{"id":1210,"url":"https:\/\/www.gubatron.com\/blog\/geek-t-shirt-collection-14-frostwire\/","url_meta":{"origin":3175,"position":2},"title":"Geek T-Shirt Collection #14 – FrostWire","author":"gubatron","date":"April 4, 2009","format":false,"excerpt":"This is the official FrostWire T-Shirt. I contribute to this open source project to keep my java skills up to date. We had a lot of these t-shirt printed to gather donations for the project. Thanks to the people that support us there's only a few left (only M size)\u2026","rel":"","context":"In "Geeklife"","block_context":{"text":"Geeklife","link":"https:\/\/www.gubatron.com\/blog\/category\/geeklife\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":994,"url":"https:\/\/www.gubatron.com\/blog\/new-frostwire-4172-for-windows-is-out\/","url_meta":{"origin":3175,"position":3},"title":"New FrostWire 4.17.2 for Windows is out","author":"gubatron","date":"November 23, 2008","format":false,"excerpt":"Download FrostWire 4.17.2 for Windows CHANGELOG: Version 4.17.2 (November 2008) Fixes a newly introduced bug in Windows which would make FrostWire(tm) take over the .bittorrent file association without asking the user. Reduces DHT network load. The LimeWire team found out that the Mojito \u201cstore forwarding\u201d feature would not provide extra\u2026","rel":"","context":"In "Geeklife"","block_context":{"text":"Geeklife","link":"https:\/\/www.gubatron.com\/blog\/category\/geeklife\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3272,"url":"https:\/\/www.gubatron.com\/blog\/new-frostwire-5-7-2-with-utp-support\/","url_meta":{"origin":3175,"position":4},"title":"New FrostWire 5.7.2 with uTP support","author":"gubatron","date":"April 12, 2014","format":false,"excerpt":"Download FrostWire 5.7.2 for Windows\u00a0(Bitcoin, Litecoin, Dogecoin enabled .torrent) Download FrostWire 5.7.2 for MacOSX\u00a0(.torrent) Download FrostWire 5.7.2 for Debian\/Ubuntu\u00a0(.torrent) This release is all about performance and stability. Some users have complained about what happens to their internet connection when using FrostWire heavily, so we\u2019ve finally added uTP support to solve\u2026","rel":"","context":"In "FrostWire"","block_context":{"text":"FrostWire","link":"https:\/\/www.gubatron.com\/blog\/category\/frostwire\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":945,"url":"https:\/\/www.gubatron.com\/blog\/new-frostwire-4171-released\/","url_meta":{"origin":3175,"position":5},"title":"New FrostWire 4.17.1 Released","author":"gubatron","date":"November 8, 2008","format":false,"excerpt":"Source FOR IMMEDIATE RELEASE: Official FrostWire 4.17.1 Download link FrostWire.com -- The last of the 4.17.x FrostWire series is finally out. The following is a list of the most important updates made for this release, which irons out most of the complains received from the community in regards to 4.17.0.\u2026","rel":"","context":"In "FrostWire"","block_context":{"text":"FrostWire","link":"https:\/\/www.gubatron.com\/blog\/category\/frostwire\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/posts\/3175","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/comments?post=3175"}],"version-history":[{"count":1,"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/posts\/3175\/revisions"}],"predecessor-version":[{"id":3176,"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/posts\/3175\/revisions\/3176"}],"wp:attachment":[{"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/media?parent=3175"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/categories?post=3175"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.gubatron.com\/blog\/wp-json\/wp\/v2\/tags?post=3175"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}