Interpreting smoke test results
Looking for early market validation re our startup idea, we did a simple smoke test: we created a facebook ads campaign, linked it to a launchrock page and looked to see what happened. We set a $20 daily budget and here came the results for our first day:
- On facebook : 139 clicks, click rate 0.039%
- On launchrock : 49 page views, 8 signups, 16.33% conversion rate
I've got 2 questions:
- Where did the 139-49 = 90 missing clicks go? Is facebook stealing from us?
- How good/bad are these numbers? Any valid point of comparison out there?
-
One day isn't enough to validate an idea. Run the campaign for at least a week. – Dnbrv 13 years ago
-
On the missing page views - how are you measuring them, Google Analytics? Have you taken account of a) GA is up to 4 hours behind on processing stats and b) Days may not be the same due to time zone differences. Eg. if GA account is set to GMT-8 but Facebook is GMT then you will b missing 8 hours if you filter for a particular date. All guesses! – Ryan 13 years ago
-
I would have to disagree on the time criterium here: the only thing that really counts is how many people you reach, since our simple hook is not likely to create any viral effect (ie: we're not in a situation where the total time of exposure matters). Only thing that counts, I think, is the number of impressions. – Guidupuy 13 years ago
2 Answers
Where did the clicks go? It's probably not really something to be worried about, and in the end, you may need to just accept a difference as a part of life.
There are lots of things that lead to inconsistencies like this. As Ryan pointed out, delays in processing and timezone changes could easily be the problem.
I have a website with Google Ads, and also on that site, I have StatCounter. Sometimes, StatCounter tells me I have a certain number of clicks that went to Google Ads, but Google only shows 1/3 of that. I looked into it and discovered that there can be quite a bit of difference in clicks and page loads with things like this. For example:
- If a person clicks on a link, and then, before the page can fully load, they realize they didn't mean to click it and push the browser's Back button, you'll get a click without a page load.
- Launchrock may not count it as a page load if the same person loads the page twice in a row.
- Launchrock may be keeping track of your IP address, and not counting your clicks. If a lot of them were yours, they may not be counting.
My point is not to enumerate all possible things that could be causing the inconsistency, but rather, to illustrate that there could be valid reasons why there's a difference. Even a substantial difference.
How do these numbers compare? dnbrv is right, one day isn't enough to go by.
I'm saying this completely out of the blue, but if you have 16% of people signing up (for an email list, I'm assuming?) that seems pretty decent to me, considering you've provided absolutely no value to them, just a hook.
The average conversion rate for going from first visit to purchase is along the lines of 0.5% to maybe 2%. It is really impossible to say how your really compares to that, since we don't know all of the details, and also, it doesn't sound like you've asked people to spend money yet.
I'd caution you that any comparison to other people's conversion rates is like comparing apples to oranges. There are just too many variables involved to truly compare them, so only do so carefully.
I did a facebook ad campaign last fall for our student consulting firm. We spent 50€ (app. 66$) over 6 weeks. We had 500.000 Impressions and a CTR of 0.17%. The important thing I noticed was, that after a while (2 weeks) the numbers got better and better. I think if the campaign would have gone any longer the result would be even better. Hope this helps to interpret your numbers.
