Case Study: Localize App Visuals & Measure Performance
On March 26, we hosted a webinar with Mélanie Mallet (ASO Specialist at Deezer) and Simon Thillay (Head of ASO at AppTweak). They each shared great insights, so we wanted to provide a recap for those who didn’t get to attend!
Part 1: How Deezer localizes visuals
In her talk, Mélanie explained Deezer’s localization strategy regarding the visuals of their app. She showed a lot of examples of A/B tests conducted by Deezer, and shared the main learnings of what worked for them, their app and their users.
- Consider adapting your creatives for your different markets
Deezer tested localized screenshots with Polish captions and generated an uplift of 4%.
Change of Deezer’s Google Play screenshots for Poland, from AppTweak’s Timeline feature.
Translating the captions on your screenshots can have a significant impact. This move allowed Deezer to create growth in a minor market where no other specific marketing efforts are being made. The experience is also easily scalable, as you can do the test over again in multiple countries, by simply translating the captions and replacing the screenshots, and identify which countries can benefit from localized screenshots.
Trying to put themselves in their users’ shoes also led Deezer to take a look at their icon.
Current Deezer Icon at the time : white background with logo and wordmark.
The 3 variations of Deezer’s icon that were tested.
It turns out that the icon with dark background and wordmark created a 6% uplift, which might be an indication of a preference for dark mode. Deezer changed their icon to reflect that, again showing that you can create growth opportunities by testing easy changes, even in markets that are usually not the main focus.
- Keep on finding new ideas to test
Even in main markets where visuals are already well-optimized, it’s important to find new ideas of tests to keep creating growth. Deezer did this by testing several elements in France, their main market.
They first tried to see if relying on current music trends would be relevant, by creating screenshots featuring current favourite artists in France. In the example below, they’re conducting a test with two well-known French-speaking artists featured on the first screenshot. They saw a 4% uplift when using one of the artists on the first screenshot.
They also used market data to find ideas to test: they used the seasonality linked to Valentine’s Day to test new creatives. They didn’t see any impact, which means they won’t need to invest any extra efforts for that event in the future.
Finally, they collaborated with other teams at Deezer to find new testing ideas. Another team at Deezer was running a promotion action giving 3 months of free subscription. They created a screenshot reflecting that action, expecting that users would be more likely to download the app if they saw they could get a few months free.
Surprisingly, that screenshot had a negative impact, with a decrease of 5%. But the point is that it’s by keeping on testing new ideas that you’re eventually going to find ones that unlock growth, even in markets where you’re already leader.
All in all, Deezer is a great example of how to leverage visual A/B testing to find new growth opportunities! You can see which other A/B tests they (or any app) have made by using AppTweak’s Timeline feature!
Part 2 : Measuring your app’s performance using data from your competitors
Simon then took the floor to share insights on how to measure your app’s performance, a topic that always creates a lot of questions.
- Define the essential ASO KPIs
The very first point that Simon made is that there are 3 essential KPIs to use in ASO, that are the “North Stars” of performance monitoring : Traffic, Conversion rates and Downloads. The whole goal of your work should be to improve those three indicators. However, your analysis of your app’s performance can be completed by looking at other metrics as well.
- Compare visibility with competitors
Traffic in itself is quite vast, and you can improve your understanding of your traffic performance by looking at a few things.
First, you should understand how your visibility compares to competitors. Comparing visibility over a list of keywords weighted by volume can help you assess exactly which app is most visible for the keywords you target.
Visibility score on a list of keywords for myCanal and competitors
Looking at the kind of keywords you are visible for and that are bringing you downloads is equally important, to understand if you and your competitors rely mostly on brand keywords to get downloads or not. This will help you identify opportunities : you’ll be able to better understand how to compete with them and which keywords to target. You might find that in a specific country, a local competitor has such a strong recognition that your brand doesn’t bring you a lot of downloads. In that case, just being ranked well on your brand wouldn’t be a sign of great performance : you could target more generic keywords and increase your traffic.
- Analyze Browse traffic
Another thing you should be looking at is the share of Browse traffic for your app. This can be key to understand sudden changes in traffic, or disparities between competitors.
For example, you can see on the screenshot below that Netflix had a huge boost of traffic in February from being represented in other app’s Similar App section, and that Hulu had a temporary boost in March. This is crucial to correctly understand how your competitors are doing and benchmark your own app accordingly.
- Benchmark against your category
Regarding conversion rates, it’s always important to look at the benchmark for your category.
Otherwise, you might consider your own performance as good or bad, without taking into account the specific difficulty (or lack thereof) of your own category. It can be hard to find that data for competitors, but Google Play actually provides a benchmark for organic conversion rate. AppTweak also provides category benchmarks for Apple and Google.
Example of conversion rate benchmark per category on AppTweak
Using Google Play Peer Groups is also a great way to understand how your app’s quality compares to competitors, which also impacts conversion, and ASO in general. You can yourself select competitors that you want to include in the Peer Group, to help you compare performance of App Ratings and Android Vitals, as shown below
In brief, there are a lot of ways to complement your analysis of your app’s performance. We strongly recommend looking at all the metrics mentioned above, if you want a complete understanding of how your app is doing.
We hope you learned something by reading this article! If you want to re-watch some of our webinars, we’ve made our most popular ones available on our Webinar page.
We’ll be doing more, so stay stuned!
In the meantime, if you want to try some of the features and analysis described here, feel free to sign up a for a free trial of the platform.