At Pushwoosh, we firmly believe that user segmentation directly impacts both revenue and engagement. To validate this, we analyzed 50 billion mobile push notifications sent via Pushwoosh in Q4 2024 across the following verticals: eCommerce, retail, news, gaming, transportation, and finance.
Our initial hypothesis was: “User segmentation consistently leads to higher push open rates.” To test this, we first examined the verticals that sent the highest volume of broadcasts most frequently — news, media, and eCommerce apps.
Broader segmentation outperforms no segmentation
We started by narrowing our focus:
- News apps, which frequently send broadcasts to their entire user base.
- eCommerce and retail apps, which often use broad segmentation based on factors like gender or country.
Our analysis revealed that a broad segment — “all women” — comprised 70% of one app’s user base. Despite its wide reach, messages sent to this segment achieved a 3x higher open rate compared to those broadcast to the entire audience.
Category | Retail | News & Media | E-commerce |
Segment | All users = 8M | All users = 9.1M | All women = 6.2M |
Open rate | 0.08% | 0.15% | 0.47% |
Still, the difference wasn’t as significant as we had anticipated. So, we decided to dig deeper.
Narrow segmentation leads to a higher open rate compared to broader segmentation
We often hear from our customers that send-outs based on user interests yield higher open rates. With this in mind, we refined our hypothesis: “More precise user segmentation leads to higher open rates compared to broader segments (e.g., men/women, country/language).”
To test this, we first analyzed eCommerce apps. Messages sent to more narrowly defined, interest-based segments achieved a 10x higher open rate compared to broader segmentation.
Segment | Country = 6.3M | Country + gender (women) = 4.7M | Country + interest (PS5) = 6.3K |
Open rate | 0.97% | 1.72% | 10.36% |
We observed the same results when we repeated the experiment with apps from different categories.
Transportation apps:
Segmentation criteria | All users | City | One specific service users | Favorite supermarket |
Open rate | 0.84% | 1.07% | 2.13% | 4.56% |
News and media apps:
Segmentation criteria | All users, global media | All users, local media | Country | Country + topic | Town |
Open rate | 0.0001% | 0.60% | 1.99% | 3.32% | 16.25% |
Here, we noticed varying levels of engagement between local and global media. The more localized and personalized the news, the higher its potential open rate.
When analyzing financial apps, we observed a drastically different approach to segmentation. In our previous research, we found that financial apps had the highest opt-in and open rates across all categories. Now, we could see why—every financial app we examined exclusively sent segmented messages.
Segmentation criteria | All KYC | KYC + location + language | Inactive users | Active users + app version |
Open rate | 0.27% | 0.62% | 6.87% | 9.35% |
We had gathered enough evidence to confirm our second hypothesis—this time with significant insights:
- Not all segmentation criteria yield the same results.
- The smaller the segment, the higher the potential open rate.
- Location- and interest-based segmentation drive higher open rates compared to other criteria.
However, we uncovered something unexpected. The same news, when framed differently—as a statement vs. a question—resulted in noticeably different open rates.
- News framed as a statement: 1.51% open rate
- News framed as a question: 2.07% open rate
Could it be that content, not just segmentation, plays a key role in driving push open rates?
Content without a clear call to action ruins open rates
We decided to analyze the relationship between content and segmentation criteria to identify any dependencies.
For our first experiment, we focused solely on retail apps.
The results were clear: generic announcements had lower open rates, while content tailored to user interests — such as updates from a user’s favorite store — achieved the highest open rates.
Segment | All users | All users | Country | Language | Favorite store |
Content | Announcement | Discount code | Announcement | Discount code | Sale in your favorite store |
Open rate | 0.3% | 0.39% | 1.35% | 1.46% | 3.9% |
Could it be that content without a clear call to action lacked the motivation needed to drive clicks?
Across retail apps, we observed that messages with vague or ambiguous content had lower open rates compared to those with a clear call to action.
Segment | All users | Users of one specific service | Favorite supermarket |
Content | Giving Tuesday | Bonus offer related to the service | Offline discount code |
Open rate | 0.84% | 2.13% | 4.56% |
To validate our findings, we decided to reverse-test, comparing the performance of the same content when delivered to different segments.
Category | Transportation | Transportation | Fintech | Fintech |
Segment | City + non-registered users | City + registered users | All KYC users (EN) | KYC users + language |
Content | New service offer | New service offer | Money transfer offer | Money transfer offer |
Open rate | 0.22% | 0.91% | 0.23% | 0.58% |
We assumed that users who invested time in setting up their accounts — completing KYC, selecting their city, language, favorite team, etc. — would be more engaged over time.
For our third experiment, we focused on a category where users typically spend no time on account setup: Match-3 and puzzle games. The games we analyzed often sent similar or, at times, vague messages.
Segmentation criteria | All users | All users | Active users | App version |
Content | 1.5x gems | 2x gems | Use bonus tools | Unique prizes |
Open rate | 0.30% | 0.56% | 1.83% | 3.20% |
We found no clear correlation between segmentation, content, and open rates.
However, the experiment confirmed that users who invested time in setting up their accounts were more engaged. But this raised a new question: why did similar content perform so differently?
Our experiments didn’t yield meaningful results—until we shifted our focus from segmentation alone to analyzing the impact of days of the week.
Sending a push on the wrong day can drop the open rate by at least 2x
As B2B marketers, we typically prefer sending communications on Tuesdays and Wednesdays. For B2C, however, our initial hypothesis was:
“Users are more likely to open push notifications on weekends.”
We were wrong. Monday turned out to be the highest-performing day for mobile push opens. Our theory? In the first half of Monday, users tend to scroll more before fully diving into work.
The only exception was transportation apps, which saw the highest engagement on Sundays, likely due to increased travel.
On the other hand, Thursday was the worst-performing day for push notification opens across all categories we studied. Our guess? Wednesdays and Thursdays are typically the busiest workdays, leaving users with less time to engage with apps.
Industry | Mon | Tue | Wed | Thu | Fri | Sat | Sun |
eCommerce & retail | 1.55% | 1.07% | 1.02% | 0.94% | 1.41% | 1.50% | 1.49% |
News | 0.04% | 0.03% | 0.04% | 0.03% | 0.03% | 0.04% | 0.05% |
Finance | 14.66% | 14.49% | 13.59% | 7.81% | 10.86% | 17.96% | 13.26% |
Transportation | 0.56% | 0.46% | 1.17% | 0.71% | 0.82% | 0.57% | 2.79% |
Gaming | 2.62% | 1.14% | 1.82% | 1.71% | 1.76% | 1.95% | 2.17% |
This experiment showed that the same message — such as one for a Match-3 game — could generate varying levels of engagement depending on the day it was sent.
Segmentation | Active users | App version | All users |
Day of the week | Friday | Saturday | Sunday |
Content | Use bonus tools | Unique prizes | 2x gems |
Open rate | 1.83% | 3.20% | 0.56% |
Combining the right day with the right content can be just as effective as broad segmentation.
Personalization can drive better results than broader segmentation
We noticed that one retail app consistently achieved significantly higher open rates compared to other retail broadcasts.
What set this app apart?
Personalization. Some of its messages directly addressed users by their [first_name] — a small yet impactful detail.
Push content | Without personalization | With personalization [first_name] |
Open rate | 2.68% | 5.22% |
Sometimes, personalization outperforms broad segmentation in driving better results.
Conclusion
Our hypothesis — “user segmentation alone leads to higher push open and click rates” — did not hold true.
Broader segmentation (e.g., by country or gender) can yield similar results to broadcasting the right content, with personalization, on the right day.
However, user interests and location (such as town or region) are the segmentation criteria that drive the most engagement. For even better results, segmentation should be reflected in the content itself—for example, Barcelona FC fans receiving updates about their favorite team. Many Pushwoosh customers have adopted this approach, starting with onboarding and notification opt-in.
As a side insight, our research suggests that email is a more effective channel than mobile push for apps and games, with an average open rate of 33% for email compared to just 0.3% for mobile push. We also observed this trend in a case from one of our fintech customers — but that’s a topic for our next study.