
I will be talking about a method that I actively use and that I think is very useful as a result of the guidance I have given to my own team. You can apply this method to your own business somehow. ☺️
When tackling complex business questions, a structured and hypothesis-driven approach to data analysis is crucial. By breaking down the problem into smaller, manageable parts, we can identify the root cause of an issue and develop actionable insights. 🚀
In this article, we will explore how to systematically address a business problem (which has happened before 👀) using data, focusing on a step by step approach that starts with the big picture and gradually narrows down to specific details.
The problem is brought to the data team as follows:
Before diving into the analysis, it is essential to visualize the user's journey through the funnel. By understanding the key stages of the funnel, we can systematically ask the right questions to identify where drop-offs or issues occur.
The funnel typically includes:
By breaking down the funnel into these stages, we can focus our analysis on specific areas and uncover potential issues impacting performance.
When a business problem arises, such as a decline in sales, it is essential to determine whether the root cause is external or internal. This decision framework helps guide the analysis:
External Factors:
1.1 → Supply Issues: Has there been a change in the availability of products?
1.2 → Demand Changes: Has customer demand for the products decreased due to market trends, economic conditions, or seasonality?
Internal Factors:
2.1 → System Changes: Have there been any changes to the platform, pricing, promotions, or algorithms?
2.2 → User Behavior Changes: Has user behavior changed despite no internal changes? For example, users may have shifted their preferences or purchasing patterns.
If no external factors are identified, we then proceed with a deeper analysis of internal factors. This involves examining the user experience, platform performance, and the impact of any recent changes to identify potential internal issues that might be causing the observed problem.
We can follow the steps below to address whether the internal flows are system related or the user experience has changed. 🚀
Hypothesis: The drop in sales may be due to reduced traffic from one or more key channels.
Questions Answered:
Insight: The most significant decline is in organic search traffic, which may indicate SEO issues or decreased search visibility.
Next Step: Since SEO is identified as an issue, we should now investigate which platform (e.g., mobile app, desktop) is experiencing the problem.
Hypothesis: One platform (e.g., mobile app, desktop) may be underperforming compared to others.
Questions Answered:
Insight: Desktop traffic has experienced the largest decline, suggesting potential issues with the desktop experience or conversion.
Next Step: With desktop identified as the problem area, we should analyze which key pages on the desktop platform are underperforming.
Hypothesis: Key pages (e.g., homepage, product detail pages) may be experiencing performance issues.
Questions Answered:
Insight: The decline in product detail page traffic suggests a potential issue with user engagement or product visibility.
Next Step: Given the issue on the product detail page, we should examine user engagement metrics to understand why users are dropping off.
Hypothesis: Users may be dropping off due to poor engagement on key pages.
Questions Answered:
Insight: A rising bounce rate and reduced average time on page indicate that users may not find the content engaging or relevant.
Next Step: We should now investigate if any specific components on the product detail page are contributing to this issue.
Hypothesis: Specific components on key pages (e.g., recommendations, ads, banners) may be underperforming.
Questions Answered:
Insight: The significant drop in recommendations CTR suggests that the recommendation engine may not be displaying relevant products.
Next Step: If the issue lies in recommendations, we should evaluate recent changes to the recommendation algorithm or logic. After evaluating the changes, we should conduct a monthly breakdown analysis to determine if there were specific months where performance dropped. This will help us pinpoint the exact timing of the issue and identify any other contributing factors or changes made during that period.
Hypothesis: Issues in payment methods or checkout flows may be causing drop-offs.
Questions Answered:
Insight: The decline in digital wallet payments and overall checkout conversion rate suggests a potential issue with the digital wallet experience.
Next Step: If a specific payment method is not boosted for recommendations, detailed analysis can be done based on payment flows (such as users' payment intervals), but the first priority may be monthly reco analysis.
Hypothesis: Identifying the specific month when the decline started can help pinpoint potential causes.
Questions Answered:
Insight: The decline appears to have started in April and accelerated in the following months.
Action: Review changes made during the critical months (April to June), such as:
By addressing these specific changes, we can determine which factors contributed to the decline and identify corrective actions.
By following a structured, hypothesis-driven approach that starts with the big picture and gradually narrows down to more granular details, data analysts can effectively identify the root cause of business problems.
This method not only helps in uncovering insights but also provides a roadmap for developing actionable solutions.
Ultimately, the choice of specific tools and methods should align with the unique needs and complexity of each project, ensuring the most effective outcomes.
Thank you for your time; sharing is caring! 🌍