From 16c66acb0cd0df7c7726c90ea692a412404d1e11 Mon Sep 17 00:00:00 2001 From: Michael Matloka Date: Fri, 20 Sep 2024 15:59:08 +0200 Subject: [PATCH 1/5] Product Analytics Q4 2024 objectives --- .../teams/product-analytics/objectives.mdx | 67 +++++++++---------- 1 file changed, 33 insertions(+), 34 deletions(-) diff --git a/contents/teams/product-analytics/objectives.mdx b/contents/teams/product-analytics/objectives.mdx index 078b8451d2ed..04e86ad515ea 100644 --- a/contents/teams/product-analytics/objectives.mdx +++ b/contents/teams/product-analytics/objectives.mdx @@ -1,34 +1,33 @@ -### Q3 2024 objectives - -1. Rock-solid analytics (Thomas + Julian + Sandy + Anirudh) - - 1. Legacy Minus – removing legacy insights code so that we can move fast - - FilterType gone from the frontend. - - rm -rf posthog/queries/ - - Experiments ported to HogQL. - - All the flags from HogQL/querying work. - 2. Tests Plus – shipping fewer bugs in the first place - - Ensure we test with the feature flags that users actually experience, both in end-to-end and integration tests. - - When shipping changes to queries, replay old vs. new version on thousands of real queries to check for regressions. - 3. Metrics Plus – catching issues before before users report - - Analytics performance dashboard in Grafana (query duration, failures, etc.). Paging alerts on critical metrics, e.g. if the number of queries drops rapidly, or failures rise. - - Analytics experience dashboard in PostHog (time till data available, result freshness across insights and subscriptions, refreshes initiated manually vs. automatically, etc.) - - Alerts on major Product Analytics errors from Sentry, and us acting on every alert. (Bonus: checking up the Sentry routing rules for the #product-analytics team.) - - Cohorts dashboard in Grafana (successful vs. failed calculations per day, recalculation backlog). Alerts here too. - 4. Performance Plus - eliminating UX pain via maximum query performance/reliability, based on Metrics Plus data - - Partial calculation of multi-day time series results - - …and more – work with Team Query Performance to find the lowest-hanging fruit, similarly to [Tim's performance mega issue](https://github.com/PostHog/posthog/issues/22413) - 5. Support Plus – sparking joy for users when they’re led to report a bug - - 1 hero + 1 sidekick - - Goal: 90% of tickets fulfill the SLA -2. Answering more product questions, deeper (Thomas + Julian + Sandy + Anirudh) - 1. Growth Plus - increasing ease of onboarding, and subsequent retention - - Identify growth opportunities working with Anna, our product manager – implement growth optimizations and track their impact whenever possible. - - Work with Team Growth on optimizing the onboarding experience of Product Analytics. - 2. Analysis Plus - answering more product questions, more deeply - - Analytics alerts are out to users (implemented with the contributor) - - “Done for the first time” in Trends, to kill the janky First Time Event Plugin - - Query in new insight URL for instant insight sharing - - Optional funnel steps - - ...and more, based on user feedback - see the [most requested features in GitHub](https://github.com/PostHog/posthog/issues?q=is%3Aissue+is%3Aopen+label%3Ateam%2Fproduct-analytics+sort%3Acomments-desc) -3. ArtificialHog (Michael + Georgiy) – an LLM-based chat-like interface for answering product questions. +### Q4 2024 objectives + +1. Legacy 0x - Thomas owning + - All insights are `query`-based + - `rm -rf posthog/queries/` + - Insight query is stored in the URL for instant sharing of unsaved insights + +2. First-class environments - Michael owning + - Environments are rolled out to everyone + - We've validated environments are useful for customers small and large + +3. Threshold-based alerts - Anirudh owning + - All users get to set up alerts on PostHog metrics + - Alerts are launched with Marketing, and positioned into paid plans + - We're using alerts ourselves for key trends and funnels + +4. Flexible funnels - Sandy owning + - UDF funnels rolled out to everyone, unlocking arbitrary complexity + - Allowing parts of funnels to be unordered. No more separation between regular, unordered, and strict funnels + - Optional funnel steps + +5. 10x onboarding and ease of discovering features - Anirudh and Sandy owning + - We run an excercise in implementing PostHog in a hobby project. What stands out as painful or unclear? + +6. Max AI 0.1 to 10 - Michael and Georgiy owning + - We get to an LLM-based product manager as a service + +7. User delight 2x - support rotation owning + - Support is 1 hero + 1 sidekick + - Every week support folks ship those small requested features (see [list of requests so far](https://docs.google.com/spreadsheets/d/1-lXjfzo6313Ai2vMf6smmoA0zghitBQTRD4lPgZ-XqA/edit?gid=0#gid=0)) + - Goal: 90% of tickets fulfill the SLA + +See [our internal Q4 planning doc](https://docs.google.com/document/d/15pATJU0rYxl5LN9LRLfzPVFmcYT1OIFl1cOQwZmnjKA/edit) for the discussion that led us here. From 2f93c7e6495d77a6417fd1f99d7a33b203d75e2d Mon Sep 17 00:00:00 2001 From: PostHog Date: Fri, 20 Sep 2024 14:01:58 +0000 Subject: [PATCH 2/5] Fix typos --- contents/teams/product-analytics/objectives.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/contents/teams/product-analytics/objectives.mdx b/contents/teams/product-analytics/objectives.mdx index 04e86ad515ea..e600f4f4d2d4 100644 --- a/contents/teams/product-analytics/objectives.mdx +++ b/contents/teams/product-analytics/objectives.mdx @@ -20,7 +20,7 @@ - Optional funnel steps 5. 10x onboarding and ease of discovering features - Anirudh and Sandy owning - - We run an excercise in implementing PostHog in a hobby project. What stands out as painful or unclear? + - We run an exercise in implementing PostHog in a hobby project. What stands out as painful or unclear? 6. Max AI 0.1 to 10 - Michael and Georgiy owning - We get to an LLM-based product manager as a service From 778d53ecadc98e2f09af5b04484674d555503ae6 Mon Sep 17 00:00:00 2001 From: Anna Szell <44681388+annaszell@users.noreply.github.com> Date: Fri, 20 Sep 2024 17:21:24 +0200 Subject: [PATCH 3/5] Update objectives.mdx --- contents/teams/product-analytics/objectives.mdx | 3 +++ 1 file changed, 3 insertions(+) diff --git a/contents/teams/product-analytics/objectives.mdx b/contents/teams/product-analytics/objectives.mdx index e600f4f4d2d4..368b600efdf3 100644 --- a/contents/teams/product-analytics/objectives.mdx +++ b/contents/teams/product-analytics/objectives.mdx @@ -30,4 +30,7 @@ - Every week support folks ship those small requested features (see [list of requests so far](https://docs.google.com/spreadsheets/d/1-lXjfzo6313Ai2vMf6smmoA0zghitBQTRD4lPgZ-XqA/edit?gid=0#gid=0)) - Goal: 90% of tickets fulfill the SLA +8. B2B analytics research - Anna owning + - Understand the market and user needs better in order to improve our current Group analytics product next quarter + See [our internal Q4 planning doc](https://docs.google.com/document/d/15pATJU0rYxl5LN9LRLfzPVFmcYT1OIFl1cOQwZmnjKA/edit) for the discussion that led us here. From 5925580767c0e4ef9214ea135f41b2c4562fc5dc Mon Sep 17 00:00:00 2001 From: Michael Matloka Date: Wed, 2 Oct 2024 15:26:17 +0200 Subject: [PATCH 4/5] Take Max out --- contents/teams/product-analytics/objectives.mdx | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-) diff --git a/contents/teams/product-analytics/objectives.mdx b/contents/teams/product-analytics/objectives.mdx index 368b600efdf3..47a9a5c55280 100644 --- a/contents/teams/product-analytics/objectives.mdx +++ b/contents/teams/product-analytics/objectives.mdx @@ -22,15 +22,12 @@ 5. 10x onboarding and ease of discovering features - Anirudh and Sandy owning - We run an exercise in implementing PostHog in a hobby project. What stands out as painful or unclear? -6. Max AI 0.1 to 10 - Michael and Georgiy owning - - We get to an LLM-based product manager as a service - -7. User delight 2x - support rotation owning +6. User delight 2x - support rotation owning - Support is 1 hero + 1 sidekick - Every week support folks ship those small requested features (see [list of requests so far](https://docs.google.com/spreadsheets/d/1-lXjfzo6313Ai2vMf6smmoA0zghitBQTRD4lPgZ-XqA/edit?gid=0#gid=0)) - Goal: 90% of tickets fulfill the SLA -8. B2B analytics research - Anna owning +7. B2B analytics research - Anna owning - Understand the market and user needs better in order to improve our current Group analytics product next quarter See [our internal Q4 planning doc](https://docs.google.com/document/d/15pATJU0rYxl5LN9LRLfzPVFmcYT1OIFl1cOQwZmnjKA/edit) for the discussion that led us here. From fb3eedfe348a8f15422d87ef8e91efb63ac58b9e Mon Sep 17 00:00:00 2001 From: Michael Matloka Date: Wed, 2 Oct 2024 15:26:52 +0200 Subject: [PATCH 5/5] Reduce scope of environments --- contents/teams/product-analytics/objectives.mdx | 1 - 1 file changed, 1 deletion(-) diff --git a/contents/teams/product-analytics/objectives.mdx b/contents/teams/product-analytics/objectives.mdx index 47a9a5c55280..f6aa9ee28d04 100644 --- a/contents/teams/product-analytics/objectives.mdx +++ b/contents/teams/product-analytics/objectives.mdx @@ -7,7 +7,6 @@ 2. First-class environments - Michael owning - Environments are rolled out to everyone - - We've validated environments are useful for customers small and large 3. Threshold-based alerts - Anirudh owning - All users get to set up alerts on PostHog metrics