Lol, yea.
I mean, for Damus/Primal, I would go with the couple of the composite metrics as a bundle to keep track of for the longer progress. I don't think you can come up with a single north star bullet metric. But there is somewhat clear hierarchy in the quality of the metrics, and their proximity to LTV.
Ex.
- Unique users with a click (comment, zap) are better than total clicks (comments, zaps)
- zap is better than like
For individual iterations, I'd still lean more into UX feedback and product intuition.
The composite metric might be
Distinct(npub HAVING (note + comment + like + zap)>0
You can do >1; >10; >100, and over different time frames, to measure higher, and more repetitive and lasting levels of engagement.
...
At different stages of the product, you want to use diffently advancing metrics. The simple ones are good for the start, but can be skewing you towards the cheap engagement baits. At more advanced stages, you want to counterbalance them with even more quality, and that gets progressively harder to define and measure.
Camper
npub1klj…t938
2024-05-18 19:18:49
in reply to nevent1q…j3w9
Author Public Key
npub1klj98ahaaduuegwcd7lscjeqa0h2680f75r82gnr35pua8ls36xqh9t938Published at
2024-05-18 19:18:49Event JSON
{
"id": "3e20bee314481fcab8a3ab5b00c164e5e4ae2344f553de391f5e8334ca3cd90c",
"pubkey": "b7e453f6fdeb79cca1d86fbf0c4b20ebeead1de9f5067522638d03ce9ff08e8c",
"created_at": 1716052729,
"kind": 1,
"tags": [
[
"e",
"20b35a37565901ca47f4cc50ae2fb86ba61070db71ce7182bbf35e1ac9c90bad",
"",
"root"
],
[
"e",
"17b021c0025aa6b0bf5d1b09f78677da7b61d8b52e6b5aec2634e8dd98af17c0",
"",
"reply"
],
[
"p",
"04c915daefee38317fa734444acee390a8269fe5810b2241e5e6dd343dfbecc9"
],
[
"p",
"df67f9a7e41125745cbe7acfbdcd03691780c643df7bad70f5d2108f2d4fc200"
],
[
"p",
"b7e453f6fdeb79cca1d86fbf0c4b20ebeead1de9f5067522638d03ce9ff08e8c"
]
],
"content": "Lol, yea.\n\nI mean, for Damus/Primal, I would go with the couple of the composite metrics as a bundle to keep track of for the longer progress. I don't think you can come up with a single north star bullet metric. But there is somewhat clear hierarchy in the quality of the metrics, and their proximity to LTV.\n\nEx.\n- Unique users with a click (comment, zap) are better than total clicks (comments, zaps)\n- zap is better than like\n\nFor individual iterations, I'd still lean more into UX feedback and product intuition.\n\nThe composite metric might be \nDistinct(npub HAVING (note + comment + like + zap)\u003e0\n\nYou can do \u003e1; \u003e10; \u003e100, and over different time frames, to measure higher, and more repetitive and lasting levels of engagement.\n\n...\nAt different stages of the product, you want to use diffently advancing metrics. The simple ones are good for the start, but can be skewing you towards the cheap engagement baits. At more advanced stages, you want to counterbalance them with even more quality, and that gets progressively harder to define and measure.\n\n\n\n",
"sig": "0406b973cb7a2fa881dbb65238587746f87f97ffcccfd4d2fd41449d8d762d0a13000fd74d39454466f10230f6602c96fdabd4bc3aba9cdf9fceb3ebe28c839a"
}