Building a world-wide nostr relay archive with the goal of providing tokenized data streams to AI-builders training nostr-search or other nostr-aware LLMs.
Public Key
npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp
Profile Code
nprofile1qqsgv3c5elzr8y9vfxtmzkmcxfa7ks2tfx8rjhsv2jhmy4dhqprn5jqpzdmhxue69uhhqatjwpkx2urpvuhx2ue0qyt8wumn8ghj7un9d3shjtnswf5k6ctv9ehx2aqn7gj7f
Author Public Key
npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Show more details
Published at
2024-04-17T21:11:34+02:00 Event JSON
{
"id": "32abcc5e1a656047b749cb8627030416a481829348fbe8da3f3d6d4843516594" ,
"pubkey": "864714cfc43390ac4997b15b78327beb414b498e395e0c54afb255b700473a48" ,
"created_at": 1713381094 ,
"kind": 0 ,
"tags": [],
"content": "{\"name\":\"Bob_stores_nostr\",\"picture\":\"https://pfp.nostr.build/f3542d6133ac3d514b2cf4652a068d19b8091c83b1ca5bcdf81b0211808e371a.png\",\"display_name\":\"Bob\",\"displayName\":\"Bob\",\"about\":\"Building a world-wide nostr relay archive with the goal of providing tokenized data streams to AI-builders training nostr-search or other nostr-aware LLMs.\",\"nip05\":\"[email protected] \"}" ,
"sig": "5c92b337505c868a80dc61ea478531701a8cea0af1f54f3154925f81ef01c1c30ee1d396026aeb7dcca672e44d682adffffb7147024d02f8ec371ae24f7eb64e"
}
Last Notes npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr I agree. I wish they could schedule... lets say, differently. I guess there is an unmet market for Bitcoin and nostr talk with live engagement in my timezone. npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr I'm not autistic, I just don't like working for other people. #nevent1q…g22e npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr Thanks! npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr It would be great if an archive could generate revenue, but honestly, my focus is on building relationships and trust with relay operators to get the data without disrupting their primary function. Once the data is coming in, then it will be down to working with people like yourself to figure out how to serve the data subset you need in the time frame you need it with the resources I have available. And if the resources are lacking, how to get them. npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr Happy to collab or learn about your use case. What subset of Nostr notes specifically would be enabling for your filter training? npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr #asknostr @npub10pe…n34f are there any resources for bootstrapping a FOSS company? I am looking for mentorship rather than funding. Thanks! npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr If you were on a limited budget, what meetup/event would you recommend attending to learn more about developing FOSS companies on nostr? npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr #asknostr what upcoming meetup opportunities are there for people developing FOSS companies in the nostr space? I want to learn which holes not to step in. Thanks! npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr #asknostr what upcoming meetup opportunities are there for people developing FOSS companies in the nostr space? I want to learn which holes not to step in. Thanks! npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr Similar to bitcoin, nostr is an open book for all to see, which I am okay with. There are easy enough ways to do pseudonymity in these open systems if you need/want it, but as you point out the asymmetry of the three letter data hoard is a problem we can begin to address. If folks require absolute privacy, I am not sure nostr is the right protocol for them. I think we should at least have open datasets where it is possible. AI frameworks are open enough but the up-to-date data is not. The tech giants are really all data hoarders and they monetize those hoards selling to advertisers, ngos, governments, and private firms. Not really much access for plebs, which will reduce the impact of pleb-driven AI tech. npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr Hi @npub1fjq…leku Just thinking here... Building search is really hard, and I am sure I am not the man for that job; however, I like to organize, analyze, and automate. I also have a large symmetric connection of which I can only really use 25% for IRL, so I thought to myself; what useful service can I create for nostr with my excess capacity? I am not sure I will be able to host a proper relay archive available to the public as managing a single large relay database would be unwieldly. It might be possible to host particular curations of the data as separate public relays, though. My main focus is segmenting and archiving the data. This seems achievable, manageable, and open to automation. I believe this will serve as a useful foundation for projects needing large nostr datasets for LLMs. I expect I can make this segmented data available as periodic updates to the public. Early stages, building out the garage data center off of local surplus in the Bay Area. npub1ser3fn7yxwg2cjvhk9dhsvnmadq5kjvw890qc490kf2mwqz88fyqdnw5rp Bob_stores_nostr #introductions Hi nostr, I am Bob. I am starting a project called Nostrchive. I have the crazy idea to collect and archive as much nostr data as possible with the goal to pre-process (collect, collate, organize, and tokenize) data for (re)training FOSS nostr-aware LLMs for nostr search. Any strfry relay operators who might consider whitelisting my archive strfry relay for negentropy connections, please reach out. I would like to identify optimal batch sizes and connection windows in UTC. Thanks for your consideration.