dcs
dave

The two relays I operated have gone kablooie from the internet.
I had been contemplating shutting them down because the vast majority of the traffic seems to be scrapers, and I can't afford to run a VPS to serve useless noise.
In the process of moving the data to another, smaller VPS, I accidentally deleted the files, and there's no backup. So much for that plan!
I don't think I'll run another relay. Altruism isn't appreciated -- people just want a place to spam and/or hoover up all the data.
Unfortunately, the scrapers continue to hammer the server, trying to connect. They seem not smart enough to give up on a relay that isn't responding. I hope they eventually do.

2023-04-27 19:38:52

- reply

My idea is that cities are unsustainable, open air prisons, and anybody with sense should escape before it's too late.

2023-04-19 20:35:53

- reply

Ok, yes. aionostr can do that. It should automatically reconnect to relays.
Let me know if you need help.

2023-04-19 18:45:03

- reply

Use nostr-bot instead ;) https://github.com/davestgermain/nostr_bot

2023-04-19 18:08:45

- reply

yup!

2023-04-19 18:08:19

- reply

Even if you use a pseudonym, a determined agency can find out who and where you are.

2023-04-19 18:05:58

- reply

I don't think so.
He disappeared from twitter, too. Maybe they got to him. :(

2023-04-19 17:40:01

I wonder if #[0] left nostr because he realized it's trivial for the NSA to hoover up the whole firehose of traffic and probably geolocate anybody they wanted to.

2023-04-10 22:41:41

New Rule:
Every creature deserves the right to a restful night's sleep, uninterrupted by the lights, noises, and radiation from industrial civilization.

2023-04-08 19:42:06

Returning after several weeks, every nostr client seems broken – feeds aren't loading or clients aren't displaying anything.
Ah well. I'm going for a walk.

2023-03-10 13:43:03

- reply

How does one leave? Other countries only want rich immigrants.

2023-03-09 23:14:10

- reply

Unfortunately, there seems to be little resistance to it in the US. I think the past several years of psyops have neutralized much of the population.

2023-03-09 22:56:23

- reply

I like the web of trust model, but how does it accommodate new users?

2023-03-09 22:54:37

- reply

I’m not sold on POW because if it can be automated, the spammers will eventually implement it.
My relays already throttle unauthenticated clients, and double the throttling each time an unauthed client tries to save an event. This mitigates some spam, since the spammers haven’t figured out authentication, yet.
Spammers demonstrate that they’re willing to waste resources — they will keep retrying infinitely, even if the event is rejected each time. Automated IP blocking might be the best tool.

2023-03-09 22:30:09

- reply

Embedding the note didn’t work as I expected. *sigh*

2023-03-09 22:29:17

I also think it’s important for public relays to exist, for people who can’t or don’t want to pay, or for new accounts with no social network.
I would prefer to implement features that mitigate automated spam, while remaining open to human users. Adaptive throttling is already implemented. What other ideas are effective?
note1n694et2k56xdx8mhpt6hxkm97m823ry6s7nruz00hd8egl89hs2qcmntl9

2023-03-09 22:20:49

The next feature I’ll add to #python nostr-relay will be “dynamic allow lists”, so that relay operators can specify nostr queries, and every “p” tag in the returned events will be allowed to post to the relay.
This is a generalization of the “friend of a friend” feature. It would allow for many other policies, based on whether a user has paid, or some other rule I can’t imagine.
https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/foaf.md

2023-03-09 21:28:28

The TwitterFiles have revealed a vast censorship industrial complex, involving collusion between governments, corporations, academia, media, and NGOs.
Institutions are waging information warfare against their own citizens.
People are earning high salaries as censors or “internet hall monitors”, and they all seem to think they’re doing something important and good.
It’s the banality of evil.

2023-03-09 16:33:10

I wish clients did a better job of indicating whether and where an event was saved. I often hit "send", and then the event seems to go nowhere. That's frustrating.

2023-03-09 16:17:32

- reply

python nostr-relay supports NIP-26...

2023-03-09 16:14:51

- reply

If I understand the SimpleX protocol, this program translates the concept to nostr. The sender creates a new conversation key and directs recipients to a relay of their choosing.
https://gist.github.com/davestgermain/12974fef590fc1edf12e9a25b9dfa7b5#file-safe_dm-py-L82

2023-03-08 14:32:14

#[0]

2023-03-08 14:22:05

- reply

Hot on the heals of 1.12, I hacked up a demo mode that will run a relay using a tuned config file:
pip install -U nostr-relay
nostr-relay --try-fast
And in another terminal:
aionostr bench -c 4
Let me know what results you get!

2023-03-08 13:00:13

Big release for #python nostr-relay today!
* Added full-text index, compatible with NIP-50
* Added the purple server – the fastest way to serve nostr websockets...
* Added validator to limit "hellthreads"
* Enabled NIP-05 identity provider for LMDB backend
* Made many micro-optimizations to the LMDB backend and json handling.
* Improved compatibility with python < 3.11
* Consolidated and improved query validation
Changelog: https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/CHANGELOG.md
And a new document on performance tuning tips: https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/performance.md

2023-03-04 16:15:18

- reply

Also implemented here: https://code.pobblelabs.org/fossil/nostr_relay/info/a78d8cf73becb166

2023-03-03 19:34:00

- reply

That’s a neat idea. One issue is that everyone would know that you’ve communicated with the bot, because DM metadata is not private.

2023-03-03 19:08:29

- reply

I would think so. I started aionostr because I wanted an async API that was also easy to use and understand. Async seems to be the better choice for nostr use cases.
As a result, with nostr_bot, it's easy to write all sorts of bots, and run them simultaneously.

2023-03-03 18:34:32

- reply

nostr_bot would be the more appropriate tool to extend.
I've already written a bot that will mirror events from people you follow. If someone wants to make it more generic, the framework allows for easy extensibility.
https://github.com/davestgermain/nostr_bot/blob/master/nostr_bot/examples/mirror.py

2023-03-03 17:54:13

- reply

It only mirrors an individual query. It doesn't attempt to page through to the beginning of time.
Would that be useful?

2023-03-03 16:56:48

New version of aionostr supports the `naddr` type.
So you can run this to retrieve the event:
aionostr get naddr1qqqqzxrhwden5te0wfjkccte9eekummjwsh8xmmrd9skcq3qljxdldrq885zamfkn82k7zcjs4lrsf9wykrh9e3hq4thh89vlzxsxpqqqp65wyu9u7v
https://pypi.org/project/aionostr/

2023-03-03 16:27:08

- reply

But they can't force anybody to see the ads, as long as clients only show you pubkeys you follow.

2023-03-02 16:51:14

#python nostr-relay 1.11.5 released:
* Support prefix id and author searches
* Several micro-optimizations in the LMDB backend
* Configurable max_limit to limit the number of events returned per REQ. (default: 6000)
* Made Homeserver more reliable
* Simplified storage of verification status
https://pypi.org/project/nostr-relay/

2023-03-02 03:09:17

- reply

python nostr-relay was the first one to support NIP-42.
Just sayin'
https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/authentication.md

2023-03-01 22:26:38

USGS has a nice web tool for making custom topographical maps of the US.
(I wish my local library could print out the 24x29" pages)
https://topobuilder.nationalmap.gov

2023-03-01 21:56:51

I'm testing my own inbox/outbox style private relay, as described here: https://code.pobblelabs.org/fossil/nostr_relay/wiki?name=Homeserver

2023-03-01 21:19:35

I switched wss://bhagos.org/ to LMDB
It's a small VPS, located in Finland. Anyone who is a friend-of-a-friend of me (and several others) can post there. About 9,000 pubkeys are whitelisted...

2023-02-28 17:32:46

- reply

I'd be curious how it holds up to lots of traffic, but it's a small VPS that I can't afford to upgrade.

2023-02-28 17:09:37

- reply

Earth has higher resolution

2023-02-28 17:06:39

- reply

relay-pub.deschooling.us uses LMDB. It doesn't get much traffic right now.

2023-02-28 17:01:40

- reply

Why not use a load balancer?

2023-02-28 17:00:50

- reply

London is the same latitude as northern Newfoundland. Pretty wild.

2023-02-27 15:13:35

"Mankind will not be free until the last general is strangled with the entrails of the last systems-analyst. As my sainted grandmother used to say."
– Edward Abbey

2023-02-27 02:35:12

- reply

I'm not interested in writing that feature, but if somebody else wanted to, it should be fairly straightforward to implement as an extension.

2023-02-25 19:26:42

- reply

What would that look like?

2023-02-22 03:04:19

- reply

Yes, all relevant NIPs are supported.
The maximum size of a SQLite database depends on the size of your server — hundreds of gigabytes should be possible (though probably not recommended. You can always switch to PostgreSQL)

2023-02-17 15:37:47

- reply

"The medium is the message"
It's important to be attuned to how this medium affects what/how we communicate.
On twitter, you can see how the corporation has crafted the medium to encourage or prevent all sorts of things.
Nostr isn't beholden to corporations, but the medium is still being formed by group consensus. At least we have some input into this formation.

2023-02-17 15:30:47

- reply

I hope it's ok to take a one week break from nostr...

2023-02-14 23:36:29

- reply

There’s going to be a server involved somewhere, right? Even if you could look up a NIP-05 identifier using dns, the dns provider could cancel you.

2023-02-14 00:05:48

Latest version of #python nostr-relay switches to using "internal events" for keeping track of NIP-05 verification, which simplifies the database a little.
Also, I added a "recipe" for configuring a private relay that can accept replies to you. It'll also forward your events to other relays. More details on the wiki page: https://code.pobblelabs.org/fossil/nostr_relay/wiki?name=Homeserver
I might add other recipes in the future. Let me know if you've got ideas!

2023-02-13 21:45:10

- reply

This could already be implemented with WebFinger
https://webfinger.net
...if anybody knew to use it.

2023-02-11 23:26:05

Does anybody remember FIDOnet?
My first email address was provided by a local bulletin board that happened to be connected to FIDOnet and provided a gateway to the outside SMTP world.
I would sometimes chat with the BBS sysop when we were both online. When I told him I was using a hand-me-down 8088, he offered to give me a spare 386sx he had – a huge upgrade for me. He drove to my house to deliver the computer, since I was too young to drive, and my mother was very skeptical about me receiving gifts from some pre-internet stranger.
But there were no strings attached. It was just an act of generosity from a benevolent sysop to a curious kid.
These days, I think that spirit of generosity is mostly lost. Many people try to monetize every interaction. They build brands around themselves, in order to monetize some fictional identity.
But I haven't forgotten FIDOnet and its beneficent sysops. I hope to be as generous as the people who have benefited me.

2023-02-11 20:40:51

- reply

#python nostr-relay is killer. Supports SQLite, Postgres, and LMDB. 😎
https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/lmdb.md

2023-02-11 18:31:39

nostr-relay 1.10.5 adds a MultiIndex to the LMDB backend, for efficiently querying complex filters.
It also adds the concept of a "service event" – an event type that the relay can use for internal storage or remote control. The relay uses this for setting authentication roles. The next release will use it for storing NIP-05 verification status.

2023-02-10 00:02:07

nostr-relay 1.10 is out, with an improved LMDB backend.
Writing the backend has been fun. I have some experience writing an LMDB content-addressable storage system, and a series of web apps that used LMDB, so I'm familiar with its limitations and advantages.
The main disadvantage is that you have to write your own querying engine, and there are no general tools for inspecting LMDB databases.
But since a nostr relay is designed for querying, this is less of a problem. To peek and poke your event data, just use nostr queries!
Switching to LMDB and pypy can result in some huge performance improvements (I'll publish benchmarks at some point). Time will tell if this setup is scalable enough for a large nostr relay.
Read more about the implementation details here: https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/lmdb.md
And let me know how it's working for you.

2023-02-06 20:17:59

- reply

I did it, but my reply didn't show up under this post. Clients are still wonky about replying correctly, it seems.
I guess I missed out on some free digital money. :(

2023-02-06 19:17:57

- reply

or `fossil up` in your working directory

2023-02-06 18:45:18

- reply

This is one of the easiest ways for relays to cut down on spam, without requiring payment or other complicated schemes.
If you want a relay open only to you and your circle of friends (or friends of #[2] ), all you have to do is configure your pubkey and then follow people you think are quality.
You can widen the network (setting "levels: 3") to whitelist thousands of pubkeys. Or restrict it to just the ones you follow.
End result: spammers will be thwarted!
https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/foaf.md

2023-02-06 17:01:39

- reply

nostr-relay 1.9 also adds an experimental LMDB storage backend, since LMDB is all the rage in nostrland!
It's undocumented, and there are no unit tests for it yet. Have fun.
https://code.pobblelabs.org/fossil/nostr_relay/file?name=nostr_relay/storage/kv.py&ci=tip
#python

2023-02-06 16:58:30

nostr-relay 1.9 adds an exciting new feature:
Automatically search your social network to allow access only to those pubkeys you follow (and followers of followers, etc)
https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/foaf.md
https://pypi.org/project/nostr-relay/
#python

2023-02-04 18:36:30

#python nostr-relay 1.8 is out!
There are throughput and memory usage improvements, along with configurable event validators.
https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/CHANGELOG.md
https://pypi.org/project/nostr-relay/

2023-02-04 18:35:22

- reply

2023-02-03 20:11:19

- reply

For instance: https://code.pobblelabs.org/fossil/nostr_relay/doc/tip/docs/authentication.md

2023-02-03 20:04:11

- reply

You don't need a new spec for that. NIP-42 is sufficient to throttle unauthenticated users, or do whatever you want.

2023-02-03 20:01:35

- reply

Clients need to improve their relay handling algorithms to find content you follow, rather than just connecting to a list of them. Otherwise, there will be lots of walled gardens around centralized relays.

2023-02-03 19:08:27

benchmarking #python nostr-relay on my low-end VPS:
~470 event adds/second
~19,000 event requests/second
This seems sufficient. If a relay were receiving 40 million events per day, you'd have all sorts of other problems to deal with.

2023-02-03 01:48:29

- reply

Do you remember how long it took before the web was turned into a tool for profit making?
How about the days of FIDOnet?

2023-02-03 01:23:01

It’s weird to see so much focus on monetization in the #nostr space.
Tim Berners-Lee or Paul Vixie weren’t thinking about profiting off of HTTP or DNS.
They wanted to build useful protocols and tools.
If nostr thrives, it’ll be due to a spirit of generosity and creativity, opposed to the greed-infested tech world of Ponzi schemes.

2023-02-03 00:37:04

Added a mirroring bot, to mirror all events from authors you follow, to a relay of your choice:
TARGET=ws://localhost:6969 PUBLIC_KEY=c7da62153485ecfb1b65792c79ce3fe6fce6ed7d8ef536cb121d7a0c732e92df nostr-bot run -c nostr_bot.examples.mirror.MirrorFollowersBot
https://github.com/davestgermain/nostr_bot/blob/master/nostr_bot/examples/mirror.py

2023-02-02 18:43:53

The C10k problem has been solved for 20 years. If things are falling over right now, go back to the drawing board.
https://www.wikiwand.com/en/C10k_problem

2023-02-02 18:36:04

- reply

"inhuman" is not a quantity. Let's be more specific, or else how can we fix the problem?

2023-02-02 18:29:44

- reply

I'd like to know where the bottlenecks are. In addition to pathological clients, I suspect there's some poor db and concurrency design at play...

2023-02-02 18:23:27

- reply

Is it the bandwidth or the VPS that is expensive?
You can get an enormous dedicated server for 120 euros/month: https://www.hetzner.com/dedicated-rootserver/matrix-px

2023-02-01 00:05:55

In the interest of transparency, here's a bot that will listen for nostr reports and notify the subject that they've been tattled on. 😉
pip install nostr-bot
nostr-bot run -c nostr_bot.examples.reporting.TattleBot
https://github.com/davestgermain/nostr_bot/blob/master/nostr_bot/examples/reporting.py

2023-01-31 19:57:07

- reply

Narcissists hate the idea anonymity. It defies their obsession with creating an idealized image of themselves.

2023-01-31 16:31:05

- reply

There are many other ways to deter spam, that don't involve paying anybody. Even requiring authentication deters spam.

2023-01-31 14:17:03

- reply

I'm pretty sure the python relay supports all of the relevant NIPs, except the most recent one, NIP-50.
Most of the NIPs only apply to clients.

2023-01-30 19:21:28

- reply

also listed here: https://code.pobblelabs.org/fossil/nostr_relay/wiki?name=features

2023-01-30 19:20:52

- reply

currently supporting: [1, 2, 5, 9, 11, 12, 15, 20, 26, 33, 40, 42]

2023-01-30 17:36:13

- reply

Sorry, I don't know anything about pycharm.
But you can run a server with:
nostr_relay.web.run_with_uvicorn()

2023-01-30 17:34:45

- reply

I don't know how nostr.watch compiles statistics. I'm running two relays at deschooling.us
Not sure who else uses it.

2023-01-30 17:28:33

- reply

Then put your identity on a different server.
I think NIP-05 identities should be on a domain you control, rather than the variety of novelty, centralized providers that have popped up.

2023-01-30 14:13:34

- reply

It uses asyncio. The database is the bottleneck – you can use SQLite or postgresql. Postgres would be better for scalability.

2023-01-29 01:08:53

- reply

If the user has a NIP-05 identity, clients can interrogate the relay listen there

2023-01-27 18:50:18

https://void.cat/d/Qc4i7wTtkxd5hRmLbjZVPm

2023-01-27 16:48:58

- reply

implemented here: https://github.com/davestgermain/aionostr/commit/8874252f60a68d28e956bc7837e8cddf5e2f06df
aionostr make-nip19 nrelay wss://nostr.mom/

2023-01-27 16:30:30

- reply

There's no extra support needed for relays. Clients can add and query for "g" tags.
#[2]

2023-01-27 03:09:14

Test post from gossip, after my computer heated my house compiling the app. :)

2023-01-27 01:28:03

- reply

Pesky Brazilians.

2023-01-27 00:00:38

Announcing the best python framework for writing nostr bots:
https://github.com/davestgermain/nostr_bot
pip install nostr-bot
nostr-bot run -c your_module.YourBot
#python
#nostr

2023-01-26 23:44:29

- reply

About 10 years. I might move to a more remote place, if I can find a nice one.

2023-01-26 19:45:33

- reply

78,000 is huge!
I live in a town of 5,000 and feel that it's too crowded...

2023-01-25 18:15:59

- reply

That reminds me of microsoft's strategy: take an open protocol and "embrace and extend it" until everyone had to conform to microsoft's version.

2023-01-22 23:08:26

nostr-relay 1.4.8 supports NIP-33: parameterized replaceable events
(kind of complicated)
https://github.com/davestgermain/nostr_relay/commit/4828edeaf3bbe6b60dc690763d8c542055dbbd09
#nostr #python

2023-01-22 17:19:54

- reply

nuclear energy requires central control. It's not like you can spin up a reactor in your backyard.

2023-01-20 21:24:39

The easiest way to send #nostr events from the command line:
pip install aionostr
export NOSTR_RELAYS=wss://nostr.mom
export NOSTR_KEY=`aionostr gen | head -1`
aionostr send --content 'hello world'

2023-01-19 23:28:49

- reply

Web clients seem to be having a tough time managing the amount of data.

2023-01-19 01:04:47

aionostr: a new async #python library and command line interface for interacting with #nostr relays.
https://pypi.org/project/aionostr

2023-01-16 23:08:32

- reply

Or you can do it in 2 lines ;-) :
pip install nostr-relay
nostr-relay serve

2023-01-16 16:54:35

#python nostr-relay 1.4 uses sqlalchemy and supports postgresql!
Overall, performance and memory usage seems much better. This architecture should allow for more future flexibility.
https://pypi.org/project/nostr-relay/
#nostr

2023-01-16 00:11:53

- reply

firefox says that it's unverified