I'm a software engineer and sometimes manager. Currently #Raleigh but also #Seattle. Building ML platform for a healthcare startup. Previously, built an IoT platform for one of "those" companies.
Open source: dura, Jump-Location, Moq.AutoMock, others
Do I have other interests? No, but I do have kids and they have interests. I think that counts for something. I can braid hair and hunt unicorns! I put the #rust in frustrate FYI I don't use Twitter at all anymore #metal #science #python
Public Key
npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr
Profile Code
nprofile1qqs269vayhrdjree02evy8w2vjfvkss8nucm3kqvn9cdzlyqsq4a3gcpz3mhxue69uhhyetvv9ujuerpd46hxtnfduqs6amnwvaz7tmwdaejumr0dsvns7pn
Author Public Key
npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Show more details
Published at
2023-03-27T15:48:58+02:00 Event JSON
{
"id": "a6f8514850a70bb401c291d5c866152b95f3bd91c25db91cc5af140ff8ed109e" ,
"pubkey": "ad159d25c6d90f397ab2c21dca6492cb42079f31b8d80c9970d17c80802bd8a3" ,
"created_at": 1679924938 ,
"kind": 0 ,
"tags": [
[
"mostr",
"https://hachyderm.io/users/kellogh"
]
],
"content": "{\"name\":\"Tim Kellogg\",\"about\":\"I'm a software engineer and sometimes manager. Currently #Raleigh but also #Seattle. Building ML platform for a healthcare startup. Previously, built an IoT platform for one of \\\"those\\\" companies. \\n\\n\u2029Open source: dura, Jump-Location, Moq.AutoMock, others\u2029\\n\\nDo I have other interests? No, but I do have kids and they have interests. I think that counts for something. I can braid hair and hunt unicorns!\\n\\nI put the #rust in frustrate\\n\\nFYI I don't use Twitter at all anymore\\n\\n#metal #science #python\",\"picture\":\"https://media.hachyderm.io/accounts/avatars/109/328/234/708/858/533/original/50d6c6d710cd90c5.jpg\",\"banner\":\"https://media.hachyderm.io/accounts/headers/109/328/234/708/858/533/original/9f1083a08b8c6365.jpeg\",\"nip05\":\"[email protected] \"}" ,
"sig": "1889fd7d45436922c0e51f813222d3e542bd71e794cc893217262b62efabe2ba248b565ecf3e2816a212b479c67bcfc4cd98308b09b5a16f3a19e93bdd15e5c3"
}
Last Notes npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg i’m very excited about the interpretability work that #anthropic has been doing with #LLMs. in this paper, they used classical machine learning algorithms to discover concepts. if a concept like “golden gate bridge” is present in the text, then they discover the associated pattern of neuron activations. this means that you can monitor LLM responses for concepts and behaviors, like “illicit behavior” or “fart jokes” https://www.anthropic.com/research/mapping-mind-language-model npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg i used an analogy yesterday, that #LLMs are basically system 1 (from Thinking Fast and Slow), and system 2 doesn’t exist but we can kinda fake it by forcing the LLM to have an internal dialog. my understanding is that system 1 was more tuned to pattern matching and “gut reactions”, while system 2 is more analytical i think it probably works pretty well, but curious what others think npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg anyone know of a plant identification app that actually works in the spring when the leaves aren’t full adult size? seek isn’t cutting it #hiking #botany #nature #camping npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg in the first hour of this #iran attack, i saw the word “unprecedented” probably 12 times, and i can’t figure out for the life of me what’s unprecedented about this situation npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg Happy #Slitherday! This guy wanted to help me trim the bushes, but got scared away by the noise of the trimmers (i’ll be quieter next time, sorry) #Wildlife #snake https://media.hachyderm.io/media_attachments/files/112/265/202/332/313/025/original/ce85028cf6e6856b.jpeg https://media.hachyderm.io/media_attachments/files/112/265/203/071/546/293/original/ca0ce79b61d6dd32.jpeg npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1u2h…z4d7 doesn’t have to be 100%, but the desert does have a lot of solar power. also a great place for nuclear power npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1u2h…z4d7 are they going to leverage solar power? seems like an opportunity npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg The Attack Turkey this morning on the run i got to the top of the hill and was resting, bc i'm out of shape, and off in the distance i see a bird trotting my way as it gets closer i realize it's a turkey. it had a big red gobbler and its neck was iridescent. It was actually really pretty, so i just watched as it approached npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg i’m hoping @npub1f6a…pnql is one of the ten developers that get access to this, so we can hear all about it https://www.theverge.com/2024/3/29/24115701/openai-voice-generation-ai-model npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub129g…4kwg wait, what’s the film? is it good? npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg ngl postfix match statements are probably the sexiest #rust feature i’ve seen in a while https://doc.rust-lang.org/nightly/unstable-book/language-features/postfix-match.html npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1fqt…vxe6 on the surface, yeah we are approaching diminishing returns and so we should expect progress to slow. but that should be an indicator of AI success, but it’s framed here as failure. but also, most die-hard AI people (not me) expect progress to happen in a different model architecture. we had nearly simultaneous success with diffusion & LLMs, but future success will be something else. that in itself is rare, so we probably should adjust expectations accordingly npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1t5m…9guy i still remember a manager suggest that i "just" add a try/catch around a block that fails a lot. "it's not that hard" npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub14lm…5crk does chatgpt also generate AImarkdown script? npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1e0a…eww0 the EU also defined it. Both the EU and US definitions are consistent with my understanding of how it's always been understood by the general public. A few years ago it certainly was just a marketing word, but we've moved past that pretty hard as governments seek to regulate it. You can't regulate without a definition of what you're regulating. I see you doubling down on it being **just** a marketing word, when it very clearly isn't just that. It can't be. https://media.hachyderm.io/media_attachments/files/111/791/394/010/134/585/original/e81317209e797698.png npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1e0a…eww0 ah, your post made it sound like you thought it was a marketing term, when it's not. My mistake npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1e0a…eww0 biden’s executive order on AI defines it, that’s the definition i use https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/ https://media.hachyderm.io/media_attachments/files/111/791/127/683/981/066/original/ce9820a8eee72068.png npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1u2h…z4d7 seems like the most likely outcome tbh npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1u2h…z4d7 tbh i'm skeptical of google ever since Bard became the butt of all LLM jokes npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1f6a…pnql still…that’s insane npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1f6a…pnql all one week?? npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1fs3…wylg how did it go? Did anyone get hurt in the pit? npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg @npub1upk…tcwy i made dura to deal with corner cases with trying to undo work in git. like, if you forget to commit/stash in a long time, or never add a file and then delete it. it has a background process that commits whenever files change https://github.com/tkellogg/dura npub1452e6fwxmy8nj74jcgwu5eyjedpq08e3hrvqexts697gpqptmz3smm2cvr Tim Kellogg does anyone out there know of an in-process vector DB that runs in the same process as the application? like SQLite but for vector stores? #LLM #LLMs #AI #vector #database