Allen @allendvasm

architect/programmer. SNES-game genie, rock n roll racing, wing commander, etc. NN programming and architecture these days. NYC Joined December 2021

Tweets

1K
Followers

447
Following

436
Likes

144K

Allen @allendvasm

3 weeks ago

most don't realize how much overhead LLM APIs like OpenAI's have in streaming mode—95%+ of the traffic is just JSON wrappers around each tiny token. Experimenting with direct gRPC binary comms on my setup to slash that inefficiency.

0 0 4 392 0

Allen @allendvasm

3 weeks ago

is it just me or are there literally no good desktop based email apps right now?

1 0 4 391 0

Allen @allendvasm

3 weeks ago

vibe coding is such a joke. Even having AI write a lot of code for you just makes it all take longer. Ask AI questions instead of having to google for it and you'll have much better results.

3 2 6 476 0

Allen @allendvasm

a month ago

If your kilo code setup is failing to index a workspace, check the vector db dimensions for mismatches.

0 0 6 265 0

Allen @allendvasm

a month ago

oh wow, #youtube just made 3x and 4x available for speed up after I got used to using 2x for everything except music videos #mtv. I think my productivity just went up. :P

0 0 2 228 0

Allen @allendvasm

a month ago

ok fine, I created an #mcpserver router discovery protocol. Setting up new mcp servers is a huge PITA and this makes it easy.

0 0 1 114 0

Allen @allendvasm

2 months ago

NNs+graphrag+context are instance dungeons in WoW. It all comes together but you still need facts / crystalized knowledge lookup. This is not a math problem, its a logic problem.

0 0 0 141 0

Allen @allendvasm

2 months ago

The RAG paradigm is a crude solution to a more complex problem. Mem0 type systems help somewhat but the real solution to thinking vs memory is for the thinking model to know how to index the exact memory and go look it up exacty. @xai

0 0 0 126 0

Allen @allendvasm

2 months ago

Unpopular opinion but discord is an arcane, hard to use chat system that is almost always dead. #Discord

0 0 0 130 0

Allen @allendvasm

2 months ago

many have no idea how affordable 100g networking has become if you know how to do it. I'm converting my entire llm and NN dev lab to 100g across the board.

0 0 1 158 0

Allen @allendvasm

2 months ago

if you haven't read 'the machine stops' then you don't really appreciate where we are headed with AI. Some of the devs I'm seeing these days are vibing their way into knowledge oblivion.

0 0 1 174 0

Allen @allendvasm

3 months ago

The shift from LLMs to “thinking” models often hurts daily use. LLMs shine as turbocharged search engines, not deep thinkers. Claude gave long-winded troubleshooting instead of just helping me find the OneDrive issue today. I needed answers, not theory.

0 0 0 171 0

Allen @allendvasm

4 months ago

the stupidest person I've ever met was a PHD from M.I.T. I know this because he told us this every chance he could while not being able to answer any question on his methodology. @UHC

1 0 4 254 0

Allen @allendvasm

5 months ago

interesting. chatgpt is getting more personable and grok is getting less funny. How did that get flipped around? i loved groks personality, someone fix it back! @elonmusk @ChatGPTapp @grok

0 0 3 250 0

Allen @allendvasm

6 months ago

AI is terrible at debugging. IMHO this is going to be a longer term problem because it didn't go through 20+ years of coding / debugging, etc. It only records the end results. I bet the best coding model will be one trained from hello world. maybe i should do that... @OpenAI…

0 0 6 344 0

Jay Alto @theJayAlto

6 months ago

this guy is one of the world's best 'competitive programmers' and has a video explaining exactly how to learn hard things

147 8K 106K 5.4M 112K

Download Image

Allen @allendvasm

6 months ago

If you have never read 'the machine stops' from like the early 1900s, you should. @elonmusk probably understands. Most devs from the past 2 to 3 years have no idea how things actually work.

0 0 5 488 0

Allen @allendvasm

6 months ago

Am I the only one who begged my parents to buy three Funk & Wagnalls encyclopedias every few months from the grocery store so we could read them because that’s all we could afford? I may be old. :P

0 0 3 445 0

Allen @allendvasm

6 months ago

.@ErikEJ, is there a way to have refresh pick up / drop tables? any time i add or remove things from the schema it requires me to go to the full reverse engineer screen. Would be nice to just right click refresh and have it do all.