HeyJaredNyghtowl Perch
Writing about building software, AI systems, and learning by doing, both above and below the waterline.
- Indexed issues, last 90 days
- 5
- Latest publication
- Sep 19, 2026
- Audience
- Checking…
- Earliest in this view
- Jul 5, 2026
Latest issues
Finally Diving into AI Model Evals (opens the original)
Read excerpt
I’ve been asked in the past how we evaluate our AI models at Fight Health Insurance (FHI), and frankly, it was pretty bare bones, and from what other startup founders have told me, they weren’t far off from that either. We didn’t have the time or resources to dive in, and the models in 2025 weren’t at a point where they could help us out the way we needed. At the end of August I finally had the time and resources to go down the eval path.What started as dipping a toe in ended with me falling in
What Does an AI Agent Need to Remember? (opens the original)
Read excerpt
TL;DR: We use “memory” as a catch-all, but an AI agent needs different information for different jobs. Context gives the model what it needs for the current decision. Memory brings useful information forward. State tells the application what is true and where the work stands. Understanding those roles matters more as the agent capabilities grow and work stretches across model calls, tool calls, waits on humans and failures. The separation is a tool for clarity. You could call all of it memory; t
Durable, flexible multi-agent systems (opens the original)
Read excerpt
Originally published on the Temporal blog: https://temporal.io/blog/durable-flexible-multi-agent-systemsAn agent system is a distributed system. You get to choose the framework and how much durability and human oversight the case demands; the tradeoffs are the part you don’t get to avoid.For the last few months, I’ve been building one system to make that concrete: the same multi-agent fleet on Google ADK, on LangGraph, and on both at once, with Temporal as a layer underneath.Where this startedZi
Swapping Models in the Agent House (opens the original)
Read excerpt
The grief for GPT-4o was surprising and fascinating when it was removed and retired and this is not isolated to that model. It’s something that has happened with other models and there is still some sadness on when they change but maybe we are at a stage where it’s less impactful and more understood (or we are just jaded). Someone else changes the weights, and users wake up to an AI that’s suddenly a different character.OpenClaw and variations of it have been around all year getting attention an
The Disagreement Was the Feature (opens the original)
Read excerpt
For the last year, I’ve had a very manual AI “ensemble” ritual: ask Claude something, paste the answer into ChatGPT or Gemini, compare what changed, then carry the useful bits back by hand. I knew I could code up something better. I also kept not doing it, because laziness is real, the tooling was moving fast, and I do not always want three models involved. For the past year, I’ve been playing around with “ensemble” model conversations, and it’s been manual pasting between chat interfaces CLIs,
Publishing over time
Last 90 days. Choose a month to open its work.
Recurring subjects
Named in the text we hold. One piece can cover several.
Audience
No verified audience measurement yet.
About this data
Counts cover the work we have indexed. Tone needs enough text and a confident classification. Excerpts and episode notes are not full articles or transcripts.
Identity or attribution wrong? Suggest a correction.