Load Bearing — Why Production AI Agents Need a Layer That Takes the Weight

What Agent Infrastructure Has to Do Before Production: Memory, orchestration, audit trails, and the failure handling that decides whether agents hold up in real use

Ran Aroussi has built the layers other people's software runs on for 30 years, from ad engines serving 3 billion ads a day to yfinance, now installed more than 30 million times a month. Most teams treat agents as a model problem and reach for another framework, when the thing that breaks in production is everything underneath: memory, orchestration, audit trails, failure handling. He walks through what an agent-native layer has to do before autonomy is safe to ship, and why he wrote Production-Ready Agentic AI and built MUXI around declarative, inspectable configs. Listeners leave able to tell which parts of their agent stack survive real traffic, and which fail quietly.

About Ran Aroussi

Ran Aroussi, podcast guest

Founder of VarOps • Building software and Resident AI into companies that can't afford to guess.

35+ years Production coding experience30M+ Open-source downloads per month50K+ GitHub stars3B+ Ads delivered daily by systems he built

Ran Aroussi has spent 35 years building software infrastructure. Now he thinks we’re building AI for businesses backwards.

Most companies are adding copilots, chatbots, and agents, then asking employees to learn how to use them. Ran’s argument is almost the opposite: people shouldn’t have to adapt to AI. AI should adapt to the company.

He’s the founder of VarOps, where he’s building what he calls "Resident AI": AI that lives inside an organization, learns how it actually operates, and works through the tools and workflows people already use. No new destination. No constant prompting. Ideally, employees barely notice it’s there.

The idea grew out of a problem Ran believes the AI industry has underestimated: AI doesn’t understand organizations.

A chatbot might have access to every document, meeting, and message in a company and still not understand why a decision was made, which unwritten rule matters, who actually knows how something works, or that the official process hasn’t been followed in three years.

Retrieval gives AI information. It doesn’t necessarily give it understanding.

Ran’s work focuses on building that missing layer: a living model of the organization itself – its knowledge, decisions, relationships, processes, and unwritten operating context. He describes it as an "Organizational Language Model" (OLM) rather than another LLM with access to company data.

View profile →

Book Ran Aroussi for your show

12+ podcast & stage appearances. Remote or in studio, broadcast-grade audio.

Request an interview →
Agent Memory is More than RAG
0:00 / 15:28
Agent Sense | Agentic Workflows & Operational AI· Listen to Ran Aroussi on air