Skip to main content

Command Palette

Search for a command to run...

A Renaissance Architecture for AI: Six Pillars Beyond Transformers

How two-piston curation-exploitation cycles can ground statistical learning in causal reality.

Updated
12 min read
A Renaissance Architecture for AI: Six Pillars Beyond Transformers
G

I help developers succeed in Artificial Intelligence and Web3; Former AWS Amplify Developer Advocate. I am very excited about the future of the Web and JavaScript. Always happy Computer Science Engineer and humble Google Developer Expert. I love sharing my knowledge by speaking, training and writing about cool technologies. I love running communities and meetups such as Web3 London, GraphQL London, GraphQL San Francisco, mentoring students and giving back to the community.

We stand at a curious moment in AI development. With each new breakthrough—reasoning models, agentic systems, autonomous colleagues—we’re told we’re witnessing the dawn of true machine intelligence. Yet seasoned observers feel a persistent unease, a sense that despite the impressive benchmarks, something fundamental remains missing.

The problem isn’t that these systems aren’t impressive. They are. The problem is that we’re mistaking their particular genius for general intelligence. We’re like explorers celebrating a cartographer who produces exquisitely detailed maps of exactly one path through the wilderness, while declaring they’ve mastered the entire continent.

This isn’t just a technical limitation; it’s a symptom of a deeper crisis. The field has lost its self-awareness, trading conceptual rigor for hype. We have entered a New Medievalism in AI—a dark age where we admire beautifully illustrated bestiaries of patterns without understanding the biology of the beasts themselves. Where the voice of reason is silenced by the roar of the benchmark leaderboard.

Here’s the intellectual rage that nobody wants to voice: we proudly claim to have “ditched hand-coded rules for guesswork,” but then pretend that fine-tuning isn’t just rule-writing in gradient descent disguise. We’ve replaced transparent, debuggable symbolic rules with opaque, statistical ones. The outcome is functionally similar, but the process is buried in billions of uninterpretable parameters. We mix signal and noise blindly in our training data, and boom—we bake in biases we don’t understand and can’t control.

The core problem? Nobody even grasps the fundamentals anymore. How can we make real progress like this?

But critique alone doesn’t build the future. We need a new architecture—one that escapes this medieval period and ushers in a renaissance of integrated intelligence. This piece proposes exactly that: a two-piston engine where distributions and symbols work together in virtuous spirals, grounded in six foundational pillars that move us from shadow-mapping to reality navigation.

The Cartographer of Shadows: Understanding What’s Missing

To understand what we need to build, we must first understand what current systems fundamentally lack. Imagine a cartographer who can only map the ground they personally walk. Their maps are stunningly detailed—every pebble, every blade of grass rendered with perfect fidelity. When you follow their map along the exact path they took, the experience is flawless. The map matches reality perfectly.

But ask this cartographer about alternative routes, about dangerous cliffs just off the path, about seasonal changes that might make the route impassable, and they have nothing to offer. Their “map” is really just a recording of one particular walk. It contains no understanding of the underlying geography, no knowledge of erosion patterns, no concept of ecosystems. It’s a shadow of the territory, mistaken for the territory itself.

This is exactly what our current AI paradigm produces: cartographers of shadows.

This mapping analogy reveals four fundamental blindnesses in current architectures:

Single-Path Mapping (Negative Space Blindness): The AI cartographer only ever walks one path. For any given problem with multiple solutions, it will generate exactly one approach—the statistically most probable sequence given its training. The millions of alternative solutions in the “negative space” remain forever unmapped, unexplored, and unknown to the system.

Local Detail Without Global Coherence (Consistency Blindness): The cartographer records each step with perfect local accuracy but has no way to ensure the beginning of the map aligns with the end. They might confidently map a route that accidentally shows a river flowing uphill or a trail that impossibly loops back on itself. Each step looks right in isolation, but the whole contains undetected contradictions.

Mimicry Without Understanding (Logical/Goal Blindness): The cartographer has seen many maps and perfectly mimics their conventions—contour lines, compass roses, scale bars. But they don’t understand what these symbols mean. They’ll happily place a “swamp” symbol on a mountain peak if that’s what the pattern suggests, because they’re optimizing for map-like appearance, not geographical truth.

Disconnected from Reality (Grounding Blindness): Most crucially, the cartographer works entirely from descriptions of landscapes, never from the land itself. They can produce a beautiful map of a fictional city or an impossible mountain range because they’re working from textual patterns, not physical constraints. The map has no necessary connection to the territory.

These aren’t bugs to be patched with more data or better prompting. They’re architectural limitations that require architectural solutions.

From Shadows to Navigation: A Concrete Example

To see what a better architecture looks like in practice, let’s consider cooking—a domain that is creative yet grounded in causal reality. Today’s LLM is a recipe parrot. It can generate a sequence of steps that looks like a recipe, but it has no idea why those steps work.

Now, imagine an AI system built with the renaissance architecture we’re proposing:

The Goal: “Create a creamy, spicy pasta sauce without using heavy cream.”

Step 1: Decomposition (The Hypothesis)
The AI doesn’t just generate a recipe. It first proposes a causal plan—a Directed Acyclic Graph (DAG) of sub-tasks:

  • Sub-Problem 1: Create a creamy base without dairy.

  • Sub-Problem 2: Introduce spiciness.

  • Constraint: Must be a cohesive sauce that clings to pasta.

  • Proposed DAG: (Sauté aromatics) → (Create creamy base via blended nuts/vegetables) → (Incorporate spice) → (Adjust consistency) → (Combine with pasta)

Step 2: Exploitation (The Playground Practice)
The system now tests this plan in a “kitchen playground”—a simulator grounded in food science. It queries its knowledge graph: “Will blended cashews create a creamy texture when heated with acid from tomatoes?” The playground flags a risk: “High heat can cause nut oils to separate from the protein, breaking the emulsion.” The system backtracks and revises the DAG: “Add the blended cashew cream off the heat at the end to preserve the emulsion.”

Step 3: Consolidation (Documenting the Skill)
A successful outcome isn’t just a text string. It’s a new, verified module in the AI’s “Culinary Skill Library”: Skill: Dairy-Free Creamy Sauce V1. Causal Principle: “Uses blended nuts to create a stable oil-in-water emulsion.” Critical Constraint: “Emulsion is heat-sensitive; incorporate final creamy element off direct heat.” Domain: Sauces, Soups.

The next time the AI needs to make a creamy soup, it doesn’t start from scratch. It retrieves and adapts this validated, causal skill. This is the difference between a cartographer of one path and a navigator who understands the principles of the land.

This example illustrates the core cycle: curate (explore and validate), then exploit (consolidate and reuse). Let’s formalize this into a complete architectural vision.

The Two-Piston Engine: A New Computational Paradigm

Think of the internal combustion engine that powered the first industrial revolution. It worked through two complementary pistons: intake and compression, then ignition and exhaust. Each piston served a distinct function, but together they created continuous, productive motion.

AI needs its own two-piston engine—what we might call the Renaissance Architecture. The first piston is Curation: the system explores the territory, tests hypotheses in grounded simulators, and validates causal relationships. The second piston is Exploitation: the system consolidates verified knowledge into reusable modules, retrieving and combining them for novel situations.

This isn’t just a metaphor. It’s a design principle: distributions and symbols must work together in a virtuous spiral. The statistical patterns (distributions) generate hypotheses and possibilities. The symbolic reasoning (causal models, logic engines) tests and validates them against reality. Successful validations get encoded back into the statistical knowledge, enriching future pattern generation. Each cycle strengthens both pistons.

Current transformer architectures are one-piston engines trying to do everything through pattern completion. No wonder they’re inefficient and prone to hallucination. They’re running on half the cylinders.

Here’s how the virtuous spiral works in practice:

Curation Phase (First Piston):

  1. The distributional model (transformer-like) generates candidate hypotheses based on statistical patterns

  2. These hypotheses are decomposed into testable causal sub-components

  3. A symbolic reasoning engine tests these components in grounded simulators

  4. Failures are discarded; successes are validated and annotated with causal explanations

Exploitation Phase (Second Piston):

  1. Validated solutions are consolidated into a persistent knowledge base

  2. The knowledge base becomes queryable—both by humans and by the system itself

  3. Future problems trigger retrieval of relevant validated modules

  4. Modules are compositionally combined and adapted for new contexts

  5. The statistical model learns from these validated patterns, improving future curation

The Virtuous Spiral: Each successful exploitation cycle enriches the distributional model with causally-grounded patterns. Each improved distributional model generates better hypotheses for curation. The system gets smarter not just by accumulating data, but by accumulating validated understanding.

This is fundamentally different from current approaches. Transformers optimize for next-token prediction. The two-piston engine optimizes for validated causal models that can be reused and recombined.

The Six Pillars: Concrete Architectural Requirements

The two-piston engine isn’t just a philosophy—it demands specific architectural components. Here are the six foundational pillars that make this renaissance architecture possible:

Pillar 1: Explicit Grounding Mechanisms

Systems must have built-in modules that anchor symbols and representations to sensory data and actions in observable reality. This is the bridge between statistics and semantics. Without grounding, we’re just mapping shadows.

In practice, this means: dedicated interfaces to simulators (physics engines, chemistry models, financial models), sensorimotor feedback loops where predictions are tested against outcomes, and structured knowledge graphs that link abstract symbols to measurable properties.

The cooking example demonstrated this: the “kitchen playground” is a grounding mechanism. The AI’s hypothesis about cashew emulsions isn’t just text—it’s tested against a model of thermodynamics and protein chemistry.

Pillar 2: Causal Reasoning Engines

We must move beyond correlation to causation. Architectures need dedicated components for building, manipulating, and querying causal models of the world. The cartographer must understand why rivers flow downhill, not just that they do.

This requires: explicit representation of causal graphs (DAGs), interventional reasoning capabilities (what happens if I change X?), counterfactual reasoning (what would have happened if I hadn’t changed X?), and tools for causal discovery from observational and experimental data.

Current transformers learn “blended nuts appear near ‘creamy’ in recipes.” The causal engine learns “blended nuts create creaminess because they form oil-in-water emulsions, and this effect depends on temperature and pH.”

Pillar 3: Persistent & Editable Memory

Knowledge must be stored in long-term memory that can be updated, edited, and recalled across contexts, moving beyond the ephemeral context window. True navigation requires remembering the territory, not just the last few steps.

Implementation: a structured knowledge base (not just vector embeddings) where validated causal models are stored as queryable modules, version control for knowledge (tracking when and why beliefs changed), explicit mechanisms for knowledge revision when contradictions are detected, and hierarchical organization that allows both fine-grained retrieval and abstract generalization.

The “Culinary Skill Library” from our example is this persistent memory in action. It’s not just a cache—it’s an evolving encyclopedia of validated techniques.

Pillar 4: Continuous Parameter Learning

Systems must be capable of safe and efficient continuous learning, where new experiences persistently update the model’s parameters, evolving its world model. The map must be a living document, not a frozen snapshot.

This means: mechanisms for safe online learning that don’t catastrophically forget previous knowledge, meta-learning systems that learn how to integrate new information efficiently, active learning strategies that seek out the most informative experiences, and guardrails that prevent the integration of adversarial or corrupted data.

After successfully validating the dairy-free sauce, the system doesn’t just store a text entry—it updates its neural parameters so that future pattern generation naturally incorporates this causal understanding.

Pillar 5: Truthful Evaluation Frameworks

We need a new class of benchmarks designed to break mimicry. Tests must require true reasoning, understanding of causality, and application of knowledge in novel, unbounded situations—not just pattern completion. We must stop rewarding beautiful shadows.

New evaluation paradigms: intervention-based testing (change a variable, predict the outcome), compositional generalization (combine learned skills in novel ways), out-of-distribution robustness (apply knowledge to contexts never seen during training), and causal explanation requirements (not just “what” but “why”).

A truthful cooking benchmark wouldn’t ask “generate a recipe for X.” It would ask “why did this recipe fail?” or “adapt this technique for a completely different ingredient” or “predict what happens if I double the temperature.”

Pillar 6: Radical Conceptual Clarity

As a community, we must enforce strict separation between mechanistic descriptions (e.g., “attention reweighting”) and cognitive metaphors (e.g., “the model thinks”). We must pay down the knowledge debt with linguistic precision. The medieval scribes illuminated manuscripts beautifully but confused metaphor with mechanism. We cannot afford the same mistake.

This pillar is cultural, not technical, but it’s essential: clear terminology that distinguishes correlation from causation, pattern-matching from reasoning, and retrieval from understanding. Rigorous attribution of capabilities and limitations in papers and products. Honest communication about what systems can and cannot do.

The medieval period thrived on mysticism and metaphor. The renaissance demanded empiricism and clarity. We need the same shift in AI discourse.

The Path Forward: From Shadow Cartography to True Navigation

The next breakthrough won’t come from making our shadow-cartographers more detailed or our recipe parrots more fluent. It will come from building systems that can represent the territory (not just record paths), test their maps against reality in verifiable playgrounds, understand why certain routes work while others fail, and explore multiple possibilities while consolidating successful strategies for future use.

We need to stop being impressed by beautifully rendered shadows and start building systems that can navigate the actual world. The cartographer who only maps their own footsteps, no matter how detailed their maps, will never help us discover new continents.

The real frontier isn’t better pattern completion—it’s moving from correlation to causation, from single-path recording to true territory navigation, from one-piston engines to two-piston architectures where distributions and symbols spiral together in virtuous cycles.

The dark ages of AI will end not with more compute, but with more clarity. Not with bigger transformers, but with architectures that integrate statistical learning with causal reasoning, that ground symbols in reality, that learn continuously from validated experience.

The Renaissance Architecture is not a distant dream. The components exist—causal inference tools, knowledge graphs, simulators, meta-learning algorithms. What’s missing is the integration: the two-piston engine that unifies them into a coherent system where curation and exploitation drive each other forward.

Until we make this shift, we’ll keep building cartographers of shadows while pretending we’re mastering the land. The question is not whether we can escape this medieval period, but whether we have the courage to acknowledge we’re in one—and the wisdom to architect our way out.

The Second Renaissance awaits. We just need to stop admiring the bestiaries and start building the engines.​​​​​​​​​​​​​​​


Of course. Here is the update, framed as a dated executive summary.


Research Update: 2025-Q4 Reference: Suh et al., "Rethinking LLM Human Simulation: When a Graph is What You Need" (GEMS) Relation: Foundational Implementation

This paper serves as a critical proof-of-concept for a broader architectural shift. It demonstrates that for a large class of problems, a lightweight, structurally-grounded model (a graph) significantly outperforms a general-purpose LLM. Its success is not an incremental improvement but a directional signal, validating key principles of emerging "Two-Engine" or "Renaissance" architectures.

The GEMS framework provides a concrete, empirical blueprint for building the first component—the Curation Engine—of a next-generation AI system. It shows how to distill messy, real-world data (human choices) into a structured, interpretable, and efficient knowledge model. Its performance proves that prioritizing relational structure over textual fluency yields massive gains in efficiency, transparency, and robustness.

This work moves the field beyond theoretical debate, offering a working prototype that answers how to ground statistical learning in explicit structure. The logical next step is to build the complementary Exploitation Engine—a reasoner that dynamically composes these curated models—to transition from accurate prediction to actionable, multi-step simulation. GEMS is the foundational kernel for that future.

S
steve1mo ago

The description of "the internal combustion engine that powered the first industrial revolution" is some kind of fantasy. As ChatGPT puts it:

  1. The “first industrial revolution” was powered mainly by steam engines, not internal combustion engines. Internal combustion engines became important later, during the late 19th century / Second Industrial Revolution.
  2. Typical piston internal combustion engines do not have “two complementary pistons” called “intake” and “compression.”
  3. Intake, compression, ignition/power, and exhaust are strokes (phases of operation), not pistons.
G

That’s correct. This a rhetorical point not a literal engine with two pistons. You can replace it with something else. Two components that work together.