Agentic AI architect and forward deployed engineer

AI that does the work. Not AI that demos.

Most AI pilots never reach production. I build the ones that do.

I work forward deployed: inside your company, with your data, until it runs. Then I hand over. Some companies need someone to own the AI decisions first.

Questions I get asked

Sound familiar?

Twenty questions I keep answering. One of them is probably yours.

01

“We already have Claude Enterprise. Why can’t we just do this ourselves?”

A license does not build the system

The work is orchestration, evaluation and guardrails. None of that is included in the license.

02

“It forgets everything halfway through the job.”

Context management

Context engineering: what to load, what to summarize, what to throw away. Not a bigger context window.

03

“Do we need MCP, or will a normal API do?”

Usually both

MCP for tools the agent picks itself. Plain APIs for the things it must never get wrong.

04

“Our data is not allowed to leave our own servers.”

Self-hosted

Open models on your own hardware. I run a 26B one on a desktop CPU. No GPU, no vendor.

05

“The chatbot we built answers questions. It doesn’t do anything.”

Agents, not chat

An AI agent takes the action and reports back. A chatbot only gives you text to read.

06

“Our developers all use AI. Output hasn’t changed.”

Agents that test their own work

AI coding agents that write the code, run the tests and fix what fails. Not a person pasting prompts into a chat.

07

“One agent works. Five of them conflict with each other.”

Orchestrated

Multi-agent orchestration with backpressure, retries and crash recovery.

08

“How do we know its answers are right?”

Evaluated

LLM-as-a-judge scoring against your own cases, re-run on every change.

09

“What stops it doing something stupid in production?”

Guardrails

Hard limits, required tests and prompt-injection detection before it is allowed to act.

10

“Someone could talk it into leaking our data.”

Every input checked

Every input is checked for prompt injection before the agent reads it.

11

“It sounds completely confident and it is wrong.”

Checked

Every answer is checked against the source documents for made-up facts, and it says when it does not know.

12

“Should we fine-tune, or is RAG enough?”

Usually neither, yet

Most teams need better retrieval and real evaluation before either one is worth the cost.

13

“The token bill doubled last quarter.”

1/100th

A fine-tuned small language model doing the large one’s job, at a fraction of the cost.

14

“We ran a proof of concept. It never became a product.”

In production

Most pilots fail at orchestration and evaluation. That is the part I build first, inside your company.

15

“Our core system is twenty years old. AI can’t touch it.”

It can

Agents connect to the old system through its existing interfaces. Legacy modernization without a rewrite.

16

“Which model should we even be using?”

Smaller than you think

Almost always. I’ll show you measured benchmark results rather than vendor claims.

17

“Forty people, a spreadsheet, and three days to close.”

1 hour

Agents run it continuously. People only handle the exceptions.

18

“The board wants a number before we go further.”

One workflow

Measured before and after, on a single workflow, before it is rolled out further.

19

“The people who built it have all left.”

Readable

Architecture the next team can understand, take over and keep running.

20

“Every vendor we talk to says yes to everything.”

An honest no

I’ll tell you which half of this not to build. Knowing what not to build usually saves more than building it.

Anyone can generate code now. Using AI to find and solve real business problems at scale is the hard part.

Output

,

contributions in the last year

Loading live from GitHub Hover any square

Writing

Articles about the work.

Fractional CTO: what it is, what it costs, and when to hire one

September 2026

Fractional Chief AI Officer: what it is, what it costs, and when to hire one

September 2026

What a forward deployed engineer does inside your company

September 2026

AI in retail: what gets built inside a retail chain

September 2026

Forward deployed engineer vs solutions engineer vs sales engineer vs solutions architect

September 2026

Forward deployed engineering: how an engagement works, week by week

September 2026

What is a forward deployed engineer?

September 2026

Self-hosted LLM: how to keep your company's data private

September 2026

Running Gemma-4 26B at 124 tokens/sec on a CPU, no GPU

June 2026

About

What apeg.dev is.

apeg.dev is the website of Arun Prasath E G, an agentic AI architect and forward deployed engineer building AI systems inside companies worldwide.

Role
Agentic AI architect, forward deployed engineer, fractional Chief AI Officer or CTO
Experience
20 years in enterprise architecture · 7 companies built and sold
Builds
AI agents, multi-agent orchestration, agentic workflows, fine-tuned small language models, low-latency trading systems
Languages
TypeScript, Python, Rust, Solidity
AI stack
Claude Agent SDK, MCP servers, DSPy, GEPA, RAG, LLM fine-tuning, LLM-as-a-judge evaluation
Platform
Cloudflare Workers, D1, R2, Docker, Ansible, PostgreSQL, ClickHouse, Redis
Also
Robotics simulation and sim2real, AI safety and prompt injection detection, on-chain settlement and MEV
Works
Remote, worldwide

Read the full bio →

Work with me

Twenty years. Seven exits.

I take on one or two engagements at a time, inside the company, and I hand over when it runs. If you have a problem in your own processes that no single product solves, and you need it built and running, not just a recommendation, that is the kind of work I do.

Or find me here