HOLD THE ORDERSYSTEM ARCHITECTUREOPEN LIVE PROOF

GOOGLE CLOUD AGENT ARCHITECTURE · RELEASE 177

One dinner.
One durable
chain of truth.

A refrigerator image becomes a household action—not just an answer. Follow the evidence through Gemini, asynchronous execution, real delivery, verified outcome, and memory that can cite exactly where it came from.

ENTER THE SYSTEM VIEW GITHUB
AGENT READY6:12 PM
WORKFLOW1×EXACTLY ONE
SCANPLANACTLEARN
ORIGINAL PHOTOSNOT STOREDINVENTED SIGNALSZEROCOMMERCE CONTROLNONE
01 GROUND IN REALITY02 ACT ASYNCHRONOUSLY03 PERSIST THE RECEIPT04 LEARN ONLY FROM OUTCOMES
01 / SYSTEM

EXPLORE THE ARCHITECTURE

Four lenses.
One coherent agent.

Switch views to see how product experience, cloud execution, household security, and durable memory fit together.

DEPLOYED SYSTEM MAPLENS · SYSTEM
01 · OBSERVE
CLIENTHousehold PWA

Scan · correct · consent · respond

DEVICE BOUNDARY
WEBCloud Run web

Same-origin proxy protects runtime keys

GCP · MIN 0 · MAX 3
STRUCTURED
EVIDENCE
02 · ORCHESTRATE
TIMECloud Scheduler

15-minute policy sweep

OIDC
EVENTPub/Sub

Retry + dead-letter delivery

STABLE EVENT ID
AUTHENTICATED
EVENT
03 · DECIDE
AGENTCloud Run

Policy · idempotency · recovery

MIN 0 · MAX 3
MODELGemini 3.5 Flash

One grounded intervention

VERTEX AI
DURABLE
ACTIONS
04 · ACT + LEARN
STATEFirestore

Receipt · outcome · memory

HOUSEHOLD SCOPED
DELIVERYPush + Inbox

Alert · task · timer · fallback

HUMAN AUTHORITY
THE WHOLE SYSTEMEvidence enters once. Every downstream action stays linked.

The browser handles consent and correction. Google Cloud handles durable execution. Firestore closes the loop without turning assumptions into outcomes.

02 / WORKFLOW

THE CLOSED LOOP

From fridge light
to learned reality.

Each stage produces an inspectable artifact. Nothing jumps magically from a model response to a product claim.

01
Observe

See the actual fridge

Up to four labeled views become structured visible inventory. Covered containers stay uncertain until a person confirms the food.

Gemini multimodal · structured result
02
Qualify

Choose the next useful action

The policy can plan, wait, request a Dinner Pulse, refresh one changed zone, or ask for an uncertain food confirmation. Weak evidence raises—never lowers—the household authority line.

Durable evaluation · no needless model call
03
Dispatch

Create one durable event

A stable event ID enters Pub/Sub. Scheduler, a person, or a recovery can initiate work, and every origin remains visibly classified.

Pub/Sub · at-least-once delivery
04
Decide

Choose — and challenge — one dinner

Cloud Run loads current evidence and sourced memory. Gemini returns one plan; a deterministic critic checks every required ingredient and selectively requests one repair before release.

Gemini 3.5 Flash · grounding critic
05
Act

Coordinate the household

The agent persists the receipt, sends Web Push, creates a durable inbox item, assigns named tasks, and schedules exact cooking timers.

Push · checklist · Cloud Tasks
06
Learn

Wait for what really happened

Only a recorded cooked, adapted, or ordered-out outcome updates savings, inventory, leftovers, and the correctable rule supplied to the next run.

Verified outcome · sourced memory

03 / TRUST + PROOF

Proof is not
a dashboard.
It is the product.

One workflow ID correlates the event, model execution, delivery, household response, recovery lineage, verified outcome, and next-run memory.

COMPARE LIVE EVIDENCE
ILLUSTRATED RECEIPTEXAMPLE · NOT LIVE
EXAMPLE WORKFLOW IDexample_home_dinner_001
PERCEPTION8 example itemsMODEL PATHGemini 3.5 FlashDELIVERY STAGEPhone proof required
ILLUSTRATED EVENT LOCKCREATE-ONLY · 1×The live Proof screen turns this green only after a real replay is rejected.
ILLUSTRATED MEMORY SOURCEOUTCOME REQUIREDA live rule appears only after a household records dinner and the next run cites it.
04 / STATE

FIRESTORE MEMORY BANK

A place for every fact.
A source for every claim.

Logical household isolation is enforced on every route. Records are scoped by household and checked again before access.

01Policy root

households

Members, timing, current inventory, credential hashes

02Optional recovery

accountHouseholds

One-way account link to a household; no passwords or owner keys

03Evidence timeline

fridgeSnapshots

Day-by-day structured inventory deltas; no original photos

04Idempotency lock

workflowEvents

Create-only stable event IDs block duplicate action

05Policy trace

autonomyEvaluations

Every scheduler decision, including wait and clarify, with evidence quality

06Decision receipt

workflows

Plan, model mode, delivery, actions, and recovery lineage

07Verified reality

outcomes

Result, time, feedback, impact, used ingredients, leftovers

08Correctable learning

memories

Explicit rules with source workflow IDs

09Coordination

agentTasks

Assigned, accepted, declined, reassigned, completed

10Live execution

cookingSessions

Steps, timers, temperature entries, repairs, checkpoints

11Household assertion

containerPassports

Expiring covered-container labels and reusable QR identity

12Async cinema

mediaJobs

Household-scoped Veo status, model receipt, and private output pointer

GOOGLE CLOUD RESOURCE MAPDEPLOYED AS CODE
MODELGemini 3.5 Flash

Multimodal inventory + constrained plan + selective repair

KITCHENManaged Gemma 4

Vertex AI verified · quota-protected Countertop questions · offline fallback

CINEMAVeo 3.1 Fast

720p opt-in jobs · 1/household/week · global hard stop

WEBCloud Run

Responsive PWA · same-origin proxy · least-privilege identity

RUNTIMECloud Run

hold-the-order-agent · async execution · min 0 · max 3

EVENTSPub/Sub

Authenticated push · retry · dead-letter handling

TIMERSCloud Tasks

Idempotent scheduled cooking callbacks

STATEFirestore Native

Household-partitioned receipts and memory

MEDIACloud Storage

Private household clips · authenticated proxy · 14-day expiry

DELIVERYWeb Push + Inbox

Device alert with durable in-app fallback

THE COST GUARDRAIL

Wake for work.
Sleep when idle.

MIN0MAX3
  • Request-based Cloud Run compute
  • CPU throttling stays enabled
  • Veo limited per household and globally
  • Generated clips expire after 14 days
  • Vertex and runtime spend monitored separately
The scheduler, event bus, and timers wake the agent. An always-running instance is not required.

THE COMPLETE AGENT STORY

It sees. It decides.
It acts. It proves.

RUN THE LIVE AGENT READ THE ENGINEERING SPEC