GLASSFLOW

The Context Layer for Physical AI Agents

The context layer for
physical AI agents.

Deploying multimodal AI agents takes two things: hardware in the field, and the entire data plane to manage what it streams. GlassFlow solves both by mapping live feeds from smart glasses, phones, and PCs into one centralized, self-hostable brain.

Every session is recorded, attributed, and indexed: who streamed it, what they said, and what happened. Your agents and your people can search, replay, and verify task completion with evidence. Open-source server. Your data stays yours.

BUILT FOR
HVAC
TELECOM
ELECTRICAL
PLUMBING
SOLAR
HEALTHCARE
MANUFACTURING
FIELD SERVICES
HVAC
TELECOM
ELECTRICAL
PLUMBING
SOLAR
HEALTHCARE
MANUFACTURING
FIELD SERVICES
The Problem

Physical AI agents need hardware and a data plane.

Any enterprise deploying multimodal AI agents needs devices that see and hear where work happens, plus the entire software stack to manage what they stream: routing live feeds, deciding which agent receives which pipeline, recording, indexing, securing, and searching everything. Today teams assemble both from scratch. GlassFlow is the packaged answer: clients on any device (smart glasses first, with phones and PCs supported), and a centralized, self-hostable server that becomes the context layer underneath every agent.

How It Works

Live feeds in. Searchable operations out.

live room egress / recording media verification ASR / transcript keyframe sampling scene analysis (VLM) + OCR entities · topics · action items summary + searchable text + chunks embeddings index ready

The indexer is the differentiator: every artifact lands timestamped on two clocks (session and media) and attributed to the participant who produced it. That is the structure agents need to reason over real work.

The Canonical Scenario

One task. Five people. Every device.

An admin creates a task and deploys agents. The team of five connects from whatever they have: three on smart glasses, one on a phone, one on a PC. Everyone lands in one live-feed room: each participant sees the others' feeds and shares a voice channel, while an agent summarizes the conversation, saves every pipeline, and indexes it all as it happens.

Search & Replay

Ask anything. Land at the exact second.

Query

“when did anyone inspect the compressor?”

Hybrid semantic search runs over transcripts, video scenes, visible text, entities, and events, so paraphrases hit too, not just keywords.

Result

worker-a · scene @ 12:34 → replay

Every hit deep-links into the replay viewer at the cited media timestamp, attributed to whoever streamed it, and task completion is verified against the same evidence.

Deploy

Managed cloud, or your own hardware.

Run GlassFlow as a managed cloud, or self-host the entire server with Docker. Feeds, indexes, and replay stay on your infrastructure. Point your own models at the indexes and GlassFlow becomes the brain of your company. See deployment options ↓

Open Source

Open-source server. Private clients.

The control plane, indexer, and dashboard are open source, so you can inspect the data plane you trust with your operations. The client apps for glasses, phones, and PCs ship separately.

Explore the technology
"
The Vision

AI is stuck at a desk. We bring it to the field.

Most AI conversations focus on desk jobs. But in the physical world, AI still can't act.

What it can do is see, reason, and guide the human who does.

Imagine a worker wearing a lightweight camera while AI sees what they see and coaches them in real time.

Instead of months of training, workers become effective immediately.

Why now? Three things have converged.

Multimodal AI

AI can now understand real-world visuals.

Invisible Hardware

Cameras and mics are already in everyday glasses.

Labor Shortage

Skilled workers are harder to find than ever.

The Solution

The Interface & The Brain.

How we deliver AI superpowers to your workforce.

Part A: The Interface

Looks like glasses. Works like a copilot.

Real-time guidance, hands-free.

Real-time vision

AI sees what the worker sees.

Two-way coaching

Workers ask. AI responds instantly.

Smart glasses hardware, Meta Ray-Ban with camera, mic array, and open-ear speakers
12MP
Ultra-wide Camera
39g
Lightweight Frame
4hr+
Streaming Battery
5-Mic
Array + Open-Ear Speakers
Part B: The Brain

Glasses see. Cloud thinks.

Monitor, assist, and optimize your distributed workforce from one screen.

Real-time oversight

See every worker, live.

Data extraction

Turn work into structured insights automatically.

Fleet Command Center · Live Preview

One screen. Every worker. Every decision.

Monitor, guide, and improve operations in real time.

Create an Account
GlassFlow command center dashboard, live fleet status, attention queue, guidance feed, field map, and agents

Live Video Feed

See what any worker sees, in real-time, from your browser.

Cloud Recording

Every session stored, searchable, and queryable in your private cloud.

Worker Analytics

Task completion, response times, safety compliance, all tracked automatically.

Enterprise Security

End-to-end encryption. Your data stays yours.

iOS Companion

Your fleet, in your pocket.

Available on iPhone. Access every recording, device, and live stream the moment you step away from your desk.

Archive replay Device pairing On-the-go review

Same fleet. Same recordings. Two surfaces.

GlassFlow iOS companion, recorded feeds archive and glasses pairing
Superpowers

What happens when you plug in?

The immediate advantages of an AI-powered workforce.

0

Days to Onboard

Workers put on the glasses and start immediately. No manuals, no shadowing. Productive from minute one.

100%

Visual Documentation

Every task is recorded from the worker's perspective and stored in your cloud. Fully searchable and auditable.

∞

Scalable Intelligence

The more you deploy, the smarter the system gets. Identify bottlenecks and recurring issues across teams.

Remote Oversight

See what workers see in real time. Guide, verify, and manage without being on-site.

The Data Advantage

Operational knowledge is captured continuously, building a system that doesn't depend on individual workers.

Skill Library

Build Claude-style skills for physical work.

Claude Skills package repeatable digital workflows. GlassFlow packages physical workflows from expert video into SOPs, guidance, focus points, trainee assessments, and live skills for glasses and phones.

Claude Code lets developers build and share reusable skills for software. We do the same for the physical world, and it all runs on the context layer below. Capture your best technician's expertise once; deploy it to your entire workforce instantly.

Source 1 · Upload demo video
GlassFlow skill generation, upload a demo video and Gemini extracts steps, tools, and an agent prompt

Drop an mp4, mov, webm, or mkv. Add optional context, then turn the best operator's process into a guided SOP and physical skill.

Source 2 · Extract from a session
Session details panel with an Extract Skill form, ready to pull a reusable skill out of a recorded GlassFlow session

Pick any past GlassFlow session, describe the skill, and pull it out of the recording.

Capture

Record expert work and generate SOPs with images, guidance, and focus points.

Assess

Let trainees record themselves following the SOP and identify evidence for every task.

Standardize

Reduce skill loss, compare workforce performance, and improve every skill version.

Custom Agents

Run the multimodal engine behind every skill.

Configure the system prompt, tools, voice, routes, and behavior. Every skill runs on live glasses and phone clients, customized to the way your team actually works.

GlassFlow agent builder, configure system prompt, model, tools, voice, and behavior for an HVAC Inspector agent deployed to smart glasses

System prompt

Define the agent's role, tone, and operating rules.

Tools

Scene analyzer, OCR, photo capture, alerts — toggle per agent.

Voice & behavior

Pick the voice, language, response style, and barge-in rules.

Skills & knowledge

Attach skills from the library and your private knowledge base.

The 3D Context Layer

What GlassFlow sees.

Every frame from the glasses builds a live 3D map of the physical space. The copilot sees geometry, depth, and layout the way the worker does.

Reconstructed from POV feed
Point Cloud · Live

Dense geometry, in real time.

A worker inspects an LCD panel. GlassFlow reconstructs the surface, edges, and depth cues so the copilot knows exactly what the worker is seeing.

Environment · Live

Whole environments, on the move.

As the glasses move through a train car, GlassFlow builds a persistent spatial map of walls, seats, people, and signage — even in fast-changing scenes.

End-to-end

GlassFlow
in action.

Live POV from the glasses, AI guidance layered on top, and a structured record of the session. Every job flows through all three in real time.

Recorded · Indexed · Reusable
POV · Glasses

Worker wears the glasses.

First-person feed streamed live from the job site, hands-free capture, no rigs, no extra hardware.

AI · Guidance

AI coaches in real time.

The copilot reasons over the feed and talks the worker through the next step, identifying parts, flagging risks, answering questions out loud.

Dashboard · Output

Session becomes knowledge.

Every job is indexed into a searchable, replayable record, so tomorrow's worker walks in with yesterday's expert already loaded.

Live POV AI Guidance Structured Output
Use Cases

Superpowered workers in every vertical.

Where AI vision changes the physical world.

Field Services & HVAC

Instant Master Mechanic

Identify equipment, diagnose issues, and guide repairs in real time. First-fix rates improve significantly.

Equipment ID Step-by-step repair Safety alerts
Telecom & Electrical

Wire-Perfect Every Time

Detect wire types, validate installations, and prevent errors before they happen.

Fiber splice guidance Code compliance Wire identification
Healthcare & Manufacturing

Flawless Compliance

Guide workflows step-by-step while ensuring compliance and quality.

Protocol compliance Defect detection Procedure recording
Get Started

Ready to give your workers AI superpowers?

Software engineers have AI writing their code. It's time to give the physical world the same advantage.

Enterprise
Full Deployment

For organizations ready to deploy at scale. Hundreds of glasses, centralized management, custom AI configurations, and dedicated cloud infrastructure for your workforce.

  • Unlimited glasses & cloud storage
  • Fleet management dashboard
  • Custom AI training on your procedures
  • Dedicated support & SLA
Pilot Program
Try It First

Start with a small team to prove the value. Get 5 pairs of smart glasses, full dashboard access, and see measurable ROI before committing to a full rollout.

  • 5 Meta Ray-Ban smart glasses included
  • Full dashboard & cloud access
  • 30-day guided implementation
  • ROI analysis & recommendations