Back to news

Sep 3

2026

Vitrus Research

LVL-1 · 100M parameters

LVL-1: A 100M Parameter Micro-World Model

LVL-1 does not ask one small model to learn vision from scratch. It extracts different kinds of spatial evidence from specialized visual models, then compresses that evidence into a 100M-parameter language core.

LVL-1 launch film · 52 seconds

01 / The question

Spatial knowledge is not one thing

A useful description of a physical scene must preserve several kinds of evidence at once: what is present, where it appears, how surfaces and objects are arranged, and what interaction is unfolding.

Object identity is semantic knowledge. Boundaries, parts, and relative position are local and dense knowledge. Relations such as above, inside, held by, or approachingrequire those visual signals to survive long enough to become language.

LVL-1 is an experiment in extracting those specific priors from specific models. It is not a metric 3D reconstruction and it does not maintain a world state through time. It turns one image into a compact, local observation that another spatial system can retain, compare, or reject.

02 / The sources

Ask each model for the knowledge it already has

LVL-1 freezes two complementary visual encoders and trains the bridge into language. The architecture is deliberately asymmetric: the visual models carry the expensive priors; the small decoder learns which evidence to preserve and how to express it.

SigLIP 2 Base

Semantic localization

Supplies language-aligned object and region meaning. SigLIP 2's training explicitly improves localization and dense features, while its NaFlex variant preserves native aspect ratio.

SigLIP 2 paper

DINOv2 Small

Dense visual structure

Supplies self-supervised image and pixel-level features that transfer to tasks such as segmentation and depth. In LVL-1, that lane contributes shape, part, texture, and layout cues.

DINOv2 paper

ARC-Text 100M

Relational serialization

Receives a learned 131-token visual prefix and turns selected evidence into concise English. It is the compression and expression layer—not the source of the visual representation.

LVL-1 architecture with SigLIP 2 and DINOv2 visual streams feeding a compact language core
Frozen SigLIP 2 and DINOv2 features are pooled and projected into a learned 131-token visual prefix.

This bottleneck is the central research question. If pooling removes a small tool, a hand-object contact, or an object boundary, the decoder cannot recover it later. A compact VLM therefore succeeds by selecting useful spatial evidence—not by retaining everything the encoders know.

03 / The training signal

Teach the bottleneck what must survive

The <DESCRIBE/> task rewards visible objects, spatial relations, activity, and scene context. The<2D_BBOX/> task asks the same model to retain explicit image-space localization. They share the visual prefix but demand different outputs.

No-image and wrong-image counterfactuals are equally important. They penalize a decoder that can imitate familiar training prose without consulting the current image. Text replay protects the language core from collapsing into a narrow caption template.

The encoder names do not guarantee grounding. Spatial knowledge only reaches the output when the projector, token budget, supervision, and counterfactual tests all preserve it.

04 / Performance

In-distribution speed, measured exactly

Restricting the archived run to 50 held-out real test frames from the same source families represented in training—AgiBot, DROID, RH20T, and Open Images—produces a median 143.122 decode tokens/s and 284.641 ms end-to-end latency on an Apple M4 Mac mini with 16 GB of unified memory. Synthetic and OOD stress images are excluded from this view.

LVL-1 in-distribution runtime performance on 50 held-out real images from AgiBot, DROID, RH20T, and Open Images
Step 6000 · <DESCRIBE/> · 32-token cap · median runtime measurements. This is not a caption-accuracy score.

The broader launch benchmark adds 50 synthetic stress images to the same 50 real frames. Every image uses the same <DESCRIBE/> prompt and 32-token cap. The tables below preserve those original, published protocols.

Apple M4 Mac mini

100-image suite · median unless noted

Decode throughput
142.997 tokens/s
Generation throughput
135.470 tokens/s
Median end-to-end latency
284.552 ms
P90 end-to-end latency
286.725 ms
Vision encoding
46.776 ms
Prefill / time to first token
19.197 ms
Allocated MPS memory
441.1 MiB

Raspberry Pi 5

Five warm runs · single evaluation image

Decode throughput
31.807 tokens/s
Generation throughput
22.772 tokens/s
Warm end-to-end latency
2.236 s
Cold end-to-end latency
2.396 s
Vision encoding
1.318 s
Prefill / time to first token
305.856 ms
Process memory
958.1 MiB

The Raspberry Pi result used ONNX Runtime on four Cortex-A76 CPU cores with 8 GB of RAM. Its five-run, single-image protocol is not directly comparable to the 100-image Mac suite. These measurements describe runtime performance, not caption accuracy.

05 / Limits

What 100M parameters can see

LVL-1 can produce useful descriptions of robotics workcells, electronics benches, tools, containers, people, and everyday environments. It also has clear limitations.

The model can repeat objects, miss fine details, hallucinate plausible elements, or lose grounding outside its training distribution. It is not a safety system, a geometric measurement tool, or a robot controller.

The next work is better spatial resolution, cleaner grounded supervision, less repetition, and evaluation that measures whether the model is truly using the image.

06 / Physical intelligence

A local account of a shared world

Vitrus is building machines that need to observe and operate in changing physical environments. We do not expect one small model to understand an entire factory. We expect many specialized observers to contribute evidence to a shared spatial system.

LVL-1 describes what a camera can see. Calibration and geometry establish where things are. VitrusOS maintains state, validates constraints, and controls what machines are allowed to do.

07 / LVL-1 and NVIDIA Cosmos

Two different layers of physical AI

LVL-1 is not a miniature Cosmos. NVIDIA's current Cosmos family targets broad world modeling across language, images, video, audio, and actions. Cosmos 3 connects understanding, generation, simulation, and action in one omnimodal system. LVL-1 deliberately occupies a narrower layer: extracting a compact observation from one image, locally and quickly.

Axis
LVL-1
NVIDIA Cosmos
Primary job
Extract compact evidence from one image
Understand, reason about, generate, and simulate physical worlds
Spatial scope
Objects, regions, relations, activity, scene context
Spatial plus temporal state, physical common sense, future evolution, and action
Model scale
0.1B language core / 0.218B deployed VLM
A family spanning billion-scale reasoners and world generators
Runtime intent
Edge-first local observer
Foundation models for broader Physical AI workflows
Output
Short description or experimental 2D boxes
Reasoned responses, generated worlds, video, and policy/action representations, depending on the model

A concrete point of reference is Cosmos-Reason1-7B, which consumes video and text and is trained for physical common sense and embodied reasoning. NVIDIA'sCosmos-Predict2.5 instead uses 2B and 14B models to predict future world states as video. Those are fundamentally broader tasks than LVL-1's single-image extraction.

The systems can be complementary. A Cosmos model can serve as a teacher, reasoner, or simulator upstream; a compact model like LVL-1 can run beside cameras and machines, continuously turning familiar visual scenes into low-cost evidence. The comparison above is architectural—not a quality or speed leaderboard. There is no shared checkpoint, task, hardware, or benchmark that would support a direct score.

Open research release

Build with LVL-1

LVL-1 is available under noncommercial, research-only terms. For commercial licensing and applications, contact Vitrus.

LVL-1: A 100M Parameter Micro-World Model | Vitrus