ALT VLM Run October 2026 changelog: OCR Playground to compare OCR models side by side; Claude MCP connector for VLM Run Gateway; System One extracts fields from images and PDFs; System One adds native Image and Box support (TypeSafe assets and bounding boxes), TypeSafe-compatible; new models: LightOnOCR-3-4B, EmbeddingGemma 2, Nemotron 3.5 Parse; new docs pages for Methods, Response Formats and Supported Inputs.
ALT EmbeddingGemma 2, now on VLM Run Gateway. Text, images, documents, video, and audio in one vector space.
ALT One embedding space: a map of twelve inputs, each a dot. An invoice image and an invoice PDF sit together with the text an invoice; two different robot videos sit together with the text robot arms; a video about a bakery, a photo of a vintage car and an audio clip each sit next to their text. Images, video, audio, PDFs and text from a live EmbeddingGemma 2 run.
ALT Model card: one multimodal embedding model. Text, code, image, document, video, and audio, searched together in one vector space. $0.01 per 1M tokens, 740M total params, 768 to 128 dims picked per request, Apache 2.0 license.
ALT Get started in a few lines of code: Python calling client.embeddings.create with model google/embeddinggemma-2, an image input, and prompt_name Document, printing 768 dims and 288 tokens; commented lines show the same call with an audio file (speech.wav), a PDF (report.pdf) or a video (clip.mp4). From your terminal: uvx vlmrun gw embed for an image, a video clip, and a text query. Sign up for a free API key at app.vlm.run.
ALT Bar chart of p50 latency to extract 10 invoice fields with Gemma 4 26B, /chat/completions vs /systemone. Text: System One 308 ms, JSON Schema 1,132 ms, JSON Mode 1,012 ms. Two-page PDF: 410 ms, 1,260 ms and 1,104 ms.
ALT LightOnOCR-3-4B, now on VLM Run Gateway. One model for Markdown, grounding, and layout.
ALT Every value comes with its box: a sample invoice with the model's grounding output drawn on it, each block boxed and labeled as title, text, table or footer.
ALT Model card: three methods, markdown, grounding and layout, with block types text, title, table, chart, formula, image, footer. $0.20 per 1M input and $0.50 per 1M output tokens. 4B params, Apache 2.0. 86.3 on olmOCR-Bench, 75.1 on ParseBench.
ALT Get started in a few lines of code: Python calling client.chat.completions.create with model lightonai/lightonocr-3-4b and method grounding, printing the blocks as JSON. From your terminal: uvx vlmrun gw chat page.jpg with methods markdown, grounding and layout. Sign up for a free API key at app.vlm.run.
ALT 22 numbered lines of Python. A TypeSafeClient for gateway.vlm.run/typesafe with model google/diffusiongemma-26b-a4b-it reads invoice.png as a data URL and asks System One "What kind of page is this?" with choices invoice, receipt and slide, then prints the label.
ALT VLM Run September 2026 changelog: gateway beta with 20+ visual models; new System One (s1) API, TypeSafe-compatible, image inputs; TypeSafe SDK works by swapping base_url; s1 engines DiffusionGemma-26B, Gemma4-26B, Qwen3.8-27B; WebSocket for s1 decisions; new gateway docs.