/

Google Developers Blog

20 stories

Run Ray on TPU, Part 1: The foundations

Google Developers BlogLabsRun Ray on TPU, Part 1: The foundations Ray 2.55 introduces official, first-class support for Google Cloud TPUs, enabling developers to run distributed Python workloads on Google's accelerators using the familiar Ray task-and-actor APIs. To handle the strict n

September 6
Scaling Agentic RL: High-Throughput Agentic Training with Tunix

Google Developers BlogLabsScaling Agentic RL: High-Throughput Agentic Training with Tunix Tunix is Google’s new JAX-native post-training library designed to eliminate TPU idling bottlenecks when training multi-turn, tool-using LLM reasoning agents. It maximizes hardware throughput by combining highly concurre

September 6
Run Ray on TPU, Part 2: Ray AI libraries

Google Developers BlogLabsRun Ray on TPU, Part 2: Ray AI libraries This second installment explores how Ray’s higher-level libraries—Serve, Data, and Train—abstract the complexities of running AI workloads on Google's TPU slices. Ray Serve uses a simple topology configuration to correct

September 6
How to use Google microbenchmarks for evaluating TPU performance

Google Developers BlogLabsHow to use Google microbenchmarks for evaluating TPU performance Google's open-source TPU microbenchmark suite provides developers with granular performance metrics across Network, Compute, HBM, Host Transfer, and Attention components to validate real-world hardware capabilities. By l

September 6
Agent and Model Evaluations in Gemini Enterprise Agent Platform are now GA

Google Developers BlogLabsAgent and Model Evaluations in Gemini Enterprise Agent Platform are now GA Agent Platform's evaluation service is now generally available, providing developers with a unified engine to measure agent quality consistently across local development experiments and live production traffic. You can e

September 6
Enable on-demand expertise with Agent Skills in Genkit Go

Google Developers BlogLabsEnable on-demand expertise with Agent Skills in Genkit Go To prevent context window bloat and reduce token consumption, Genkit Go introduces Agent Skills based on a progressive disclosure architecture. Developers can package specialized instructions, scripts, and references int

September 6
Scaling real-time AI agents with session-aware load balancing

Google Developers BlogLabsScaling real-time AI agents with session-aware load balancing Real-time AI agents break traditional request-response load balancing paradigms because they rely on long-lived, stateful bidirectional streams that obscure true server capacity. To solve this, developers must implement

September 6
Model routing with Google Cloud API Gateway

Google Developers BlogLabsModel routing with Google Cloud API Gateway Google Cloud API Gateway now offers a model routing feature in Public Preview, allowing developers to dynamically route traffic to models like Gemini, Claude, or OpenAI OSS-GPT without hardcoding endpoints or managing op

September 6
Scaling AI Agent Infrastructure with the MCP Stateless updates

Google Developers BlogLabsScaling AI Agent Infrastructure with the MCP Stateless updates The 2026-07-28 Model Context Protocol (MCP) specification replaces legacy stateful constraints with a fully stateless core, enabling cloud-native horizontal scaling, serverless deployments, and standard round-robin load

September 6
Agent Plugins package your skills, tools, and more

Google Developers BlogLabsAgent Plugins package your skills, tools, and more Agent Plugins 1.0.0 is a new, vendor-neutral directory specification—backed by Google, Amazon, Microsoft, and others—for packaging Agent Skills and MCP servers into a single portable unit. By standardizing the manifest (

September 6
Mastering Edge AI on Raspberry Pi with LiteRT and Gemma

Google Developers BlogLabsMastering Edge AI on Raspberry Pi with LiteRT and Gemma Deploying secure, real-time Edge AI on Raspberry Pi is now simplified using LiteRT and lightweight Gemma open models. LiteRT optimizes CPU and GPU performance, delivering fast token speeds for models like Gemma4, enablin

September 6
Why Go is an Ideal Language for AI-Assisted Software Engineering

Google Developers BlogLabsWhy Go is an Ideal Language for AI-Assisted Software Engineering As AI coding assistants shift the developer's primary role from writing boilerplate to reviewing and maintaining systems, language choice becomes critical for long-term architectural integrity. Go directly addresses this

September 6
Introducing Credentio: Open Source C++ Library for C2PA Content Credentials from Google

Google Developers BlogLabsIntroducing Credentio: Open Source C++ Library for C2PA Content Credentials from Google Credentio is a newly released, open-source C++ library from Google that allows developers to integrate high-performance, local-first validation of C2PA Content Credentials into their client and server applications. By pr

September 6
HeyGen x Google Cloud: Bringing Avatar IV to TPUs

Google Developers BlogLabsHeyGen x Google Cloud: Bringing Avatar IV to TPUs HeyGen ported their 18B+ parameter Avatar IV video generation model to Google Cloud's Trillium (v6e) TPUs via torchax and XLA, utilizing FSDP and Ulysses sequence parallelism across an eight-chip mesh. To achieve a 1.86x

September 6
Build zero-trust AI agents with Google's Agent Development Kit

Google Developers BlogLabsBuild zero-trust AI agents with Google's Agent Development Kit Building autonomous AI agents that mutate production state requires moving beyond soft system prompts to a robust zero-trust architecture. To secure Google Agent Development Kit (ADK) workflows against prompt injections

September 6
How to Evaluate Live & Voice Agents in ADK

Google Developers BlogLabsHow to Evaluate Live & Voice Agents in ADK Moving live voice agents from demo to production requires rigorous, automated testing to handle the unpredictability of real multi-turn conversations. ADK now provides native live evaluation, allowing developers to test

September 6
Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU

Google Developers BlogLabsEnterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU Google Cloud has natively integrated TPU support into the vLLM serving engine, allowing developers to elastically scale high-demand embedding pipelines using Google Kubernetes Engine (GKE). To handle massive 15K+ token c

September 6
Decoding cosmic signals with deep learning and Keras

Google Developers BlogLabsDecoding cosmic signals with deep learning and Keras Astroparticle physics sits at the exciting intersection of astrophysics and particle physics and stu...

September 6
4 engineering patterns behind the strongest AI Agents Challenge submissions

Google Developers BlogLabs4 engineering patterns behind the strongest AI Agents Challenge submissions The recent Google for Startups AI Agents Challenge revealed that the most successful multi-agent systems rely on foundational software engineering patterns rather than just raw model power. Winning architectures consiste

September 6
Driving Developer Excellence: Inside the Program Sprints

Google Developers BlogLabsDriving Developer Excellence: Inside the Program Sprints The Gemini Enterprise Developer Experience (DevEx) program conducts ongoing sprint testing of end-to-end developer workflows to identify and rapidly resolve friction points without relying on internal shortcuts. This rec

September 6