Latest Artificial Intelligence News & Technical Dispatches

NVIDIA ships TensorRT-LLM 0.18 featuring native SGLang runtime engine integration, sub-1ms TTFT radix attention kernels, and Blackwell FP4 serving support.

Anthropic unveils Claude Code Enterprise Fleet with distributed AST refactoring, shared memory checkpointers, and multi-developer workspace synchronization.

Meta open-sources Muse Spark Open, a 14B dense reasoning model with test-time compute scaling that matches 70B parameter models on STEM and coding benchmarks.

Compare Graph RAG knowledge graphs against hierarchical vector clustering across 10,000 multi-hop reasoning queries for agent retrieval precision and latency.

Benchmark Lookahead Decoding against Medusa multi-head speculation on dual NVIDIA H100 GPUs across 100,000 inference requests for TTFT and memory bandwidth.

Benchmark deterministic AST code refactoring against raw LLM code generation across 500 repository migrations to evaluate syntax validity and token costs.

Explore Mistral AI Voxtral 3 featuring end-to-end multimodal audio reasoning, sub-45ms voice-to-voice streaming, and low-latency open-weights deployment.

Explore Google DeepMind Gemini 4 Carbon featuring native high-framerate visual reasoning, sub-100ms DOM action latency, and autonomous browser execution.

Explore how OpenAI models and Codex agentic workflows enter Google Cloud Model Garden, enabling native Vertex AI private endpoints and commit drawdowns.

Compare Radix prefix caching against context window compaction across real-world multi-turn autonomous agent latency, cache hit ratios, and token costs.

Benchmark KV cache pruning against chunked prefill in vLLM to optimize long-context serving throughput, reduce TTFT, and eliminate GPU memory exhaustion.

Analyze reasoning budget allocation mechanics comparing test-time search tokens and RL fine-tuning across real-world cost, latency, and accuracy benchmarks.

The Allen Institute for AI ships SERA and OLMo 2 32B, delivering fully open-weights repository coding agents with soft verification and Apache 2.0 weights.

Google Cloud unveils the Gemini Work Agent, granting enterprise AI dedicated Workspace accounts, unified activity audit logs, and cross-application execution.

Analyze tiered KV cache offloading to NVMe SSDs with INT4 quantization and GPUDirect Storage to scale 512K context LLM serving at 70% lower GPU VRAM cost.