Latest AI and tech news

modal.com • Sep 14 • by Modal

Data science · community +7

+ = Sign in to like, bookmark, or love articles.

8945B

Product updates: Sandbox Sidecars, new models, a refreshed dashboard, and moreRecent product updates from Modal and news from around the community.

modal.com • Sep 2 • by Modal

Careers · london +6

+ = Sign in to like, bookmark, or love articles.

5F66E

Modal is expanding in Europe with our new London officeModal is expanding, and hiring on all fronts across Europe.

modal.com • Sep 2 • by Modal

Generative AI · Web development +12

+ = Sign in to like, bookmark, or love articles.

00EC4

How Botika runs full-stack generative AI on ModalBotika is building the next generation of tooling for agentic e-commerce brands, backed by a fleet of custom models trained and served on Modal.

modal.com • Aug 12 • by Modal

LLMs · Inference +8

+ = Sign in to like, bookmark, or love articles.

DF267

Qwen3.8-2.4T-A95B now available on ModalQwen3.8-2.4T-A95B by Alibaba, with a 1M token context window, is now available via Modal Auto Endpoints.

modal.com • Aug 4 • by Modal

Cloud · closer +7

+ = Sign in to like, bookmark, or love articles.

B282B

Bringing serverless functions closer to the speed of wireModal’s Function Call data path is now >50ms faster. Our new routing layer is geographically distributed, so you can further reduce your network overhead.

modal.com • Jul 29 • by Modal

AI agents · agent +7

+ = Sign in to like, bookmark, or love articles.

C1F8F

A note on the Hugging Face agent incidentHugging Face published a technical timeline of a recent agent intrusion. Modal's platform and isolation were not compromised in this incident.

modal.com • Jul 27 • by Modal

Computer vision · multimodal +7

+ = Sign in to like, bookmark, or love articles.

BCE21

Kimi K3 by Moonshot now available on ModalKimi K3, a 2.8 trillion parameter multimodal model by Moonshot, along with a custom-trained DFlash speculator, is now available on Modal.

modal.com • Jul 22 • by Modal

AI · Software engineering +8

+ = Sign in to like, bookmark, or love articles.

222D4

July 21, 2026Devin Outposts on ModalDevin, built by Cognition, is an AI software engineer: it plans, writes, tests, and ships code semi-autonomously. With Outposts, Devin can now run its work in Modal sandboxes.

modal.com • Jul 16 • by Modal

DevOps & SRE · million +7

+ = Sign in to like, bookmark, or love articles.

44F51

July 16, 2026Scaling to 1 million concurrent sandboxes in secondsHow (and why) we built a scheduling system that can scale to 1 million concurrent sandboxes (per workspace) in seconds.

modal.com • Jul 15 • by Modal

Computer vision · multimodal +7

+ = Sign in to like, bookmark, or love articles.

75477

July 15, 2026Inkling by Thinking Machines now available on ModalInkling, a general-purpose multimodal model by Thinking Machines, along with a custom trained DFlash speculator, is now available on Modal.

modal.com • Jul 12 • by Modal

Cloud · GPUs & chips +8

+ = Sign in to like, bookmark, or love articles.

E1FF8

July 6, 2026How to price serverless GPUsTo compare rates for serverless and reserved GPUs, look at your application's peak-to-average ratio.

modal.com • Jul 12 • by Modal

Generative media · diffusion +7

+ = Sign in to like, bookmark, or love articles.

E700F

July 1, 2026Multi-token Residual PredictionOne tiny module, two ways to win on Diffusion LMs

modal.com • Jul 12 • by Modal

Inference · inference +7

+ = Sign in to like, bookmark, or love articles.

880A8

June 23, 2026Introducing Modal Auto Endpoints: Optimized inference you actually ownLLM inference at SotA speeds and Modal quality, now available to everyone.

modal.com • Jul 9 • by Modal

machine · program +6

+ = Sign in to like, bookmark, or love articles.

6CE02

July 9, 2026Modal is a computerWhat is Modal? A machine that runs programs of arithmetic & logic operations on information.

modal.com • Jun 30 • by Modal

AI research · LLMs +9

+ = Sign in to like, bookmark, or love articles.

7B449

June 30, 2026Anthropic integration with Modal brings scalable compute to Claude ScienceAnnouncing our integration with Claude Science, bringing Modal's elastic compute to researchers when they need it.

modal.com • Jun 25 • by Modal

Inference · Kubernetes +8

+ = Sign in to like, bookmark, or love articles.

11B98

June 25, 2026Proxying inference requests in 6ms with Pingora, Envoy, and SpannerA deep dive inside our new ultra-low-latency primitive.

modal.com • Jun 22 • by Modal

Startups · Kubernetes +8

+ = Sign in to like, bookmark, or love articles.

4B3AF

June 22, 2026Unpacking sandbox startup latency: why started ≠ readyBuilding performant sandbox systems goes way beyond the initial container boot. Here, we unpack what that means, and discuss some tools to help you manage the entire lifecycle.

modal.com • Jun 14 • by Modal

Generative media · Inference +8

+ = Sign in to like, bookmark, or love articles.

B022A

March 26, 2026Runway chooses Modal to power real-time inference for Runway CharactersModal is proud to power real-time inference for Runway Characters.

modal.com • Jun 12 • by Modal

Inference · june +6

+ = Sign in to like, bookmark, or love articles.

B1B1A

June 11, 2026Making FlashAttention-4 faster for inferenceWhat part of "dtype = 'fp8', num_splits = 0, pack_gqa = True, q_stage = 1, page_size = 1" do you not understand?

modal.com • Jun 10 • by Modal

Machine learning · Open source +7

+ = Sign in to like, bookmark, or love articles.

01A5A

June 1, 2026Reinforcement learning is an infrastructure problemWhat we've seen helping teams run Reinforcement Learning at scale on Modal. Plus an open-source library to skip the scaffolding.

modal.com • Jun 10 • by Modal

Enterprise AI · AI & society +9

+ = Sign in to like, bookmark, or love articles.

15468

May 27, 2026Role-Based Access Control for humans and agentsIntroducing Role-Based Access Control for humans and agents, now available for all users on Teams and Enterprise plans.

modal.com • Jun 10 • by Modal

AI economy · Cloud +10

+ = Sign in to like, bookmark, or love articles.

872B3

May 21, 2026Modal's Series C: Raising $355M at a $4.65B valuationWe've raised $355M at a $4.65B valuation to continue building the production cloud for AI.

modal.com • Jun 10 • by Modal

Languages · Computer vision +11

+ = Sign in to like, bookmark, or love articles.

E669A

May 4, 2026Boosting multimodal inference performance by >10% with a single Python dictionaryIf we've said it once, we've said it once per millisecond: never block the GPU.

modal.com • Jun 10 • by Modal

AI agents · LLMs +6

+ = Sign in to like, bookmark, or love articles.

F5272

May 19, 2026Introducing Claude Managed Agents with Modal Sandboxes

modal.com • Jun 10 • by Modal

Machine learning · Enterprise AI +10

+ = Sign in to like, bookmark, or love articles.

41B0E

May 20, 2026Scaling reinforcement learning at Applied ComputeHow Applied Compute trains custom agents with Reinforcement Learning for enterprises like DoorDash, Cognition, and Mercor on Modal.

modal.com • Jun 10 • by Modal

Inference · Robotics +7

+ = Sign in to like, bookmark, or love articles.

8E556

April 8, 2026Real-time inference for robots at Physical IntelligenceHow Physical Intelligence runs remote, real-time, robotic inference on Modal.

modal.com • May 12, 08:00 AM • by Modal

Cloud · deep +7

+ = Sign in to like, bookmark, or love articles.

F5EE2

May 12, 2026How we achieved truly serverless GPUsA deep dive on Modal's deep tech for fast boots.

modal.com • Apr 29 • by Modal

Automation · Software engineering +8

+ = Sign in to like, bookmark, or love articles.

26774

April 29, 2026Building an RL theorem-proving workflow on ModalLearn how AE Studio used evolutionary algorithms on Modal to efficiently improve Lean proof generation.

modal.com • Mar 7 • by Modal

Software engineering · march +6

+ = Sign in to like, bookmark, or love articles.

942DB

March 4, 2026Product Updates: Directory Snapshots, GLM-5, Billing updates and moreA roundup of everything we shipped in February: Directory Snapshots for Sandboxes, a free GLM-5 endpoint, new billing API, and more.

modal.com • Mar 7 • by Modal

AI research · AI +8

+ = Sign in to like, bookmark, or love articles.

194B1

February 25, 2026Accelerating AI research that accelerates AI researchLearn why researchers at Scaling Intelligence, Hazy Research, and other top labs are choosing Modal.

modal.com • Mar 7 • by Modal

project · sandbox +6

+ = Sign in to like, bookmark, or love articles.

0B3EC

February 24, 2026Directory Snapshots: Resumable project state for SandboxesIntroducing Directory Snapshots, a programatic way to snapshot a specific directory within a running Sandbox and mount it into another Sandbox later, independently of the base image and the rest of the filesystem.

modal.com • Feb 19 • by Modal

AI coding tools · AI agents +8

+ = Sign in to like, bookmark, or love articles.

CCE2D

February 19, 2026How Ramp built a full context background coding agent on Modal

modal.com • Feb 18 • by Modal

LLMs · Open source +7

+ = Sign in to like, bookmark, or love articles.

C33EE

February 11, 2026Try GLM-5, the new frontier of open intelligence, on ModalGLM-5 establishes a new SotA for open models. Try it free today.

modal.com • Feb 18 • by Modal

AI agents · AI coding tools +9

+ = Sign in to like, bookmark, or love articles.

02633

November 20, 2025Agents need good developer experience tooTurns out, good devex for agents looks a lot like good devex for humans.

modal.com • Feb 18 • by Modal

Inference · GPUs & chips +8

+ = Sign in to like, bookmark, or love articles.

8C192

November 18, 2025Host overhead is killing your inference efficiencyNever block the GPU.

modal.com • Feb 18 • by Modal

Inference · GPUs & chips +7

+ = Sign in to like, bookmark, or love articles.

508BC

November 19, 2025How Reducto improved enterprise-scale document processing latency by 3xLearn how Reducto used GPU memory snapshotting and flexible autoscaling to build fast multi-model pipelines.

modal.com • Jan 28 • by Modal

Cloud · Marketing & sales +7

+ = Sign in to like, bookmark, or love articles.

AAB1D

January 28, 2026Product Updates: Modal in AWS & GCP marketplaces, Sandbox improvements, and moreAll the latest news across product, content, community, and events this month.

modal.com • Jan 15 • by Modal

Machine learning · january +7

+ = Sign in to like, bookmark, or love articles.

317A8

January 15, 2026Seamless Computational Bio at Chai DiscoveryLearn how Chai Discovery moves seamlessly from ML experimentation to production antibody pipelines with Modal.

modal.com • Dec 28, 07:00 AM • by Modal

Data centers · DevOps & SRE +10

+ = Sign in to like, bookmark, or love articles.

FE8EE

December 28, 2025Keeping 20,000 GPUs healthyHow we do active and passive monitoring on hyperscalers and neoclouds.

modal.com • Dec 2, 07:00 AM • by Modal

GPUs & chips · LLMs +7

+ = Sign in to like, bookmark, or love articles.

E3C02

December 2, 2025Modal + Mistral 3: 10x faster cold starts with GPU snapshottingWe've partnered with Mistral to bring you Day 0 support for Mistral 3, with GPU-snapshot-optimized performance.

modal.com • Nov 13, 07:00 AM • by Modal

Fine-tuning · AI +11

+ = Sign in to like, bookmark, or love articles.

F3B77

November 13, 2025How Decagon shipped real-time voice AI on ModalHow Decagon and Modal made real-time voice AI possible, combining fine-tuned small models with a re-engineered inference runtime for sub-second latency.