> At a Glance
> – Caterpillar pilots Cat AI in its 306 CR Mini Excavator using Nvidia Jetson Thor
> – System answers operator questions, schedules services, and broadcasts safety alerts
> – Digital twins built on Nvidia Omniverse simulate material needs and schedules
> – Why it matters: Field workers get real-time insights without leaving the cab
Caterpillar is testing an AI co-pilot in excavators and digital twins of entire job sites, aiming to turn live machine data into on-the-spot decisions for operators who “live in the dirt.”
Inside the First AI-Ready Excavator
The Cat AI prototype runs on Nvidia’s Jetson Thor edge computer inside a mid-size 306 CR Mini Excavator. A fleet of AI agents powers voice help, on-screen resources, proactive safety tips, and one-touch service booking.
Brandon Hootman, VP of data and AI, says the goal is simple: keep operators productive without extra screens or downtime.
Digital Twins Map Projects Before Ground Breaks
Caterpillar feeds roughly 2,000 messages per second from connected machines into Nvidia Omniverse. Engineers then run what-if schedules and calculate exact material volumes before crews arrive.
| Simulation Use | Benefit |
|---|---|
| Schedule testing | Reduce idle time |
| Material forecasting | Cut waste and over-ordering |
| Conflict detection | Avoid clashes between crews |
The company already runs fully autonomous trucks in mining; these pilots target road-building and urban projects.
Bill Dally, Nvidia chief scientist, calls physical AI the chipmaker’s next frontier after gaming and cloud GPUs.
> “Physical AI is the next wave of AI. Nvidia is pioneering that with computers that train the models, that do the simulation to test the models and deploy the models into the robots, whether that’s an autonomous car or a Caterpillar machine.”
> Deepu Talla, VP of robotics and edge AI, adds that every firm is now a robotics company in some form.
Key Takeaways
- Cat AI gives operators instant answers and service booking from the cab
- Omniverse twins translate live machine data into pre-build logistics
- Caterpillar’s mining autonomy success paves the way for construction automation
- Nvidia sees construction equipment as the new frontier for physical AI
The partners will demo the system at CES, signaling that heavy iron and silicon are now on the same timeline.
