The machines talk back

What if you could ask your machine a question — and it could talk back? That’s now a reality with forthcoming technology from several OEMs. Bobcat, Caterpillar, and Hitachi all demonstrated AI assistants at CONEXPO-CON/AGG, with some differences in use case and implementation.

Bobcat‘s in-cab assistant for compact equipment, Jobsite Companion, is a streamlined system that gives operators the option to activate and deactivate machine functions via voice command. It can answer questions about the machine’s status and provide real-time job cost and performance insights. All computing functions are done on board, facilitating lightning fast response to instructions and queries.

Cat’s AI Assistant is a conversational tool that can currently be used within Cat web and app experiences, including VisionLink. It’s designed to provide clear responses to questions covering service needs, fleet utilization, parts and products, dealer information and scheduling, and more. Cat is working on incorporating the assistant into future machine cabs, where it will offer voice-activated coaching, troubleshooting help, service scheduling, and more.

Hitachi‘s assistant, Assist Pro, lives on the user’s mobile device, making it flexible for operators, technicians, and project managers inside or outside the cab. This prototype assistant is ready to provide quick retrieval of requested information — drawing from Hitachi’s repository of technical manuals, video tutorials, images, and promotional materials. Hitachi notes that this system will gauge the complexity of the user’s query and adapt its response to their experience level.

There’s a real need behind these flashy new features — operators who are less experienced need quick, real-time information to understand their equipment. With these new tools, OEMs are making that information available in a faster, more accessible format that will keep the operator working instead of flipping through a manual.