Waymo is experimenting with generative AI and other technologies for its self-driving cars, but the company believes the assortment of laser sensors and radars mounted on its cars remains the safest way to run a robotaxi service at scaleâat least for now.
âWeâve done a lot of research. Weâre aware of what works and what doesnât work at our scale and what we need to do,â Srikanth Thirumalai, who is vice president of onboard engineering for the current robotaxi industry incumbent, Waymo, said this week at the Ai4 Conference in Las Vegas.Â
While rivals like Tesla are pushing self-driving cars that rely solely on video cameras, Waymoâs Thirumalai says the combination of LiDAR and radar provides âan additional safety netâ to make sure that the company has the adequate data it needs to make driving decisions âunder all conditionsââincluding extreme weather.
Thirumalai was speaking on stage in an interview with Fortune. Earlier that day, Thirumalai gave a solo presentation, describing Waymoâs AI stack and approach to safety in detail that has allowed the company to scale its operation to five cities by mid-2025 and conduct more than 100 million driverless miles. In his presentation, Thirumalai showed a video of how LiDAR sensors on the Waymo Jaguar I-PACE had picked up movement from human beings readying to jump in the road, even when the vehicleâs cameras had notâor a woman preparing to go around a stopped bus and directly into the path of a Waymo robotaxi. In both instances, Waymoâs robotaxi stopped or maneuvered out of the way to avoid contact with the pedestrians, according to the videos.
The presentation showed the stark contrast in approaches between Waymo and one of its newer rivals, Tesla, which launched a small-scale, invite-only robotaxi service in Austin this June, with safety drivers in the passenger seat. Tesla, which was demonstrating its full self-driving (FSD) technology via demo rides at the Ai4 Conference, is only using video cameras and its AI technology for FSD and Tesla Robotaxi, after years of Elon Musk stating that other sensors are expensive and unnecessary. âLiDAR is a foolâs errand,â Elon Musk said in 2019. âAnyone relying on LiDAR is doomed. Doomed! [They are] expensive sensors that are unnecessary.â
Thirumalai wouldnât say directly whether he considered camera-only self-driving systems like Teslaâs to be safe for the public roads. He said that you have to consider âthe whole processâ of how a system is built, tested, then validated, and he also said that you cannot statistically compare Waymoâs system to another, because of the lack of comparable safety metrics. General Motorsâ subsidiary Cruise, which also used LiDAR and radar systems, suspended operations earlier this year after it failed to relaunch after a serious accident in San Francisco. For context, Tesla said it had driven 7,000 driverless miles at the end of July, compared to Waymoâs 100 million.
âIf we are talking about objective measures, then we have to look at the statistics of our safety record, at scale, right?â Thirumalai said. âWhen someone actually says: Yes, we matched your safety at your scale with a different system, thatâs great. Weâll take that.âÂ
Waymo is regularly testing new technology as it becomes available, according to Thirumalai. As part of that experimentation, he said that Waymo has researched how multimodal models like Gemini can be incorporated into the Waymo tech stack (Waymo has not tested any other generative AI models besides Googleâs Gemini, Thirumalai confirmed). The robotaxi company has published several papers of its research into multimodal models, including a city-scale traffic simulation with a generative world model as well as Waymoâs research around EMMA, Waymoâs End-to-end Multimodal Model for Autonomous driving. Waymo has reported that co-training its vehicles with EMMA helped with things like object detection and road graphs, saying there was âpotentialâ for EMMA as a generalist model for autonomous driving applications. However, EMMA is expensive, can only process a small number of image frames, and does not incorporate LiDAR sensors or radarâall of which lead to âchallengesâ for using EMMA as a âstandalone model for drivingâ
Thirumalai said incorporating generative AI models into the self-driving tech stack is an area of âintense research,â and that he believes this will continue. âBut thereâs a lot more work thatâs going to be needed to make the system as simple as possible,â he said.

