【車訊網 報道】 在端側配備智能護欄功能的多模態模型可實現更無縫、更安全的車內交互,解鎖強大功能,遠超單純的信息娛樂體驗
上海及馬薩諸塞州伯靈頓,2025年4月23日——Cerence Inc.(NASDAQ: CRNC)(“賽輪思AI”),全球對話式AI用戶體驗創新的領導者,今日宣布與聯發科(MediaTek)達成全新戰略合作關系,并擴大與英偉達(NVIDIA)的現有合作,共同推出下一代CaLLM™ Edge,一款專為汽車用戶交互體驗設計的嵌入式小語言模型(Small Language Model,SLM)。憑借由NVIDIA AI Enterprise軟件驅動的全新多模態功能,CaLLM Edge將使車內交互比以往任何時候都更智能、更具感知能力、更人性化、更安全。這款多模態端側小語言模型(SLM)已無縫集成到Cerence xUI™——全新一代端云混合、智能體化的AI平臺,并將于2025上海車展上首次亮相。
此次發布的信息源于聯發科與英偉達的持續合作,聯發科的汽車級天璣汽車座艙芯片組集成了英偉達的GPU、人工智能和圖形技術。如今,這兩家公司已與賽輪思AI攜手推出多模態端側解決方案,為汽車制造商提供卓越性能并具有成本效益,同時為駕駛者和乘客解鎖強大的新功能。利用聯發科的汽車座艙解決方案,并率先在NVIDIA DRIVE AGX上進行優化,CaLLM Edge的先進多模態功能通過雙處理平臺,針對車內部署進行高效率微調,實現了車內車外的全新情境感知。
聯發科展臺上展示由賽輪思AI 提供技術的車載AI語音助理
賽輪思AI產品與技術執行副總裁Nils Schanz(左四)和聯發科企業副總裁兼汽車業務總經理Mike Chang(左五)在上海車展現場
上海車展標志著Cerence xUI首次在NVIDIA DRIVE AGX上運行,并集成到模擬量產的汽車設計中,該設計復制了實車的多座環境,為駕駛者和乘客帶來無縫、個性化的交互體驗。關鍵創新包括:
車內智能提升——想象一下,您的汽車能感知到您何時在與它交談,何時沒有。您可以要求推薦意大利餐廳,然后問乘客:“第二家怎么樣?”車載助理會知道要等待,再繼續對話。此外,它還能同時處理駕駛者和乘客的指令,例如,“打開我的車窗”,隨后說“我也要”。或者,想象一下,您的汽車可以在您短途旅行時照看您的寵物,或者在您駕駛時回答有關后座小孩的情況。
車外情境感知增強——想象一下,一個助理不僅能提供車內信息,還能提供車外世界的信息。例如,它能解釋或翻譯路標,識別路邊建筑,甚至提供有關廣告牌上有趣事物的詳細信息。Cerence xUI可以結合汽車傳感器數據以及內部和外部攝像頭視頻流,利用CaLLM Edge多模態SLM,在端側實現實時輸入處理——所有這些應用場景都將首次在上海車展上展示。
端側智能護欄——賽輪思AI已針對NVIDIA DRIVE AGX平臺開發了優化的汽車智能護欄技術,該技術整合了NVIDIA NeMo Guardrails功能,確保其驅動的系統在連接條件受限時,仍能安全可靠地提供品牌專屬的車內交互體驗。這些智能防護機制有助于最大程度減少分心、防止誤用,并確保語音交互始終保持情境感知且符合安全規范。
除了這些為駕駛者帶來的新功能外,CaLLM Edge還為汽車制造商提供了關鍵優勢。多模態處理的主要工作在端側完成,這意味著所需的云端帶寬更少,汽車制造商成本更低。此外,使駕駛者能夠訪問車外信息,并提供先進的生成式人工智能功能,為車企解鎖了新的訂閱服務和收入來源。
賽輪思AI產品與技術執行副總裁 Nils Schanz 表示:“隨著我們不斷突破CaLLM系列云端和嵌入式語言模型的極限,我們繼續提升滿足各種汽車制造商及其特定信息娛樂平臺需求的能力。通過與聯發科和英偉達合作,我們為CaLLM Edge注入了實時感知和情境感知能力,重新定義了車內體驗。”
聯發科企業副總裁兼汽車業務總經理Mike Chang表示:“賽輪思AI的CaLLM Edge與聯發科天璣汽車平臺的結合,為車輛中強大的多模態、生成式人工智能驅動體驗奠定了堅實基礎。聯發科天璣汽車平臺在端側支持Cerence LLM和SLM,而我們新推出的配備雙AI引擎的C-X1非常適合可靠地同時運行多個AI任務。這一合作是我們汽車生態系統的重要補充,將使全球汽車品牌能夠自信地加速下一代設計。”
英偉達汽車業務副總裁Rishi Dhall表示: “賽輪思AI與聯發科的合作基于公司部署NVIDIA人工智能和加速計算以提升整體車內體驗。雙方合作使汽車制造商能夠更好地控制語音體驗的定制,而端側NVIDIA NeMo護欄的集成在安全、可擴展的車內人工智能可成為新的行業標桿。”
賽輪思AI于4月23日至5月2日在上海車展上與聯發科和英偉達共同展示其產品。感興趣的參觀者可以在8.2號館8BD002號展臺體驗Cerence xUI 實車演示。該解決方案將在聯發科展臺——8.2號館8BE006號展臺上展示。
如需了解更多關于賽輪思AI的信息,請訪問www.cerence.ai 或www.cerence.cn 。
關于Cerence Inc.
賽輪思(Cerence Inc,NASDAQ: CRNC)是全球汽車行業及移動出行領域在創造直觀、無縫且基于人工智能的用戶體驗方面的領導者。憑借超過二十五年在語音、生成式AI與大語言模型領域的創新成果和技術優勢,賽輪思為駕駛者與乘客精心打造了集成的車載體驗,使每一次出行都更加安全、互聯和愉悅。至今,已有逾 5億輛汽車采用了賽輪思技術。賽輪思與全球頂尖的汽車制造商、移動出行OEM及科技領軍企業緊密合作,共同推動下一代用戶體驗的發展。賽輪思中國總部設于上海,公司業務遍布全球,其全球團隊致力于持續突破人工智能的創新邊界。如欲了解更多信息,請訪問www.cerence.ai或www.cerence.cn。
此新聞稿為翻譯本,所有內容以Cerence英文版新聞稿為準。
媒體查詢,請聯系: Kate Hickman | 電話: 339-215-4583 | 電郵: kate.hickman@cerence.com 席瑩| 電話: 131 2183 1378 | 電郵: sally@gedyinc.com |
|
Cerence AI and MediaTek Partner to Introduce Multi-Modal Language Models Running on the Edge, Built on NVIDIA
Multi-modal models with smart guardrailing at the edge enable more seamless and safer in-car interactions, unlocking powerful capabilities that go far beyond pure infotainment
SHANGHAI andBURLINGTON, Mass.,April23, 2025– Just ahead of Auto Shanghai 2025, Cerence Inc. (NASDAQ: CRNC) (“Cerence AI”), a global leader pioneering conversational AI-powered user experiences, today announced a new partnership with MediaTek and expanded collaboration with NVIDIA to deliver the next generation of CaLLM™ Edge, its embedded small language model (SLM) purpose-built for automotive user experiences. With new multi-modal capabilities powered by NVIDIA AI Enterprise software, CaLLM Edge will now make in-car interactions smarter, more perceptive, more human, far safer and more secure than ever. This multi-modal edge SLM is seamlessly integrated into Cerence xUI™, the company’s hybrid cloud/embedded agentic AI platform, and will be showcased for the first time at Auto Shanghai 2025.
Today’s announcement stems from an ongoing collaboration between MediaTek and NVIDIA, with MediaTek’s automotive-grade Dimensity Auto Cockpit chipsets integrating NVIDIA’s GPU, AI, and graphics technologies. Now, the companies have teamed with Cerence AI on a multi-modal edge solution that delivers top performance and cost efficiency for automakers and unlocks powerful new features for drivers and passengers. Leveraging MediaTek’s automotive cockpit solution and optimized first on NVIDIA DRIVE AGX, CaLLM Edge’s advanced multi-modal capabilities are fine-tuned for in-vehicle deployment and high efficiency via a dual processing platform, delivering a new level of contextual awareness – both inside and outside the vehicle.
Auto Shanghai marks the first public demonstration of Cerence xUI running on NVIDIA DRIVE AGX, integrated into a production-ready automotive reference design that replicates a real car’s multi-seat environment, enabling seamless, personalized interaction for drivers and passengers alike. Key innovations include:
Increased intelligence inside the car–Imagine your car knows when you’re talking to it – and when you’re not. You could ask for recommendations for Italian restaurants, then ask your passenger: “What about the second one?” – and the assistant knows to wait to jump back into the conversation. Plus, the assistant can take direction from driver and passengers at the same time – for example, “Open my window,” followed by “Same for me.” Or, imagine your car can keep an eye on your pet while you run a short errand, or, while you’re driving, answer questions about how your toddler is doing in the back seat.
Additional context from outside the car– Imagine an assistant that provides information about not only what is inside the vehicle, but also in the world outside. For example, it can explain or translate road signs, identify roadside buildings, and even offer details about something interesting spotted on a billboard. Cerence xUI can leverage car sensor data and both interior and exterior camera feeds in combination with the CaLLM Edge multi-modal SLM, enabling streaming input on the edge – all of which will be shown for the first time at Auto Shanghai.
Smartguardrailingon the edge– Cerence AI has developed automotive guardrails optimized for NVIDIA DRIVE AGX, helping ensure Cerence-powered systems can safely and reliably handle the nuances of brand-specific in-car interaction, even in conditions with limited connectivity. As part of its comprehensive hybrid architecture, Cerence AI will be delivering this embedded guardrail with NVIDIA NeMo Guardrails, both to complement its cloud variant as well as help minimize distractions, prevent misuse, and ensure voice interactions stay context-aware and compliant with safety norms.
Beyond these new capabilities for drivers, CaLLM Edge also offers key benefits for automakers. The heavy lifting of the multi-modal processing happens at the edge, meaning less cloud bandwidth required and reduced costs for OEMs. In addition, enabling drivers to access information outside the car and delivering advanced, generative AI-powered features unlocks new subscription-based services and revenue streams for OEMs.
“As we continue to push the limits of our CaLLM family of cloud and embedded language models, we continue to improve our ability to meet the needs of a wide variety of automakers and their specific infotainment platforms,” said Nils Schanz, EVP, Product & Technology, Cerence AI. “By teaming with MediaTek and NVIDIA, we’ve supercharged CaLLM Edge with real-time perception and contextual awareness that redefines the in-vehicle experience.”
“The combination of Cerence’s CaLLM Edge with MediaTek Dimensity Auto platforms creates an incredible foundation for powerful multi-modal, generative AI-driven experiences in vehicles,” said Mike Chang, Corporate Vice President and General Manager of Automotive Business of MediaTek. “MediaTek Dimensity Auto supports both Cerence’s LLM and SLM on the edge, and our new C-X1 featuring dual AI engines is ideal for the task of reliably running multiple AI tasks simultaneously. This partnership is a key addition to our automotive ecosystem and will enable global automotive brands to accelerate their next-generation designs in confidence.”
“Cerence’s collaboration with MediaTek builds on the company’s work to deploy NVIDIA AI and accelerated compute to improve the overall in-vehicle experience,” said Rishi Dhall, Vice President of Automotive at NVIDIA. “The work now gives automakers greater control to customize voice experiences, and our work to integrate NVIDIA NeMo Guardrails at the edge has the power to set a new industry benchmark in the evolution of safe, scalable in-car AI.”
Cerence AI will demonstrate its offering with MediaTek and NVIDIA at Auto Shanghai, taking place April 23-May 2. Interested attendees can experience Cerence xUI in action in Hall 8.2, booth number 8BD002. The solution will also be shown at MediaTek’s booth, also in Hall 8.2, at booth number 8BE006.
To learn more about Cerence AI, visit www.cerence.ai, and follow the company on LinkedIn.
About CerenceInc.
Cerence Inc. (NASDAQ: CRNC) is a global industry leader in creating intuitive, seamless, AI-powered experiences across automotive and transportation. Leveraging decades of innovation and expertise in voice, generative AI, and large language models, Cerence powers integrated experiences that create safer, more connected, and more enjoyable journeys for drivers and passengers alike. With more than 500 million cars shipped with Cerence technology, the company partners with leading automakers, transportation OEMs, and technology companies to advance the next generation of user experiences. Cerence is headquartered in Burlington, Massachusetts, with operations globally and a worldwide team dedicated to pushing the boundaries of AI innovation. For more information, visit www.cerence.ai.