Apple’s next-generation CarPlay system gets a cold reception

Apple continues to introduce the new generation CarPlay system for the last two years. This system aims to gather the interfaces of all screens in your vehicle under one roof. However, from the beginning of this process, only Aston Martin and Porsche have stated that they will integrate this system into their vehicles. Moreover, even these brands have not given a clear date.

The approach of other companies in the automotive industry is quite cautious. Many automotive CEOs are uncomfortable with Apple’s direct interference in customer relations. Mercedes-Benz CEO Ola Källenius said in a statement to The Verge last April, “We use Apple CarPlay. If you prefer this system for some functions, you can use it. But leaving the entire control panel to someone else? “This is unacceptable to us.” he said.

How does Apple’s new generation CarPlay system work?

Apple published two detailed videos about the architecture and design of the new generation CarPlay at WWDC 2024. These videos make it clear that automakers will have great control over how the system will look and work. They even have the opportunity to use their own interfaces for some features. This shows that Apple is turning to providing a design tool that can adapt to automakers, rather than a system that is completely under its control.

The current CarPlay system essentially acts as a second screen for your phone. When you connect your phone to the vehicle, your phone sends a video stream and this image appears on the vehicle screen. However, for more integrated features like speedometers and climate controls, CarPlay needs to collect data from your vehicle, display that data in real time, and be able to directly control various functions. In the new generation CarPlay, these functions are divided into parts called “layers”. Some of these layers work on your phone, some on your car. So, even if your phone disconnects, the system continues to work. Since the new generation CarPlay only supports wireless connections, the stability and performance of the connection becomes an important issue. When talking about the next generation architecture, Apple says, “The stability and performance of the wireless connection are essential.” says.

The new system has two local layers. The first layer, called “Overlay UI,” includes features that work entirely in your car and are untouchable, such as turn signals and odometer. The other layer is called “local UI” and contains driving-related features that need to be constantly updated, such as the speedometer and tachometer. Automakers can customize these layers in a variety of ways; Different display styles and layouts available. Interestingly, Apple only has a single font option, the San Francisco font.

Apple’s goal for the next generation CarPlay is for the system to start instantly when the driver opens the door. Therefore, the assets of native UI elements are loaded from your phone to your car during the pairing process. Automakers can update their livery and send refreshed assets over the phone. Another layer called “Remote UI” includes features that run on your phone: maps, music, travel information, etc. This is similar to existing CarPlay but can now be used on other screens in your car.

The last layer is called “punch-through UI” and here Apple offers the most flexibility to automakers. Instead of its own interface ideas like rearview cameras and advanced driver-assistance features, Apple is letting automakers feed their existing systems through CarPlay. For example, when you shift into reverse, the interface will display your car’s backup camera screen.

Apple’s approach to HVAC controls is another compromise: The company isn’t really rethinking how HVAC controls work. Instead, it allows automakers to customize controls and show interior previews to suit the vehicle system.

This entire system is run at 60fps (or higher, if the car system supports it) by a new custom UI timing channel. Most underlying compositing relies on OpenGL running in the tool.

In summary, it’s pretty clear that Apple has realized that automakers aren’t going to give up their interfaces. Many car manufacturers have designed special interfaces that run on Unreal Engine and have fun animations. Apple’s decision to allow these interfaces to be fed via CarPlay may enable faster adoption of the system. However, this can also create an interface clutter.

As you can see, no one has seen the new generation CarPlay in real life yet. It will become clear over time whether Porsche and Aston Martin will come to market with this system and whether other manufacturers will also adopt this innovation.