What usually leaks last on Pixel devices is software features. Although every hardware detail is usually disclosed months in advance, we usually only learn about new software just before it launches.

That’s not the case today, because thanks to a massive leak from Google’s gChips division, Android Authority has seen credible documents that hint at a few new features we can expect from the Pixel 10 and Pixel 11.

The big thing Google phones are focusing on right now is AI Featuresand it is no different in the case of the upcoming Pixel phones.

Thanks to its improved TPU, Tensor G5 (which is expected to debut in the Pixel 10 series and newer) will benefit from “Video Generative ML” features. While it’s a pretty vague name, learning the intended use case explains what the feature will do a little better: “Intuitive post-capture generative AI-powered video editing for app Photos.” We can only guess what exactly that means, but it looks like Google will make it easier for users to edit their videos using AI that actually understands video. The feature may also be available in the YouTube app, specifically for YouTube Shorts.

Google is also exploring several AI features for photo editing, including “Speak-to-Tweak,” which appears to be an LLM-based editing tool, and “Sketch-to-Image,” which is self-explanatory and looks like to a similar functionality. offered by Samsung’s Galaxy AI. In addition, there is prior evidence indicating that Google is developing a Sketch-to-Image feature for its Gemini project.

Google is also working on a “Magic Mirror” feature, but unfortunately no additional context could be gathered from the leaked documents. Additionally, the Tensor G5 should also be able to run stable streaming-based models locally, which could be used in the Pixel Studio app, instead of the current server-based solution.

Google focuses heavily on the cameras in its phones, so it’s no surprise that many of the new features are related to that area. First, Tensor G5 finally supports 4K 60fps HDR video, while previous models only allowed 4K 30fps video.

The Pixel 11 can also offer 100x zoom capabilities using machine learning for photos and videos. However, we expect that the algorithms used for each will be different, so don’t expect identical quality from one format to another. Additionally, the documents refer to a “next-gen” telephoto lens designed to improve this feature, suggesting that significant hardware upgrades could also be on the way.

Cinematic Blur also gets an upgrade on the Pixel 11, with support for 4K 30fps and a new “video relight” feature that appears to change lighting conditions in videos. These two new features are made possible by a “cinematic renderer” integrated into the chip’s image signal processor. The inclusion of the new hardware block also reduces the power consumption of blur video recording by almost 40%.

The last, and perhaps most exciting feature potentially available on the Pixel 11 is “Ultra Low Light Video,” also known as “Night Sight Video.” A feature by this name already exists, but it relies on cloud processing, whereas this one is entirely on the device. Google has specifically mentioned that 5-10 lux is the intended lighting conditions for this feature. This is considered very dim light, similar to the illumination provided by a dimly lit room or the light from a cloudy sky at dusk; for example, it is comparable to the brightness of a candle placed about a meter away. The new feature will also rely on new camera hardware to achieve the desired results.

New ambient features

Thanks to the inclusion of a new “nanoTPU” in the low-power part of the Tensor G6, Google plans to add some ML-based always-on features to the Pixel phones. A good portion of them are health-related features, such as “agonal breathing, cough, snoring, sneezing and sleep apnea detection, fall detection, gait and monitoring of sleep stages. There is also emergency sound event detection.

Some features are also aimed at activity tracking, such as “Running ML”, which is a set of tools for runners, such as analyzing “coachable pace” and “balance and oscillations”.

The Pixel 11 might also support more Quick Phrases, but unfortunately no list was provided.

What potential new features are you most excited about? Let us know in the comments below!