» iPhone Tips » iPhone 16 and Spatial Video: What to Know About This New Feature
With the coming of this fall, the release of iPhone 16 has brought many new features, including New Apple Intelligence, faster charging, A18 chip (pro), Wi-Fi 7 and so on. In addition, a new Capture button has been added to make taking pictures and zooming more convenient. Apple has especially strengthened the shooting function and supports recording spatial videos, allowing users to enjoy an immersive experience. So, how exactly does the iPhone 16’s recording spatial video work? What is the difference between space video and ordinary video? Let’s dive into this innovative feature next!
Spatial video is a multi-dimensional video format that captures three-dimensional spatial information, including video and audio, capable of recording the depth and spatial dimensions of a scene, allowing viewers to experience objects and distances in the video from multiple angles. This kind of video is usually suitable for AR/VR devices, such as Apple’s recently released AVP (Apple Vision Pro). For more information about AVP, refer to this article: Could the Apple Vision Pro Replace the MacBook Pro? Here’s What We Found…. Watching space videos using such devices will provide an immersive viewing experience that makes people feel as if they are actually there.
*image: Apple
In terms of video quality, spatial video enhances immersion by superimposing two images, so the image quality of both images must be very high to ensure the best overlay effect. If one picture is 4K+120fps, and the other picture maintains the same specifications, the overall effect is 4K+120fps. However, if the image quality does not match, the superimposed effect will be affected, resulting in a loss of immersion.
*image: Apple
In terms of video storage, spatial video is expected to be higher in size per minute due to the additional depth information and multi-angle data to be recorded, possibly reaching 1GB to 1.5GB or more, especially in ProRes recording mode. So now iPhone phones that can record spatial videos only support recording in 1080p+30fps format, otherwise the phone's storage space may not be enough. After understanding this, let’s take a look at how iPhone 16 converts your videos into spatial videos.
With the equipment of the LiDAR sensor, iPhone 16 can quickly and accurately measure the distance to an object to obtain three-dimensional depth data of the scene. This data is combined with image information to create the three-dimensional effect required for spatial video. You can record space videos or photos through the following steps.
Notice:
Step 1: Open "Camera" on your iPhone.
Step 2: Select "SPATIAL mode", then rotate iPhone to landscape orientation.
Step 3: Tap the "Capture button" to take a spatial photo or long holding to start recording a spatial video.
*image: Apple
You can use the iPhone to watch space videos or photos, but since the iPhone is not a dedicated AR/VR device, it cannot present a true sense of 3D. There is only a space logo in the upper left corner of the video. Although you can see the video content normally, but if you want to get a more realistic immersive experience, it is recommended to use dedicated AR/VR equipment to watch, such as the aforementioned AVP.
The future of space video is full of potential. Although current AR/VR equipment has problems such as high price, short battery life, and unsuitable for long-term use, with the development and continuous improvement of technology, it will break the traditional two-dimensional screen experience. Bringing a more immersive viewing experience.
*image: Movie: Ready Player One.
Like Apple said: "You have many high-definition screens over fifty inches in front of you, and they can be dragged". Many fields such as entertainment, education, social media, medical care and engineering will benefit from the innovation of spatial video technology, and video creators will also have more creative freedom. The future of space video will not only provide richer interactive experiences, but will also change the way we share stories, learn knowledge and solve problems. Imagine that scenes from science fiction movies are becoming reality. How cool is this!
"The future is already here — it's just not very evenly distributed." — William Gibson
