Free viewpoint real video streaming system for 360° three-dimensional viewing

The goal of this study was to develop a unique free viewpoint real video technology for 360° three-dimensional (3-D) viewing of photographic subjects and to utilize it in online video transmissions. In existing multi-angle video systems, the simultaneous synchronization and playback of large volumes of video images significantly burdens the central processing unit (CPU). Because repeated play and pause processing of multiple videos must be performed, a time lag occurs with every change in viewpoint. In this context, smooth transitions between videos of multiple viewpoints are challenged.In response to this situation, the author developed a method to create a single composite image of a subject photographed in 360° using multiple cameras and display the image during transmission by partially trimming it and sliding the display positioning under the direction of the user.This method resulted in a system that enables not only smooth viewpoint switching and 360° 3-D viewing of photographic subjects; it does so at a quality and size possible for online streaming. Therefore, in 2013, a Japanese patent was granted for this technology, it was used in an advertising promotion for Sharp?s 4K television, and it was used in the television Asahi web program ?Danceta!? Additional patents were granted in 2015 in Korea, China, and the United States. The European patent is pending.