Ismael Daribo | Scientific Researcher

The National Institute AIST, Kagoshima University and Hiroshima City University developt a novel technology for measuring objects in 3D in real time, using only a camera and projector. With this new method, patterned light is projected onto the object, and the pattern images captured by the camera are processed to measure it's 3D shape. Because the 3D shape can be measured from a single image, this method can also be used with a high-speed camera.

Leap represents an entirely new way to interact with your computers. It's more accurate than a mouse, as reliable as a keyboard and more sensitive than a touchscreen. For the first time, you can control a computer in three dimensions with your natural hand and finger movements.

A time-of-flight camera (ToF camera) is a camera system that creates distance data with help of the time-of-flight (ToF) principle. The PMD CamBoard provides highly accurate and fast 2D and 3D images using only USB power. No external power supply is needed. This makes the device the ideal development plattform for mobile applications and consumer electronics.

   download the dissertation.

In the framework of 3D multiview imaging system, a large number of cameras capture the same scene from different viewpoints. There exists a fairly strong correlation between the different video sequences, which leads to the necessity to properly take it into account, specially if one wants to transmit such 3D video sequence on a communication channel throughout the different views. Current 3D video standards use conventional predictive patterns, where the prediction is no longer calculated on the time axis but also one camera to another one.

This thesis aims to study the technical processing of a 3D video communication system, including both broadcast model (coding for video 2D + depth) and multiview video model. Direct applications are 3DTV and FVV applications. This area of research gathers various known techniques as video coding 2D+t theory (e.g., predictive coders, wavelet coders, etc.), computer vision background related to multiview imaging (e.g., stereoscopic analysis, DIBR, etc.), 3D display technologies, etc.

The dissertation will be online ... very very soon.

@PHDTHESIS{Daribo_09,
  author = {Isma\"{e}l Daribo},
  title = {Coding and rendering of 3D video sequences;
  and applications to Three-Dimensional Television (3DTV)
  and Free Viewpoint Television (FTV).
  },
  school = {Graduate College of Telecom ParisTech},
  year = {2009},
  address = {Paris, France},
  month = nov,
  keywords = {3D video communication, three-dimensional television, 3DTV,
	free viewpoint television, FTV, three-dimensional phone, 3D phone,
	MPEG-2, MPEG-4 AVC, H.264, MVC, video-plus-depth, texture-plus-depth
	multiview video, MVV, free viewpoint video, FVV video coding, image coding,
	texture coding, depth coding, depth compression, 3D video coding,
	multiview video-plus-depth, texture-plus-depth coding, motion estimation,
	joint motion estimation, rate allocation, joint rate allocation,
	distortion model, view synthesis, view rendering, rendering (computer
	graphics), multiview video-plus-depth virtual view rendering, virtual
	intermediate camera view, multiview rendering quality},
}
		

3D reconstruction can be done by using the photometric propriety of the light reflection on a surface. The scene is highlighted by different light source at different position. By using the captured image from each spot light, we can extract a normal map and thus a depth map.

Combined with a smart camera, the Xetal digital signal processor is able to run a variety of image processing algorithms. Here an application in depth estimation in real time. In the depth map, bright gray value means closer.

A Scalable System for Real-Time Acquisition, Transmission, and Autostereoscopic Display of Dynamic Scenes from Mitsubishi Electric Research Laboratories, Cambridge, MA.
The system contains an array of 16 cameras and projectors, a rear-projection 3D display with a double-lenticular screen and a front-projection 3D display with single-lenticular screen.

Johnny Chung Lee, a brilliant student of the Human-Computer Interaction Institute, Camegie Mellon University (USA), find out how to produce 3D perception on a conventionnal 2D TV display by using the Wii Remote.

One example of 3DTV application, the Free Viewpoint Video (FVV). A set of mulitple cameras captures a scene from multiple viewpoint. Moreover, FVV allowing virtual replays and freeze-and-rotate effects.

This site that you've reached is currently under construction. Please visit back at a later time to check on the progress.

Thank you for your comprehension.