Type of Publication

Thesis

Date:

9 /

2015

Status

Published

Improved Depth Estimation Algorithm using Plenoptic Cameras

Featured in:

MD Thesis

Authors:

Joel Cunha

Abstract

Plenoptic cameras open new possibilities to the world of photography, allowing to capture more information at a single moment with a single camera. With a single image captured by these cameras we are able to estimate depth and create a fully focused image. In this thesis we present an automatic algorithm to create a depth map and a fully focused image, using as input only a raw plenoptic image and few calibration parameters. The depth estimation starts with a RANSAC-like algorithm and then the points estimated are submitted to an outlier removal filter. Finally, it is created a dense depth map. We also present an algorithm for the image synthetization (rendering). As for the depth estimation improvements introduced we studied new lenses patterns. Within the RANSAC-like algorithm there is a correspondence search within neighbor lenses. We then studied different neighbor lenses arrangements (by analyzing lenses of different focal lengths and distances from to the target micro lens). We also implemented a coarse depth map, where this map has the depth to each individual micro lens. We also present a methodology to create synthetic plenoptic data, useful to compare the depth estimated with the true depth values. Therefore with the synthetic data we were able to assess the estimation of the depth values and analyze its error. This method to create synthetic data allowed to study different parameters in order to improve our own work or provide guidelines for future work. Finally our algorithm was tested with real plenoptic images provided by Raytrix. Because Raytrix depth estimation and image rendering is a proprietary algorithm and, therefore, we are challenged to achieve our results with our own ingenuity and resources.

Citation
Joel Cunha (2015), Improved Depth Estimation Algorithm using Plenoptic Cameras. MD Thesis. University of Coimbra, 2015.

Related Content

Researcher Coordinator, VIS TEAM Leader
No tagged content to show
No tagged content to show
No tagged content to show

RECENT PUBLICATIONS

Graph-Based Radiomics Feature Extraction from 2D Retina Images

Authors: Ofélio Jorreia; Nuno Gonçalves; Rui Cortesão
Featured in: IEEE Access

Book of Extended Abstracts of the 12th Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA 2025)

Authors: Aitana Menárguez-Box; Angel Navarro; Antonio Requena Jiménez; Brenda Nogueira; Dylan Perdigão; Farhad Shadmand; Iurii Medvedev; Marco Alexandre Tomás Tereso; Maria del Mar Coch-Alcina; Matheus Kovaleski; Miguel Leão; Teresa M.C. Pereira; Tomás Silva Santos Rocha
Featured in: 12th Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA 2025)

How to Rethink Education with Artificial Intelligence: The Portuguese Use Case from Political and Practical Perspectives

Authors: Nuno Gonçalves; Maria Helena Monteiro
Featured in: Futures'2025 Conference Artificial Intelligence in Education

suggested news

Four papers presented @ IbPRIA 2025
Prof. Nuno participates in Conference on Digital Governance
ISR-UC maintains the “Excellent” rating in FCT evaluation!

RECENT PROJECTS

FACING2 – Face Image Understanding
VISUAL-ID – Unique Visual Identities in Graphics, Images and Faces
UniqueMark

Institute of Systems and Robotics Department of Electrical and Computers Engineering University of Coimbra