Type of Publication

Journal Articles

Date:

2 /

2015

Status

Published

DOI:

10.1016/j.neucom.2014.08.077

Perspective shape from shading for wide-FOV near-lighting endoscopes (extended version)

Featured in:

Neurocomputing, Volume 150, Part A, 2015

Authors:

Diogo Roxo, Nuno Gonçalves, João Barreto and Pedro Rodrigues

Abstract

In minimally invasive medical procedures the surgeon uses as guidance the video acquired by near-lighting endoscopic cameras. Near-lighting endoscopes are small size self-illuminated cameras that typically have a wide or very wide field of view (FOV), and hence their images are affected by high radial distortion and small spatial resolution in the periphery of the image (an object of the same size at equal distance gets smaller in the periphery). To help the interpretation of the images by the surgeon, the 3D modeling of the observed cavities is highly interesting and shape-from-shading is a natural choice in the 3D shape reconstruction of bones and organs. However, the shape from shading technique has been traditionally performed using the perspective projection model (perspective shape from shading – PSFS) which is barely appropriate for modeling endoscopes since it does not account for the high distortion and reduced resolution in image periphery. Our aim is thus to adapt the shape from shading technique to the particular case of near-lighting endoscopes. We propose in this paper two improvements to the state of the art methods for PSFS in Near-Lighting Endoscopes. The first contribution is the introduction of the radial distortion model directly in PSFS equations and the second contribution is the compensation of the reduced resolution of the image in its periphery, due to wide FOV. Tests performed in real objects and in a knee bone phantom show that by modeling these two effects our method highly improves the accuracy of the estimation.

Citation
Nuno Goncalves, Diogo Roxo, Joao Barreto and Pedro Rodrigues (2015). Perspective shape from shading for wide-FOV near-lighting endoscopes, Neurocomputing, Volume 150, Part A, 2015, Pages 136-146, DOI: 10.1016/j.neucom.2014.08.077

Related Content

Researcher Coordinator, VIS TEAM Leader
No tagged content to show
No tagged content to show
No tagged content to show

RECENT PUBLICATIONS

Geometric implicit neural representations for signed distance functions

Authors: Luiz Schirmer, Tiago Novello, Vinícius da Silva, Guilherme Schardong, Daniel Perazzo, Hélio Lopes, Nuno Gonçalves, Luiz Velho
Featured in: Special Section on SIBGRAPI 2023 Tutorials

Towards Secure Biometric Solutions: Enhancing Facial Recognition while Protecting User Data

Authors: Jose Silva, Aniana Cruz, Bruno Sousa and Nuno Gonçalves
Featured in: 14th International Conference on Pattern Recognition Applications and Methods (ICPRAM) 2025

StylePuncher: encoding a hidden QR code into images

Authors: Farhad Shadmand, Luiz Schirmer and Nuno Gonçalves
Featured in: 14th International Conference on Pattern Recognition Applications and Methods (ICPRAM) 2025

suggested news

Best Paper Award @ICPRAM 2025
Nuno Gonçalves serves as jury member for PhD...
ACHILLES project launches official Website and Newsletter

RECENT PROJECTS

FACING2 – Face Image Understanding
VISUAL-ID – Unique Visual Identities in Graphics, Images and Faces
UniqueMark

Institute of Systems and Robotics Department of Electrical and Computers Engineering University of Coimbra