Andrea Caraffa

I'm a Research Scientist in Computer Vision and Deep Learning at Fondazione Bruno Kessler (FBK) currently working on foundation models and 6D pose estimation. I previously did research at SMaRC – Swedish Maritime Robotics Centre focusing on computer vision applications for autonomous underwater navigation.

My work focuses on developing novel deep learning approaches for challenging computer vision tasks. I'm particularly interested in zero-shot learning and fundamental deep learning research. Recently, I've been exploring how to leverage foundation models for 6D pose estimation without requiring task-specific training, with applications ranging from robotic manipulation to drone-based imaging.

I'm also passionate about creating datasets and benchmarks that push the boundaries of computer vision research. I've contributed to collecting and annotating datasets for wild berry detection using drones (WildBe) and thermal imaging of rural scenarios (MONET). My research aims to bridge the gap between theoretical advances in AI and real-world applications.

Publications

Wild Berry image dataset collected in Finnish forests and peatlands using drones

Wild Berry image dataset collected in Finnish forests and peatlands using drones

Luigi Riz, Sergio Povoli, Andrea Caraffa, Davide Boscaini, M. L. Mekhalfi, P. Chippendale, Marjut Turtiainen, B. Partanen, Laura Smith Ballester, Francisco Blanes Noguera, Alessio Franchi, Elisa Castelli, Giacomo Piccinini, L. Marchesotti, Micael S. Couceiro, Fabio Poiesi

arXiv.org 2024

FreeZe: Training-Free Zero-Shot 6D Pose Estimation with Geometric and Vision Foundation Models

Andrea Caraffa, Davide Boscaini, Amir Hamza, Fabio Poiesi

European Conference on Computer Vision 2024

The MONET dataset: Multimodal drone thermal dataset recorded in rural scenarios

The MONET dataset: Multimodal drone thermal dataset recorded in rural scenarios

Luigi Riz, Andrea Caraffa, M. Bortolon, M. L. Mekhalfi, Davide Boscaini, André Moura, J. Antunes, André Dias, Hugo Silva, A. Leonidou, C. Constantinides, C. Keleshis, D. Abate, Fabio Poiesi

2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 2023

A Deep Learning Approach for Estimating the Rind Thickness of Trentingrana Cheese from Images

Andrea Caraffa, Michele Ricci, M. Lecca, C. M. Modena, E. Aprea, F. Gasperi, S. Messelodi

International Conference on Image Processing and Vision Engineering 2023