Biography

Royal Academy of Engineering Research Fellow

I am a Royal Academy of Engineering Research Fellow in the Centre for Vision, Speech and Signal Processing, University of Surrey working in 4D Vision for perceptive machines. The emergence of machines that interact with their environment has led to an increasing demand for automatic visual understanding of real-world scenes. My research aims to better understand complex scenes so that machines can efficiently model and interpret real-world for a range of socially beneficial applications including autonomous systems, augmented reality and healthcare.

I am currently a Senior Research Fellow at CVSSP, University of Surrey, where I finished PhD in 'General dynamic scene reconstruction from multi-view videos' in 2016, supervised by Prof. Adrian Hilton. I have previously worked at Samsung Research Institute, Bangalore, India for 3 years (2010 - 2013) in Computer Vision. In 2010 I received M.Tech. degree from the Indian Institute of Technology (IIT), Kanpur, India supervised by Prof. K.S. Venkatesh in Human Computer Interaction. Please refer to CV for more information.

Research interests: 3D/4D Computer Vision, Scene Understanding, Segmentation, Multi-view Performance Capture and Human Computer Interaction which include robust computer vision to model and understand real world scenes.
My work was published in Computer Vision News Magazine and here are a few videos of my work.


Research

Projects

4D Vision for Perceptive Machines
Royal Academy of Engineering funded project
Aug 2018 - Jul 2023

ALIVE: Live Action Light Fields for Immersive VR Experiences
Innovate UK project in collaboration with Figment Productions and Foundry
October 2016 - December 2017
Figment Productions Foundry Video

IMPART: Intelligent Management Platform for Advanced Real-Time media processes
EU FP7 project in collaboration with Filmlight, Double Negative, AUTH, UPF and BUT
July 2013 - October 2015
Website Video

Publications

MSFD: Multi-scale segmentation based feature detection for wide-baseline scene reconstruction
Armin Mustafa, Hansung Kim, and Adrian Hilton
at IEEE Transactions in Image Processing(TIP) 2018
PDF Project

4D Temporally Coherent Dynamic Light-field Video (Spotlight)
Armin Mustafa, Marco Volino, Jean-Yves Guillemaut and Adrian Hilton
at 3D Vision (3DV) 2017
PDF Project Video Poster PPT

Semantically Coherent Co-segmentation and Reconstruction of Dynamic Scenes
Armin Mustafa and Adrian Hilton
at IEEE International Conference in Computer Vision & Pattern Recognition CVPR, 2017
PDF Project Video Poster PPT

Temporally Coherent 4D Reconstruction of Complex Dynamic Scenes (Oral)
Armin Mustafa, Hansung Kim, Jean-Yves Guillemaut and Adrian Hilton
at IEEE International Conference in Computer Vision & Pattern Recognition CVPR, 2016
PDF Project Video Poster PPT

4D Match Trees for Non-rigid Surface Alignment
Armin Mustafa, Hansung Kim and Adrian Hilton
at The 14th European Conference on Computer Vision, ECCV 2016
PDF Project Video Poster

General Dynamic Scene Reconstruction from Multiple View Video
Armin Mustafa, Hansung Kim, Jean-Yves Guillemaut and Adrian Hilton
at International Conference on Computer Vision (ICCV) 2015
PDF Project Video Poster

Segmentation based Features for Wide-baseline Multi-view Reconstruction (Oral)
Armin Mustafa, Hansung Kim, Evren Imre and Adrian Hilton
at 3D Vision (3DV) 2015
PDF Project Video Poster PPT

Short Paper
Initial Disparity Estimation using Sparse Matching for Wide-baseline Stereo (Short paper)
Armin Mustafa, Hansung Kim, Evren Imre and Adrian Hilton
at The 11th European Conference in Visual Media Production (CVMP) 2015
PDF Poster

Book Chapter
Multi Finger Gesture Recognition and Classification in Dynamic Environment under Varying Illumination upon Arbitrary Background
Armin Mustafa and K.S. Venkatesh
in Speech, Image, and Language Processing for Human Computer Interaction: Multi-Modal Advancements 2012
PDF Press

Background Reflectance Modeling for Robust Finger Gesture Detection in Highly Dynamic Illumination
Armin Mustafa and K.S. Venkatesh
at In International Conference on Hybrid Information Technology, volume 6935 of Lecture Notes in Computer Science, 2011
PDF

Patents

Method and apparatus for converting 2d video to 3d video
U.S. and Korean Patent 2013
LINK

A Method and System for Human Gesture based on Visual Contour Analysis
Armin Mustafa and K.S. Venkatesh
Indian Patent 2010
LINK

Service

Organised

DynaVis - The 1st International Workshop on Dynamic Scene Reconstruction @ CVPR 2019 on 15 June 2019, Long Beach, California
Organisers: Armin Mustafa, Marco Volino, Michael Zollhofer, Dan Casas and Adrian Hilton

BMVA symposium on Dynamic Scene Reconstruction on 21 June 2017 , London
Organisers: Jean-Yves Guillemaut, Armin Mustafa and Marco Volino
PPT

Reviewer
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
IEEE/CVF International Conference on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)
British Machine Vision Conference (BMVC)
International Conference on 3D Vision (3DV)
EUROGRAPHICS
IEEE Transactions in Image Processing (IEEE TIP)
IEEE Transactions in Multimedia
European Conference for Visual Media Production (CVMP)
Computer Vision and Image Understanding (CVIU)
IET Computer Vision
3D Reconstruction in the Wild (3DRW)

Talks

  4D Vision for Dynamic Scene Understanding, 30 November 2018
  at Sixth ASLLA Symposium on Human Understanding through AI: Days of Future Present, by KIST, South Korea

  General Dynamic Scene Understanding, 12 November 2018
  at University of Portsmouth, UK

  4D Vision for Creative Industries, 07 November 2018
  at How can the creative industries use AI?, by Machine Intelligence Garage, Digital Catapult, UK

  Semantic Reconstruction of Dynamic Scenes, 26 February 2018
  at C Design Lab, Purdue University, Indiana, US

  General Dynamic Scene Reconstruction, 04 October 2017
  at Microsoft Research, Cambridge, UK

  General Dynamic Scene Reconstruction, 22 August 2017
  at Adobe Research, San Jose, US

  Semantic Scene Reconstruction, 21 June 2017
  at BMVA Meeting on Dynamic Scene Reconstruction, by BMVA London, UK

  General 4D Scene Reconstruction, 25 April 2016
  at Symposium on Computer Vision and Video Effects Generation, by Rank Prize Funds, UK


CV

Experience

  Royal Academy of Engineering Research Fellow: Aug' 2018 - Present
  Centre for Vision, Speech and Signal Processing, University of Surrey, UK

  Senior Research Fellow: Aug' 2018 - Present
  Centre for Vision, Speech and Signal Processing, University of Surrey, UK

  Research Fellow: Oct' 2016 - Jul' 2018
  Centre for Vision, Speech and Signal Processing, University of Surrey, UK

  Lead Engineer: Apr’ 2012 – May’ 2013
  Samsung Research Institute India, Bangalore, India

  Senior Software Engineer: Aug’ 2010 – Mar' 2012
  Samsung Research Institute India, Bangalore, India

Education

PhD: Jul' 2013 – Dec’ 2016
Centre for Vision, Speech and Signal Processing, University of Surrey, UK
Thesis: General Dynamic 4D Scene Reconstruction from Multi-view Videos
Advisor: Prof. Adrian Hilton

M.Tech: Aug’ 2008 – June’ 2010
Computer vision lab, Indian Institute of Technology, Kanpur, India
Thesis: Finger Gesture Recognition in Dynamic Environment under Varying Illumination upon Arbitrary Background
Advisor: Prof. K.S. Venkatesh

B.E.: Aug’ 2004 – May’ 2008
Institute of Engineering and Technology, Indore, India

Teaching

Teaching Assistant: Oct’ 2013 – Jan’ 2016
Centre for Vision, Speech and Signal Processing, University of Surrey, UK

Teaching Assistant: Apr’ 2009 – Mar’ 2010
Indian Institute of Technology, Kanpur, India

For detailed CV please contact me.