Prophesee Image Deblurring Frame-Based + Event-Based Vision

Preliminary image deblurring results on high-speed scene, obtained combining Prophesee Metavision® sensor and algorithms with Snapdragon® platform. Prophesee’s breakthrough sensors add a new sensing dimension to mobile photography. They change the paradigm in traditional image capture by focusing only on changes in a scene, pixel by pixel, continuously, at extreme speeds. Each pixel in the Metavision sensor embeds a logic core, enabling it to act as a neuron. They each activate themselves intelligently and asynchronously depending on the amount of photons they sense. A pixel activating itself is called an event. In essence, events are driven by the scene’s dynamics, not an arbitrary clock anymore, so the acquisition speed always matches the actual scene dynamics. High-performance event-based deblurring is achieved by synchronizing a frame-based and Prophesee’s event-based sensor. The system then fills the gaps between and inside the frames with microsecond events to algorithmically ext