IR video over SPI

IR sensor interface

BitSim has developed a receiver for FLIR’s Video over SPI (VoSPI), an interface to enable streaming images from a Lepton Infrared camera directly to an FPGA-based image processing system. You can use it in your platforms like:

  • On Xilinx devices with our new customized IP.
  • On every SoC circuit with an ARM CPU and Python with our pure-software driver.
  • A Python interface which integrates the VoSPI IP in your PYNQ design.

VoSPI stands for “Video over Serial Peripheral Interface”. VoSPI protocol is designed to send out the video in a format that allows transmission over a SPI interface while requiring minimal software or hardware. The sensor acts as SPI slave and the hardware acts as SPI master and the video is streamed on MISO pin. The hardware system uses custom logic to receive and render the video. The sensor sends out bytes of pixels through packets and segments to form a frame of 160×120 resolution.

The development of this IP has been done on BitSim’s Python-based development platform, SpiderPig board. Utilizing this simple interface between the Logic fabric and the high-level Python environment, debug information and image analysis could be performed almost directly after a bitfile is generated. BitSim has developed tools for Thermal Imaging and specifically to integrate the FLIR Lepton sensor by using VoSPI.

Using this IP block, it is possible to attach a low cost FLIR Lepton IR sensor, which sends processed 16-bit data to an FPGA design. The IR sensor captures infrared radiation as input. The output is a uniform thermal image with temperature measurements throughout the image. This can be used in applications such as Mobile phones, Gesture recognition, Building automation, Thermal imaging and Night vision where detection of temperature values and high temperature scenes are necessary.

IR video over SPI

Thermal image of  a person holding a hot coffee captured by Lepton 3.5 IR sensor.

BigScience

BitSim at Big Science Lund

BitSim attended and exhibited at the BigScience Lund event November 26-27th, with over 200 attendees from the BigScience units CERN, ESS, Maxlab IV, ITER and XFEL, Swedish universities, regional organizations and industrial partners. We showed our offering in Data Acquisition such as BitSim’s FMC ADC/DAC boards. BitSim joined the BigScience Sweden organization 2019.

BigScience

CERN

Machine learning collaboration at CERN

CERN, the research faciility in Switzerland and Zenuity, a new ADAS and AD Software Company owned by Volvo and Autoliv, have announced a collaboration on machine learning based on hardware acceleration. This is exactly the area we at BitSims are exploring with our new platform Spiderpig. The idea is utilize existing libraries and the Python language to quickly develop areas such as advanced object recognition and machine learning applications. See here

This announcment from CERN and Zenuity underscores the opportunities we at BitSim see in acceleration of machine learning in hardware. Read further

CERN