Image Signal Processing Xilinx FPGA IP

Omnitek’s Image Signal Processing (ISP) IP is designed to provide all the necessary correction tools to take the RAW image from the camera sensor array, interpolate, white balance, colour correct, noise reduce and condition the image prior to transmission or storage. This IP is required to decode the output from a digital camera image sensor and turn it into a view-able image. Typically, the sensor output is not arranged in a conventional RGB raster image format, and instead uses a “Bayer” or similar arrangement of pixels. Sensors often contain dead or noisy pixels and suffer from uneven lighting and other image quality anomalies that need to be resolved.

A typical implementation of the ISP Pipeline IP uses additional IP Cores such as the Omnitek HDR Tone-mapping IP to condition the image and the Omnitek Warp IP to perform lens correction before the image is output.

This diagram illustrates Omnitek’s Image Signal Processor (ISP) and HDR Tone-mapping IP to process camera sensor array images. The sensor output is first fed into an ISP pipeline which can crop the image as required, then correct any camera anomalies before it is de-Bayered by the Colour Filter Array block. The image is then passed to our HDR Tone-mapping IP which uses statistical analysis to enhance the image contrast. The image stream is then passed to the Warp Processor to correct for lens distortion and apply any size and shape transformations that are required before the image is output.

Key Features

  • Very small FPGA resource footprint
  • Very low latency (as little as 3 video lines)
  • Input video format support for 8/10/12-bit Raw Sensor Image
  • Image resolutions up to 4096 pixels x 2160 lines up to 120Hz
  • Image Cropping
  • Defective Pixel Correction
  • Black Level Correction
  • Auto White Balance
  • Vignette correction
  • Colour Filter Array Interpolation (for example de-bayer or CFA)
  • Focus Assist analysis
  • Wide Dynamic Range support
  • Bare Metal and Linux Support Libraries
  • Available as an independent IP Core
  • Fully compatible with Omnitek the OSVP IP Suite, HDR Tone-mapping IP, Warp IP, Image Stitch IP and other IP Cores to provide a comprehensive image processing package.


  • Camera lens / image correction
  • Automotive image capture
  • Medical imaging
  • Multiple image stitching

ISP Demonstration

Start typing and press Enter to search