Fish identification from videos captured in uncontrolled underwater environments

Faisal Shafait*, Ajmal Mian, Mark Shortis, Bernard Ghanem, Phil F. Culverhouse, Duane Edgington, Danelle Cline, Mehdi Ravanbakhsh, James Seager, Euan S. Harvey

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

There is an urgent need for the development of sampling techniques which can provide accurate and precise count, size, and biomass data for fish. This information is essential to support the decision-making processes of fisheries and marine conservation managers and scientists. Digital video technology is rapidly improving, and it is now possible to record long periods of high resolution digital imagery cost effectively, making single or stereo-video systems one of the primary sampling tools. However, manual species identification, counting, and measuring of fish in stereo-video images is labour intensive and is the major disincentive against the uptake of this technology. Automating species identification using technologies developed by researchers in computer vision and machine learning would transform marine science. In this article, a new paradigm of image set classification is presented that can be used to achieve improved recognition rates for a number of fish species. State-of-the-art image set construction, modelling, and matching algorithms from computer vision literature are discussed with an analysis of their application for automatic fish species identification. It is demonstrated that these algorithms have the potential of solving the automatic fish species identification problem in underwater videos captured within unconstrained environments.

Original languageEnglish
Pages (from-to)2737-2746
Number of pages10
JournalICES Journal of Marine Science
Volume73
Issue number10
DOIs
StatePublished - Nov 2016

Keywords

  • computer vision
  • fish classification
  • fish identification
  • image analysis
  • image sets
  • species recognition
  • COMPUTER VISION
  • SPECIES RECOGNITION
  • VISUAL TRACKING
  • CLASSIFICATION
  • SHAPE

Cite this