University of Agder Logo

CAIR seminar by Prof. Nicolai Petkov on representation learning with trainable COSFIRE filters

On Wednesday, February 6, at 12:15-13:00, Prof. Nicolai Petkov, presents his work on Representation learning with trainable COSFIRE filters. Prof. Nicolai Petkov is Head of the Intelligent Systems Research Group at Faculty of Science and Engineering, University of Groningen. The seminar takes place in A2 021.

 

In order to be effective, traditional pattern recognition methods typically require a careful manual design of features, involving considerable domain knowledge and effort by experts. The recent popularity of deep learning is largely due to the automatic configuration of effective early and intermediate representations of the data presented. The downside of deep learning is that it requires a huge number of training examples.

Trainable COSFIRE filters are an alternative to deep networks for the extraction of effective representations of data. COSFIRE stands for Combinations of Shifted Filter Responses. Their design was inspired by the function of certain shape selective neurons in areas V4 and TEO of visual cortex. A COSFIE filter is configured by the automatic analysis of a single pattern. The highly non-linear filter response is computed as a combination of the responses of simpler filters, such as Difference of (color) Gaussians or Gabor filters, taken at different positions of the concerned pattern. The identification of the parameters of the simpler filters that are needed and the positions at which their responses are taken is done automatically. An advantage of this approach is its ease of use as it requires no programming effort and little computation – the parameters of a filter are derived automatically from a single training pattern. Hence, a large number of such filters can be configured effortlessly and selected responses can be arranged in feature vectors that are fed into a traditional classifier.

This approach is illustrated by the automatic configuration of COSFIRE filters that respond to randomly selected parts of many handwritten digits. We configure automatically up to 5000 such filters and use their maximum responses to a given image of a handwritten digit to form a feature vector that is fed to a classifier. The COSFIRE approach is further illustrated by the detection and identification of traffic signs and of sounds of interest in audio signals.

The COSFIRE approach to representation learning and classification yields performance results that are comparable to the best results obtained with deep networks but at a much smaller computational effort. Notably, COSFIRE representations can be obtained using numbers of training examples that are many orders of magnitude smaller than those used by deep networks.