ACT-CV - Computer Vision for Cognitive Modeling

This package is intended to create an easy to use interface between a video source and a cognitive modeling tool.

Overview

Three types of sources have been implemented

The screen images/videos are analyzed with OpenCV. The following demos are currently available:

an object matching demo that uses cross-correlations to find the KDE/MS Windows folder symbol on the screen and moves the mouse to one of them.
a line finder using the function cvHoughLines2 from OpenCV
an optical flow demo that computes the flow using consecutive images. The demo is intended for car driving scenarios. The flow can be used to detect whether the current egocentric direction (indicated by a focus on the screen) matches the heading of the virtual camera.

The package consists of four elements:

act-cv is a standalone application running the demos
ACT-CV.dll / libAct-CV.so is the server library that provides the computer vision to cognitive models implemented somewhere else. A lisp interface for the usage with ACT-R can be created by using make interface
act-cv-testclient is a simpe standalone application that uses the ACT-CV library
an optional client/server version of ACT-CV using ICE

Questions about installation, usage, and so on are covered in the online documentation. This is part of the source code release as well.