Romain Bourdon

Creating animations by using computer vision to extract motion data

Synopsis

OpenCV's computer vision techniques are used to extract joint angles of animals from videos. The application uses cascading classifiers to detect the legs of an animal which in this case is a horse. Frames of the video in which legs have been detected are then grey scaled and put through a canny edge detection algorithm. Active contours are then applied to the image that attach to the edges of the legs. The joint angles are calculated by using the dot product between the front and end of a contour and by taking the start of one contour to the start of the next contour in the series. The angles are then outputted into a file. A unity script attached to the rig joints of a model then sets a desired angle from the output file and interpolates from the current angle of the joint to the desired angle, creating animation.

Project info

  • Developer Romain Bourdon
  • Showcase year 2021
  • Programme Computer Game Applications Development

Creating animations by using computer vision to extract motion data

This project extracts range of movement angles from animal joints using computer vision to create realistic animations that are comparable with traditional animations.

Motivation

Reading about the procedural animation that the creators of planet zoo use and wondering if there was a way to animate animals from video.

Credits

“Creating animations by using computer vision to extract motion data” is a 2021 Digital Graduate Show project by Romain Bourdon, a Computer Game Applications Development student at Abertay University.      

Find out more      

Romain's Website

Full Project Here!

Romain Bourdon

Pause carousel

Play carousel