Next steps

This guide is the first in a series of guides about training your own gesture recognition on the Raspberry Pi using machine learning. There are some limitations to this approach:

  • Changes to location, background, and even clothing can throw detection off.
  • Recording longer example videos can cause out of memory errors during training.
  • It is difficult to train networks to recognize subtle gestures that do not cause much visual change in the image.

You can easily extend the example code by modifying the classifier network, and by changing the actions that are performed when each category is detected. If you are already familiar with neural networks, we recommend that you add data augmentation techniques and explore different feature extraction networks like larger MobileNets and the Inception family.

We also explore these topics in the Teach your Raspberry Pi, Episode 2: multi-gesture recognition guide.