This is good hobby, lot of time and effort is required to build this. I make hobby projects, mainly small or large copters and few arduino based stuff. I looked into detail of your project and it looks interesting and may be you can guide to me what I want to do. Most of the things are new to me in your project.
I want to detect humans, recognize their movement(gestures, like waving etc.) and then take some action based on that movement. For example the copter (having on board camera) can hover or move in one direction or land based on the gestures detected. Is it practical to do this with Tensorlfow?