Scene Understanding for Autonomous Robotic Systems Inferring Physical Interaction Application to Assistive Robotics & Precision Agriculture