1. 12 November 2009, UT Austin, CS Department Control of Humanoid Robots Luis Sentis, Ph.D. Personal robotics Guidance of gait

2. Assessment of Disruptive Technologies by 2025 (Global Trends)

3. Human on the loop:  Personal / Assitive robotics (health)  Unmanned surveillance systems (defense / IT)  Modeling and guidance of human movement (health) Human-Centered Robotics

4. Biomechatronics facility Emerging sensors Analysis of Human Gait (a) (b) (c) (d) Human-Centered Robotics Laboratory

5. Human Centered Robotics Today

6. Current Projects: Compliant Control of Humanoid Robots

7. Recent Project: Guidance of Gait Using Functional Electrical Stimulation

8. CONTROL OF HUMANOID ROBOTS

9. General Control Challenges  Dexterity: How can we create and execute advanced skills that coordinate motion, force, and compliant multi-contact behaviors  Interaction: How can we model and respond to the constrained physical interactions associated with human environments?  Autonomy: How can we create action primitives that encapsulate advance skills and interface them with high level planners PARKOUR

10. The Problem (Interactions)  Operate efficiently under arbitrary multi-contact constraints  Respond compliantly to dynamic changes of the environment  Plan multi-contact maneuvers Coordination of complex skills using compliant multi-contact interactions

11. Key Challenges (Interactions)  Find representations of the robot internal contact state  Express contact dependencies with respect to frictional properties of contact surfaces  Develop controllers that can generate compliant whole-body skills  Plan feasible multi-contact behaviors

12. Approach (8 years of development) 1.Models of multi-contact and CoM interactions 2.Methodology for whole-body compliant control 3.Planners of optimal maneuvers under friction 4.Embedded control architecture

13. Humanoids as Underactuated Systems in Contact Non-holonomic Constraints (Underactuated DOFs) External forces  Model-based approach: Euler-Lagrange Torque commands Whole-body Accelerations External Forces

14. Model of multi-contact constraints  Accelerations are spanned by the contact null-space multiplied by the underactuated model: Assigning stiff model:

15. Model of Task Kinematics Under Multi-Contact Constraints x q legs  Reduced contact-consistent Jacobian x base q arms  Differential kinematics  Operational point (task to joints)

16. Modeling of Internal Forces and Moments

17. Variables representing the contact state

18. Aid using the virtual linkage model (predict what robot can do) C C C C Grasp / Contact Matrix Center of pressure points Internal tensions Center of Mass Normal moments

19. Properties Grasp/Contact Matrix 1.Models simultaneously the internal contact state and Center of Mass inter- dependencies 2.Provides a medium to analyze feasible Center of Mass behavior 3.Emerges as an operator to plan dynamic maneuvers in 3d surfaces

20. Example on human motion analysis (is the runner doing his best?)

21. More Details of the Grasp / Contact Matrix  Balance of forces and moments:  Underdetermined relationship between reaction forces and CoM behavior: Optimal solution wrt friction forces

22. Example on analysis of stability regions (planning locomotion / climbing)

23. Contact Center of Pressures (CoPs) C  Balance of moments on support links

24. Dependency CoP’s – ZMP

25. Dependency CoP’s – ZMP (Coplanar Stance Only)  Relationship CoP’s - ZMP  Dependencies

26. Approach 1.Models of multi-contact and CoM interactions 2.Methodology for whole-body compliant control 3.Planners of optimal maneuvers under friction 4.Embedded control architecture

27. Linear Control Stanford robotics / AI lab Torque control: unified force and motion control (compliant control) Control of the task forces (pple virtual work) Control of the task motion Potential Fields

28. Inverse kinematics vs. torque control duality Pros: Trajectory based Cons: Ignores dynamics Forces don’t appear Pros: Forces appear Compliant because of dynamics Cons: Requires torque control Inverse kinematics: Torque control:

29. Highly Redundant Systems Under Constraints

31. Prioritized Whole-Body Torque Control  Prioritization (Constraints first):  Gradient descent is in the manifold of the constraint

32. Constrained-consistent gradient descent x task  Optimal gradient descent:  Constrained kinematics: x un-constrained

33. Constrained Multi-Objective Torque Control  Lightweight optimization  Decends optimally in constrained-consistent space  Resolves conflicts between competing tasks

34. Torque control of humanoids under contact

35. Control of Advanced Skills

36. Example: Interactive Manipulation

37.  Manifold of closed loops Control of internal forces  Unified motion / force / contact control

38. Compliant Control of Internal Forces  Using previous torque control structure, estimation of contact forces, and the virtual linkage model:

39. Simulation results

41. Approach 1.Models of multi-contact and CoM interactions 2.Methodology for whole-body compliant control 3.Planners of optimal maneuvers under friction 4.Embedded control architecture

42. Contact Requisites: Avoid Rotations and Friction Slides C Rotational Contact Constraints: Need to maintain CoP in support area Frictional Contact Constraints: Need to control tensions and CoM behavior to remain in friction cones

43. Automatic control of CoP’s and internal forces Motion control

44. CoM control

45. Example: CoM Oscillations

46. Lateral Walk: CoM and CoP Trajectoriy Generation

47. Specifications

48. Multiple steps: forward trajectories

49. Multiple steps: lateral trajectories

50. Results: lateral steps

51. Dynamic Walk

52. Approach 1.Models of multi-contact and CoM interactions 2.Methodology for whole-body compliant control 3.Planners of optimal maneuvers under friction 4.Embedded control architecture

59. Cognitive architecture

60. Demos Asimo  Upper body compliant behaviors  Honda’s balance controller  Torque to position transformer

61. Manipulation tests

62. Summary Grasp Matrix 1.Models of multi-contact and CoM interactions 2.Methodology for whole-body compliant control 3.Planners of optimal maneuvers under friction 4.Embedded control architecture

63. PRESENTATION’S END