Skip to main content

Human Robot Interface

Meet AMAS, the Advanced Mechanics Assistance System which makes operating robots easier than ever before. This new Human-Robot Interface from Extend Robotics allows non-robotic experts to operate and programme robots easily using gesture control.

What are the benefits of Human Robot Interface?

There are many benefits to be derived from the Human Robot Interface including:

• Remote programming, remote working, remote error recovery
• Fast, easy setup – avoids expensive programming and training of users
• Capable of handling complex tasks in remote locations
• Affordable User Interface providing faster return on investment

 

Virtual Reality, Mixed Reality, Extended Reality, Remote working, remote handling, robotic gesture control

How does the Human Robot Interface work?

The Advanced Mechanics Assistance System (AMAS) offers a truly remarkable next-generation immersive experience which requires two main components:-

1. The AMAS VR app which runs on consumer VR equipment (oculus, steam VR)
2. The peripheral hardware called SenseKit and RoboKit which can be attached and connected to the Universal Robot, enabling 3D sensing, connectivity and control.

Both components communicate via the internet to enable remote access.

Once set up, the user need only start the UR program and, using the AMAS interface, follow the instructions to connect to both the RoboKit and the SenseKit.

The signals are communicated to the robot via a small peripheral SenseKit attachment that fits to the base of the Universal Robot.

The AMAS Human-Robot Interface combines Real-time Volumetric Telepresence with Interactive Digital Twin and has 3 distinct benefits: Immersive Visualisation, Intuitive Operation and Semi-Automation Programming.

RoboKit UR

RoboKit UR works with the Universal Robot URCap and ROS protocol to provide essential connectivity and control from the Extend Robotics AMAS VR app.

This will transform the standard collaborative robot arm into an intuitive teleoperated robot over a standard network via WiFi or Ethernet.

Our UR robotic arm set-up is perfect for use in manufacturing, warehouse and medium to heavy industrial applications. Key features include:-

• Plug and play
• Modular and customizable for proof of concepts
• Support ROS (Robot Operating System)

Teleoperation, Telerobotics, Human Robot Interface, Virtual Reality, Mixed Reality, Extended Reality, Remote working, remote handling, volumetric telepresence, robotic gesture control

SenseKit

SenseKit is a core part of the AMAS package, which works alongside the RoboKit UR and the AMAS VR app to capture and stream 3D visual information of the workspace around the robot. There are two types of SenseKit: SenseKit Realsense and SenseKit Kinect.

Both SenseKit Realsense and SenseKit Kinect offer real-time volumetric capturing and streaming to Extend Robotics AMAS VR app over a standard network via WiFi or Ethernet. SenseKit is the world’s first plug and play IP camera that streams 3D data, under low latency (< 100 ms) and low bandwidth (20 Mbps). The key features of each SenseKit are as follows:

SenseKit Realsense

The Realsense camera offers low latency RGB-D capturing under a wide range of lighting conditions for both indoor and outdoor applications. Optionally, it offers real-time bi-directional audio communication with the Extend AMAS app. Key features include:-

• RGB-D Capturing and streaming device over standard network
• Low-cost option for fast moving tasks
• Perform well in both indoor and outdoor environments.
• Optional audio communication

SenseKit Realsense, Extend AMAS app, Realsense camera, RoboKit UR, Advanced Mechanics Assistance System

SenseKit Kinect

Kinect camera offers high accuracy, high resolution RGB-D capturing under indoor lighting conditions. It works the best for non-black, non-reflective, non-transparent surfaces. Optionally, it offers real-time bi-directional audio communication with the Extend AMAS app. Key features include:-

• RGB-D Capturing and streaming device over standard network
• High accuracy option for high precision tasks
• Perform well in indoor environments.
• Optional audio communication

SenseKit Kinect, Kinect camera, Teleoperation, Human Robot Interface

What Applications can our Human Robot Interface be used for?

AMAS allows workers to remotely operate robots to perform complex tasks in hazardous environments or in areas that are very hard to access physically. Remote robot operation improves the safety of workers in industries such as

• Decommissioning nuclear facilities
• Inspection and maintenance of offshore energy facilities
• Handling toxic pharmaceutical material
• Servicing low earth orbit satellites