Operating robots with virtual reality

Bagus Manuaba is researching at the ANU how to remote control a machine using virtual reality. Devices such as bomb disposal robots are normally operated by remote control, with an operator looking at a live video display and pushing buttons and operating a joystick. The operator is only a few hundred metres from the robot and so there is little delay transmitting video from the robot to the operator and the operators instructions back. However, as the distance in increases the, delay does also.

Where the operator is on one side of the world and the robot the other, the delay prevents fine control and the robot has to be semi-autonomous. In addition, looking at a flat 2d image makes it hard to control a robot.

Some systems use stereoscopic video, such as the Airbus Military Aerial Refuelling Boom System (ARBS) fr the Airbus A330 Multi Role Tanker Transport (MRTT) aircraft being acquired by the Royal Australian Air Force. With this system the operator sits in the aircraft cockpit and fly the boom while looking at a stereoscopic image. Previous systems, such as the KC-135, require the operator to be in the tail of the aircraft. It might be interesting to enhance the Airbus system with virtual reality.

Teleoperation System with Supervisory Control in a Mixed Reality Environment

Bagus Manuaba (SoCS CECS)

CS HDR MONITORING Info & Human Centred Computing Research Group

DATE: 2010-04-15
TIME: 11:30:00 - 12:00:00
LOCATION: Ian Ross Seminar Room
CONTACT: Michelle.Moravec@anu.edu.au

ABSTRACT:
Mixed reality is a new innovation of virtual reality. By combine this innovation with supervisory control in teleoperation system is expected can solve any limitations that occur in teleoperation system today. In this presentation I will give a brief description about teleoperation, supervisory control and mixed reality, and also bring several examples of research that related in this area. In addition, it is also showing the focus and the expected outcomes from my current research.

Virtual Reality for Commanding the Australian Defence Force

The Australian Department of Defence has issued a Request for Tender for a "Headquarters Joint Operations Command (HQJOC) Telepresence System" providing virtual reality meeting rooms. There is a 94 page document available, but only a couple of pages addresses the requirement in very general terms. This seems a good opportunity for those with advanced systems to offer products beyond ordinary video conferencing. One limitation will be compatibility with systems such as those I observed personnel using on the USS Blue Ridge.

The Department of Defence (Defence) requires solutions for a virtual reality meeting capability between two Defence locations in and near Canberra, ACT, Australia.

Defence is seeking a Respondent's proposed solution that will:

a. provide Defence with visibility of Respondents products, indicative costs and options for a virtual reality meeting solution;

b. meet Defence's current and future defence capability requirements;

c. provide Defence with a value-for-money solution;

d. provide significant and sustainable benefits to Defence, defence industry and the Respondent who is ultimately successful in the process; and

e. provide long-term cost benefits and risk reduction to other forms of personnel communications over short, medium and long distances. ...

From: "Headquarters Joint Operations Command (HQJOC) Telepresence System, AZ4477, Defence Support Group of the, Department of Defence, 23-Feb-2009