Channels ▼
RSS

Design

Visual Intelligence Project


Ground surveillance is a mission normally performed by human beings, such as Army scouts. Military leaders would like to shift this mission to unmanned systems, removing troops from harm’s way — but unmanned systems lack a capability that currently exists only in humans: visual intelligence.

The Defense Advanced Research Projects Agency (DARPA) is addressing this problem with Mind’s Eye, a program aimed at developing a visual intelligence capability for unmanned systems.

Humans perform a wide range of visual tasks with ease, something no current artificial intelligence can do in a robust way. They have inherently strong spatial judgment and are able to learn new spatiotemporal concepts directly from the visual experience. Humans visualize scenes and objects, as well as the actions involving those objects and possess a powerful ability to manipulate those imagined scenes mentally to solve problems. A machine-based implementation of such abilities is broadly applicable to a wide range of applications, including ground surveillance.

The joint military community anticipates a significant increase in the role of unmanned systems in support of future operations including jobs like persistent stare. By performing persistent stare, camera-equipped unmanned ground vehicles (UGVs) would take scouts out of harm’s way. Such a capability, however, would not constitute a force multiplier because human analysts would have to interpret streaming video from these platforms to detect operationally significant activities. A truly transformative capability requires visual intelligence, enabling these platforms to detect operationally significant activity and report on that activity so warfighters can focus on important events in a timely manner.

DARPA has contracted with 12 research teams to develop fundamental machine-based visual intelligence: Carnegie Mellon University, Co57 Systems, Inc., Colorado State University, Jet Propulsion Laboratory/CALTECH, Massachusetts Institute of Technology, Purdue University, SRI International, State University of New York at Buffalo, TNO (Netherlands), University of Arizona, University of California Berkeley and University of Southern California. These teams will develop a software subsystem suitable for employment on a camera for man-portable UGVs, integrating existing state of the art computer vision and AI while making novel contributions in visual event learning, new spatiotemporal representations, machine-generated envisionment, visual inspection and grounding of visual concepts.

DARPA has also contracted with three teams to develop system integration concepts: General Dynamics Robotic Systems, iRobot and Toyon Research Corporation. These teams are taking a collaborative approach to developing architectures incorporating newly-developed visual intelligence software onto a camera suitable as a payload on a man-portable UGV.


Related Reading


More Insights






Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

 
Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.
 

Video