Are doodles the key to an effective search?

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

NEWS

Do you remember faces better than names? A team of university researchers is developing software that applies the same phenomenon to PCs.

VisualID is an experimental program that seeks to help individuals more rapidly find their word files or spreadsheets by tagging them with graphical -- and largely arbitrary -- icons.

A snowflake with pop artist Peter Max overtones, for instance, might represent a document listing the members of an organisation, while a dachshund-with-a-hat doodle might become the visual mnemonic for the household expense file.

The principle behind VisualID is that humans can remember pictures better than words, and can navigate faster and easier with distinct, individual images than with generic icons (like the consistent, omnipresent "W" that tags Microsoft Word documents).

"Our visual brains 'suck up' the appearance of everything we see. It doesn't require effort or even conscious thought. We just do it, all the time," J.P. Lewis, a researcher at the University of Southern California and the principal author of the project, wrote in an email interview. Researchers at USC and at the Massachusetts Institute of Technology are cooperating on the project.

The quest for better desktop navigation is as old as the computer industry itself. Mice, graphical Oases and directories have all helped simplify PC controls. More recently, Google, Apple Computer, Microsoft and others have announced plans to release search tools that will scour hard drives for files, although Microsoft recently delayed its project.

The appeal of VisualID is that it takes advantage of the familiarity of the graphical icons concept and the hardwiring of human psychology. The program won't replace text file names -- just enhance them.

"Visuals always help," said Jerry Tarasofksky, CEO of iPerceptions, which analyzes Web sites for large companies. "When you are looking for shoes, an icon is so much clearer than 'shoes.'"

One of the more intriguing findings with VisualID has been that the icons themselves don't have to be meaningful for people to remember them. A squiggly sea monster-like icon can just as easily represent a file outlining monthly sales figures or a stored URL on beach vacations.

It turns out that "scenery" of this sort is not used by the brain for data visualisation but instead enables visual search and memory, according to Lewis. The icons of VisualID can relate to each other. The program fashions similar icons for files with similar names, and icons can be grouped under a thematic meta-icon. But, overall, no intrinsic connection between content of the file and doodle exists.

"We cannot always guess the appearance of a book due to arrive in the mail from knowledge of its subject matter, but its somewhat arbitrary appearance is almost instantly learned and remembered once we see it," Lewis writes. "I think the realisation that relating the visuals to content is not necessary is one of our bigger contributions."

Doodle away, maestro
VisualID icons, called doodles, expand on the icon vocabulary in software today. Applications on PCs typically sport icons -- like the script triangle that signifies Adobe Acrobat files -- but the icon stays the same for each document or file created with that application. VisualID gives each file its own distinct symbol automatically.

While the shape of an icon is random, the program creates mutations of an original icon if a new file shares a similar name. The icons differ from each other by shape, but color may be added as a future identifier.

Determining what makes a good icon remains a challenge. The VisualID icons are deliberately complex to avoid confusion and overlapping imagery, but also try avoid excessive complexity. The group adopted the Kolmogorov definition of complexity, which says that an object is complex to the extent that each part of it is unpredictable given the other parts.

"A humanised version of the definition would be: How many words would it take someone to describe a particular icon to someone else over the phone with enough detail that it could be picked out from among other icons of the same general sort?" Lewis said. For instance, a triangle is easily identifiable, but there aren't enough simple shapes like this for the thousands of files inside the average PC. A circle containing random dots is clearly distinct and individual, but nearly impossible to remember with precision.

A look at results
Surprisingly, people can keep many squiggly figures in mind. "In one study, people were able to form much better than chance recognition memory for a set of 100 of these icons after seeing them once for a few seconds each," Lewis wrote. "The brain is finite, so there is some limit to how many icons can be learned, depending on how long a person spends working with the icons...I would guess that this number is in the several hundreds to several thousands range."

Fortunately, not all of the figures have to be kept at the forefront of the mind. Because most people access just a few files during a given period -- and often never access many files after a relevant period again -- only a few files need be actively recognised at any given time.

It's too soon to tell whether the VisualID work will influence the future development of software. But early tests indicate that the system works. In one experiment, VisualID users took 25.2 seconds on average to conduct four file searches versus 30.5 seconds for those seeking with generic icons. In another experiment, subjects recalled VisualID tags 37 percent of the time a day later, as opposed to 24 percent of the time with generic markers.

Subjects contacted six weeks after the study were able to still correctly identify previously seen icons (as opposed to icons they weren't shown in the experiment) 80 percent of the time, according to researchers.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Freebies202

Duplicate comments are not made intentionally. Its very good to know that now you are keeping check on this problem because sometimes a commenter...

35 minutes ago by Freebies202 on Microsoft fixes blog comments, speeds up blogs with open source
kevinmchapman

"the very significant number of users" and "many (most) of us" - you have no evidence for these statements. It is a fact that most users are saying...

9 hours ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
Marg Menzies Harrison

Another grammar faux pas is the improper use of "you". When sitting down down in a restaurant, for example, I get cringe when the waitress...

10 hours ago by Marg Menzies Harrison via Facebook on 10 flagrant grammar mistakes that make you look stupid
zdnetukuser

And NOW, folks, for Canonical's next trick... Kubuntu is late. Here's a pencil. Draw your own conclusions. cf.:...

11 hours ago by zdnetukuser on Linux Minterface
Moley

@kevinmchapman. The discussion here reflects the very significant number of users who really do like the traditional menu system and who wish to...

13 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

Er, no... It is an efficient means of finding the application/file/setting you need in one place. The icons are a simply a fallback for when you...

14 hours ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

Isn't the provision of a text based search an admission by the developers that the mass of icons approach does not work? I don't need to use a...

15 hours ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
kevinmchapman

"Unity and GNOME 3 both abandon the old text-based cascading menus in favour of a graphical icon-driven system." Point truly missed. Both use a...

16 hours ago by kevinmchapman on A tale of two distros: Ubuntu and Linux Mint
TerryRK

whs001 - Thank you, I'm glad you liked the article. I absolutely agree with you on your first point. I should perhaps have made it clearer that...

16 hours ago by TerryRK on A tale of two distros: Ubuntu and Linux Mint
Dennis Nilsson

If we allow corporate interest to dictate the way our government circumvents due process against foreign entities then we should accept the same...

17 hours ago by Dennis Nilsson via Facebook on ACTA stumbles in Germany
GHar123

I totally dislike pirating of works, I fear that artists will be deterred from creating works if they think that they are going to get ripped off....

19 hours ago by GHar123 on ACTA stumbles in Germany
JCB33

How dare film makers, artists or anybody that invests in creativity stop us pirating their works for free. I want to be able to walk into my local...

1 day ago by JCB33 on ACTA stumbles in Germany
Moley

@GrueMaster. I prefer horses for courses rather than one size fits all. I, and I suspect most other computer users, do not really wish to have...

1 day ago by Moley on A tale of two distros: Ubuntu and Linux Mint
greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

1 day ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

1 day ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

1 day ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

1 day ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

1 day ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

1 day ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Moley

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

1 day ago by Moley on A tale of two distros: Ubuntu and Linux Mint