Technology & Science

Story Tools: E-MAIL | PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

Software recognizes and describes images in words

Last Updated: Thursday, November 2, 2006 | 4:39 PM ET

U.S. researchers have developed a computer system that can automatically recognize the content of a photograph and describe it in English.

The system by Penn State University professors uses a vocabulary of up to 332 words to annotate a photo with subject-relevant descriptors or keywords. For example, an image of a polo match could be described by the system as "sport," "people," "horse," "polo," the researchers said.

The technology makes it possible to automatically tag images with keywords, rather than having a person manually label the photos. The system can tag online collections of images as they are uploaded.

Image search engines currently rely on text tags to help index and sort images, so those that don't have descriptions are effectively invisible to search requests.

The Automatic Linguistic Indexing of Pictures Real-Time (ALIPR) system developed by Penn State associate professors James Wang and Jia Li solves the problem by analyzing the images and comparing them against a database. The computer then suggests 15 possible tags for the image.

"By inputting tens of thousands of images, we have trained computers to recognize certain objects and concepts and automatically annotate those new or unseen images," Wang said in a statement. "More than half the time, the computer's first tag out of the top 15 tags is correct."

The analysis takes about 1.4 seconds per image and in 98 per cent of tests suggests at least one correct tag in the top 15.

The university has applied for a patent on the invention.

Related

More Technology & Science Headlines »

Microsoft, Novell team up to bridge divide
Microsoft Corp. is partnering with rival Novell, Inc., to improve interoperability of their software in a deal announced by the chief executives of both companies in San Francisco on Thursday.
Battle over 'net neutrality' arrives in Canada
The fight in the United States by major telecom companies to control web content has arrived in Canada with little fanfare — and could dramatically change the nature of the internet.
Software recognizes and describes images in words
U.S. researchers have developed a computer system that can automatically recognize the content of a photograph and describe it in English.
Researchers project collapse of seafood species
The ocean ecosystems are in trouble and losing species fast, which could leave no seafood to harvest before 2050 if the current global trend continues, said researchers Thursday.
Google offers Gmail mobile tool
Google Inc. on Thursday released software that lets users of its Gmail service more easily use the company's free e-mail offering from their mobile phones.
Story Tools: E-MAIL | PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

World »

Researchers project collapse of seafood species
The ocean ecosystems are in trouble and losing species fast, which could leave no seafood to harvest before 2050 if the current global trend continues, said researchers Thursday.
Canada near top, U.K. at low end in protecting privacy rights: survey
When it comes to privacy rights, Britain is considered one of the worst protectors while Canada ranks among one of the top defenders, according to a new survey.
Suspect in California wildfire could face death penalty
A man suspected of starting a wildfire last week in Southern California that killed five firefighters could face the death penalty, a prosecutor said Thursday.
more »

Canada »

Internet cops arrest man after witnessing child abuse live online
An undercover police officer alleges he caught a man sexually assaulting a young child in southern Ontario live on the internet.
Too little folate in diet may raise colon cancer risk: mouse study
A diet low in folic acid appears to increase the risk of colorectal cancer in laboratory mice, and a similar deficiency could play a role in the human form of the disease: study.
Former soldiers want Ottawa to address stress claims
A group of military veterans is willing to settle their lawsuits with the federal govenment for about $10 million, a fraction of the $100 million in claims they've made.
more »

Health »

Men may need earlier colonoscopies, study suggests
Men are more likely to have advanced growths in their colon at an early age than women are, a finding that suggests colonoscopy screening guidelines may need to take sex differences into account, researchers in Poland say.
No evidence treating gum disease reduces preterm births
Treating gum disease during pregnancy is safe, but is unlikely to prevent early delivery, a study suggests.
Family doctor shortage major hurdle to health care: study
A family physician shortage is among the biggest hurdles contributing to wait times for basic and specialized health care, according to a new report from the College of Family Physicians of Canada.
more »

Arts & Entertainment»

Cruise and partner to resurrect United Artists
Just months after being dumped by Paramount, Tom Cruise and his producing partner Paula Wagner have been put in charge of another Hollywood studio.
Residents of town in Desai's Booker novel upset about portrayal
Residents of the Himalayan town at the centre of Kiran Desai's Booker Prize-winning novel The Inheritance of Loss are upset over her portrayal of them.
Rankin Family plans comeback tour
Mabou's most famous singing family is reuniting on stage after an eight-year break.
more »

Technology & Science »

Microsoft, Novell team up to bridge divide
Microsoft Corp. is partnering with rival Novell, Inc., to improve interoperability of their software in a deal announced by the chief executives of both companies in San Francisco on Thursday.
Battle over 'net neutrality' arrives in Canada
The fight in the United States by major telecom companies to control web content has arrived in Canada with little fanfare — and could dramatically change the nature of the internet.
Software recognizes and describes images in words
U.S. researchers have developed a computer system that can automatically recognize the content of a photograph and describe it in English.
more »

Money »

Bleeding stops on TSX
The hemorrhaging on the Toronto Stock Exchange ended Thursday, as investors moved into banks and financial services stocks.
Famous Players takes Cineplex to new highs
The merger with Famous Players helped the Cineplex movie chain to new financial records in the third quarter.
Manulife Financial profit jumps 31%
Manulife Financial Corp. reported a 31 per cent jump in third-quarter profit as the company made $975 million.
more »

Consumer Life »

High-tech toys for tots dominate holiday season
A tot-sized MP3 player, a mini-computer in a smart pen and a lifelike pony that responds to voice and touch are among this season's hottest high-tech toys touted by Canadian toy organizations.
Battle over 'net neutrality' arrives in Canada
The fight in the United States by major telecom companies to control web content has arrived in Canada with little fanfare — and could dramatically change the nature of the internet.
Alesse birth control pills back in stock soon
Pharmaceutical giant Wyeth says it's making progress in ending a shortage of two popular birth control pills in Canada.
more »

Sports »

Scores: NHL CFL MLB

Koivu, Habs eye win in Carolina
Saku Koivu and the Montreal Canadiens meet Carolina Thursday night for the first time since last year's Eastern Conference quarter-final loss to the Hurricanes.
Canucks keep looking to Luongo
Roberto Luongo will start his seventh straight contest Thursday night when the Canucks take on the Wild in Minnesota.
Mike Weir drops swing coach
Mike Weir has ended a 10-year partnership with his swing coach.
more »
Click here to find out more!