NEWS / WINDOWS

Google, Yahoo, Microsoft To Clean Up Web

14 Feb, 2009, 10:43 am IST | IANS | Windows

In a rare instance of collaboration among otherwise fierce rivals, Google, Yahoo and Microsoft said they would support a new web standard that will allow millions of publishers to remove duplicate pages from their websites. As a result, search engines would be able to make their search results more comprehensive.

"There is a lot of clutter on the web and with this, publishers will be able to clean up a lot of junk," said Matt Cutts, an engineer who heads Google's spam fighting efforts, the New York Times reported.

"I think it is going to gain traction pretty quickly," said Cutts.

The problem is the following: Many web publishers, especially those that have voluminous sites, like e-commerce companies, have multiple URLs that all point to the same page. This confuses search engines, sometimes causing them to index the same page multiple times. As much as 20 percent of URLs on the web may be duplicates, according to some estimates.

Engineers at Google came up with a simple way for web publishers to indicate when a URL is a duplicate, and if so, which is the principal, or "canonical," URL that search engines should be indexing. Yahoo and Microsoft, the no. 2 and no. 3 search engines, have agreed to support the same standard.

"We are happy that everyone is going to support the same implementation," said Nathan Buggia, a lead program manager at Microsoft. "This is a clear benefit for publishers as it gives them an opportunity to get more exposure through search engines."

All search engines have developed technologies to detect duplicates that are more or less effective. The so-called Canonical Link Tag, as the standard is known, should make it easier for both publishers and search engines to address the problem, NYT reported Thursday.

"It is an important step because all the search engines are coming out with it," said Priyank Garg, director of product management for web search at Yahoo.

Tags: Google , Yahoo , Microsoft

RELATED STORIES

Google doodles for Valentine's Day

Google doodles for Valentine's Day

Google, after its little Valentine's Day easter egg has released a doodle to celebrate this day of love. When you go to the Google homepage today, ...

Prepaid cards for Google Wallet temporarily disabled; Google says it is safe

Google is getting new test labs and 'Experience Center' at Googleplex

Google expands Chromium Security Rewards Program

Google easter eggs for Valentine's Day

HC continues with criminal proceedings against Yahoo! India

How to Root and install Custom Recovery on any Android phone

 

Leaked Images, Availability, Pricing,
Specs, Pre-order

features

5 free operating systems that aren't Linux

5 free operating systems that aren't Linux

The war of operating systems started decades ago, and the first mainstream

By Rossi Fernandes

It's a great time to be a family

It's a great time to be a family

Microsoft has unveiled its first ever global, multi-product advertising...

By Advertorial

A look at MeeGo on a netbook

A look at MeeGo on a netbook

In a sea of operating systems with Windows 7, the upcoming Windows 8 and...

By Rossi Fernandes

MORE FEATURES

Close

More from this Author

Android Roars Past iPhone in US