Google found a solution to index the web pages protected by webmasters or owners. "First Click Free" means to allow Google to include your protected pages in the search results, and to provide full access for the text on that page. This way, the first visit is free for paid subscription and other protected pages and does not require a login. The free visitor can be block for the other protected pages or sections.
In order to implement the First Click free, the webmasters have to provide full access to the first visited page for the visitors coming from the search engine search results or other Google domain, the displayed page must be identical to the content that is shown to Googlebot, and for a multi-page article the webmasters must provide full access to all the corresponding pages. The webmaster needs needs to configure the website to serve the full text of each document when the request is identified as coming from Googlebot via the user-agent and IP-address, and the robots.txt file to allow access of these URLs by Googlebot. In order to do this, the web server will need to check the "Referer" HTTP request-header field.
The First Click Free URLs can be submitted using Sitemap files.
By using First Click Free, Google does not guarantee inclusion in the web index.
Technorati Tags: 

Tue, 10/21/2008 - 11:00
[...] unknown wrote an interesting post today onHere’s a quick excerptTechnorati Tags: access areas articles First Click Free Google Google Googlebot implement index multi-page owners protected robots.txt search results Sitemap web pages webmasters Google First Click Free protected areas index web pages … [...]
Post new comment