Watch Should I block duplicate pages using robots.txt? Video

This text will be replaced

Added By: GoogleWebmasterHelp

Description:
Halfdeck from Davis, CA asks: "If Google crawls 1,000 pages day, Googlebot crawling many dupe content pages may slow down indexing of a large site. In that scenario, do you recommend blocking dupes using robots.txt or is using META ROBOTS NOINDEX,NOFOLLOW a better alternative?" Short answer: No, do...

Related videos to: Should I block duplicate pages using robots.txt?

Does Google treat "brandname" and "brandnameÂ®" differently?
0.90 min. | 4.85 user rating | 3396 views

Academy Award Winning Movie Trailer
3.38 min. | 4.8891172 user rating | 2379753 views

Does Google think the world will end in 2012?
0.15 min. | 4.134021 user rating | 9963 views

What are some effective techniques for building links?
7.87 min. | 4.704762 user rating | 22590 views

Are you on the Google PR team?
0.43 min. | 4.090909 user rating | 2783 views

If I use multiple versions of a phrase, would it be seen as keyword spam?
1.57 min. | 4.7586207 user rating | 4268 views

At what level is nofollow honored?
1.27 min. | 4.6666665 user rating | 3512 views

add sitemap tag to robots.txt
1.10 min. | 0 user rating | 658 views

Uncrawled URLs in search results
4.57 min. | 4.6444445 user rating | 20766 views

Google for Webmasters Tutorial: Discoverability
2.25 min. | 4.105263 user rating | 74181 views

Should we be worried about a penalty if we quickly removed hacked content?
1.30 min. | 4.7777777 user rating | 3592 views

SMX Seattle: Matt Cutts on Duplicate Content and Paid Search
6.80 min. | 4.9166665 user rating | 6222 views

Use Google Webmaster Tools to Create a robots.txt File
4.08 min. | 3.0 user rating | 2606 views

How can a site that focuses on video or images improve its rankings?
2.25 min. | 4.818182 user rating | 3822 views

Can having dofollow comments on my blog affect its reputation?
2.58 min. | 4.7 user rating | 5092 views

Does Google remove the PageRank coming from links on pages that no longer exist?
1.93 min. | 4.827586 user rating | 6029 views

Does conference attendance affect rankings?
1.05 min. | 4.4210525 user rating | 2607 views

Google for Webmasters Tutorial: Ranking
5.40 min. | 4.709677 user rating | 33117 views

Is it worth spending time on creating tags and categories?
1.98 min. | 4.695652 user rating | 12964 views

How can I remove old content from Google's index?
2.27 min. | 4.7083335 user rating | 4626 views

How can I get Google to index more of my Sitemap URLs?
1.52 min. | 4.4814816 user rating | 6027 views

Web Design Blog - Robots txt files explained
3.60 min. | 4.0 user rating | 1314 views

Google does not use the keywords meta tag in web ranking
1.97 min. | 4.6666665 user rating | 100220 views

Kraftwerk - The Robots
3.68 min. | 4.8160534 user rating | 4320088 views

Google Fiber Communities Davis California
2.77 min. | 0 user rating | 79 views

Link:

--------------------------------------------------------------------------
Embed:
--------------------------------------------------------------------------
Search:
--------------------------------------------------------------------------