Comments on: Create a robots.txt file http://www.dailyblogtips.com/create-a-robotstxt-file/ Thu, 09 Feb 2012 07:21:17 +0000 hourly 1 By: Kamal Hasa http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1167386 Kamal Hasa Thu, 06 May 2010 14:56:09 +0000 http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1167386 Well the images folder that is being mentioned could be the ones like the icons and miscellaneous images. as far as the normal images are concerned it should and needs to be crawled by Google. My blog receives more than 30% of the traffic from Google Images presently. Well the images folder that is being mentioned could be the ones like the icons and miscellaneous images.

as far as the normal images are concerned it should and needs to be crawled by Google. My blog receives more than 30% of the traffic from Google Images presently.

]]> By: Alan http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1165132 Alan Mon, 03 May 2010 23:15:07 +0000 http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1165132 Hi, My only issue is that WP has a virtual robots.txt file. This file, for example, is used with the xml sitemap plugin to list the Sitemap. So as not to have a duplicate Sitemap, I would imagine that I should tick the xml sitemap plugin option NOT to show the Sitemap in the virtual robots.txt file & put it the the new actual robots.txt file instead. Does this sound right? Thanks for the post! Hi,

My only issue is that WP has a virtual robots.txt file. This file, for example, is used with the xml sitemap plugin to list the Sitemap.

So as not to have a duplicate Sitemap, I would imagine that I should tick the xml sitemap plugin option NOT to show the Sitemap in the virtual robots.txt file & put it the the new actual robots.txt file instead.

Does this sound right? Thanks for the post!

]]> By: Saifa Raz http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1128754 Saifa Raz Thu, 25 Mar 2010 08:53:41 +0000 http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1128754 This Article is Great. thanks for the Information. but r these really useful for indexing by Google ? This Article is Great. thanks for the Information.
but r these really useful for indexing by Google ?

]]> By: Keith Davis http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1027265 Keith Davis Wed, 25 Nov 2009 19:46:22 +0000 http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-1027265 Hi Dan That's my next step for my site... creating a robots.txt file. I've always understood the problem of duplicate content, but the penny has only just dropped about how easy it is to create duplicate content with a wordpress site. Great solution, to use a robots.txt file. Hi Dan
That’s my next step for my site… creating a robots.txt file.

I’ve always understood the problem of duplicate content, but the penny has only just dropped about how easy it is to create duplicate content with a wordpress site.

Great solution, to use a robots.txt file.

]]> By: Daily Good Tips http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-944035 Daily Good Tips Sat, 08 Aug 2009 03:36:29 +0000 http://www.dailyblogtips.com/create-a-robotstxt-file/#comment-944035 Create robot.txt just can be created in wordpress or website with wordpress but I think robot.txt creating can not be applied in blogspot template. We just talk google if we want to change the robot.txt. Create robot.txt just can be created in wordpress or website with wordpress but I think robot.txt creating can not be applied in blogspot template. We just talk google if we want to change the robot.txt.

]]>