Robots.txt文件用法举例

软件技术前端

honeymoose October 26, 2012, 1:06pm 1

禁止所有搜索引擎访问网站的任何部分User-agent: * Disallow: /

Topic		Replies	Views	Activity
Robots.txt 文件的格式前端	0	116	October 26, 2012
什么是robots.txt文件前端	0	102	October 26, 2012
Robots.txt 设置前端	0	107	October 26, 2012
Robots协议书写指南前端	0	104	July 15, 2012
向 Google 提交网站地图的 robots.txt 文件配置前端	0	124	October 26, 2012