seo¿ìÅÅ£º Ê×Ò³ » ÍøÕ¾seo½Ì³Ì » SEOÅàѵϵͳ½Ì³Ì » °Ë¡¢robots.txtÎļþ´úÂë´ú±íʲôÒâ˼£¿

°Ë¡¢robots.txtÎļþ´úÂë´ú±íʲôÒâ˼£¿

·¢±íÓÚ£º2017-06-17 12:05 À´Ô´£ºseo¿ìÅÅ ±êÇ©£º robotsÎļþ robotsÎļþÔõô¿´£¬
robots.txtÎļþÊÇʲôÒâ˼ÄØ
 
´ó¼ÒÖªµÀrobots.txtÊÇʲôÂð£¿ÔÚÍøÕ¾ÓÅ»¯µÄ¹ý³ÌÖУ¬¶¼»áÓöµ½Ïà¹Ørobots.txt׫дҲÊÇÓÅ»¯µÄÒ»²¿·Ö¡£½ñÌìseo¿ìÅÅС±à¸ø´ó¼ÒÏêϸ½éÉÜÏÂrobots.txtÎļþ´úÂë´ú±íʲôÒâ˼£¿
 
ÎÒÃÇÓ¦¸Ã¶¼ÖªµÀËÑË÷ÒýÇæÓÃÀ´ÅÀÈ¡ÍøÒ³ÄÚÈݵŤ¾ßÎÒÃdzÆ֮ΪËÑË÷ÒýÇæ»úÆ÷ÈË¡£ËÑË÷ÒýÇæ»úÆ÷ÈËÿ´ÎÀ´µ½Òª×¥È¡µÄÍøÕ¾£¬¶¼»áÏÈ·ÃÎÊÕâ¸öÍøÕ¾¸ùĿ¼ÏµÄÒ»¸öÎļþ£¨robots.txt£©£¬Èç¹û²»´æÔÚ¸ÃÎļþ£¬ÔòËÑË÷ÒýÇæ»úÆ÷ÈËĬÈÏÕâ¸öÍøÕ¾ÔÊÐíÆäÈ«²¿×¥È¡¡£ 
 
robots.txtÊÇÒ»¸ö¼òµ¥µÄ´¿Îı¾Îļþ£¨¼Çʱ¾Îļþ£©£¬ËÑË÷ÒýÇæ»úÆ÷ÈËͨ¹ýrobots.txtÀïµÄ“˵Ã÷”£¬Àí½â¸ÃÍøÕ¾ÊÇ·ñ¿ÉÒÔÈ«²¿×¥È¡»ò²¿·Öץȡ¡£
 
Èç¹ûÄãÏ£ÍûËÑË÷ÒýÇæÊÕ¼ÄãÍøÕ¾µÄÈ«²¿ÍøÒ³£¬ÔòÄã¿ÉÒÔ²»ÉèÖÃrobots.txt»òÉÏ´«Ò»¸öÃüÃûΪrobots.txtµÄ¿Õ¼Çʱ¾µ½¸ù±¾Ä¿Â¼¡£
 
ÉÏ´«ÄãµÄrobots.txtºó£¬Í¨¹ýÄãµÄÓòÃû/robots.txt ¿ÉÒÔÕý³£·ÃÎÊ¡£ ×¢Ò⣬robots.txtµÄÃüÃû£¬¶¼Ó¦¸ÃÊÇСд¡£
 
·ÃÎÊÈ磺/robots.txt
 
robots.txtÎļþµÄÄÚÈÝÖ÷Òª¾ÍÊÇÒ»¸ö´úÂ룺Disallow:
 
×¢Ò⣬robots.txtÎļþÖÐÒ»°ãÒª°üº¬ÖÁÉÙÒ»¸öDisallow:  
 
Èç¹û¶¼ÔÊÐíÊÕ¼£¬Äã¿ÉÒÔдһÐÐDisallow:/search.html   Õâ¸öÎļþ(search.html)±¾À´¾Í²»´æÔÚҲûÊ¡£ÏÂÃæ¼òµ¥·ÖÏíÈçºÎÈÏʶrobots.txtÎļþ´úÂë´ú±íʲôÒâ˼£¿
 
¸ñʽÈ磺
 
User-agent: *
 
Disallow: /search.html
 
Disallow: /index.php?
 
Disallow: /tempweb/
 
˵Ã÷£º
 
User-agent: *   ÐǺÅ˵Ã÷£¬ÔÊÐíËùÓеÄËÑË÷ÒýÇæÀ´ÊÕ¼£¬°üÀ¨°Ù¶È¡¢google¡¢yahooµÈ¡£
 
Disallow: /search.html  ËµÃ÷²»ÔÊÐíÊÕ¼ /search.html Õâ¸öÎļþ¡£
 
Disallow: /index.php?  ËµÃ÷²»ÔÊÐíÊÕ¼ÒÔindex.php?Ϊǰ׺µÄÁ´½ÓÈ磺index.php?122.html¡¢index.php?=12¡¢index.php?/baiduµÈµÈ
 
Disallow: /tempweb/  ËµÃ÷²»ÔÊÐíÊÕ¼/tempweb/ÀïµÄËùÓÐÎļþ¡£µ«¿ÉÒÔÊÕ¼È磺/tempwebtaim.html µÄÁ´½Ó¡£ ÕâÀï½éÉܵÄÊdz£Óõļ¸¸ö´úÂë¡£ 
 
Ïà¹ØÎÊÌ⣺ 
 
1¡¢ÎÒ·¢ÏÖÓÐÒ»¸öÍøÕ¾±»KÁË£¬µ«Ëü¼ÓÁËÎÒµÄÍøÕ¾Á´½Ó£¬ÎÒ¿ÉÒÔ°ÑËüÆÁ±ÎÂ𣿠
 
±»KµÄÍøÕ¾¼ÓÄãÍøÕ¾µÄÁ´½Ó£¬¶ÔÄãÍøÕ¾ÊÇûÓÐÌ«´óÓ°ÏìµÄ¡£Í¨¹ýrobots.txtҲûÓа취ÆÁ±ÎÍⲿÁ´½Ó¡£¶ø²»ÒªÊÇÏ໥Á¬½Ó£¬¶¼ÊÇûÎÊÌâµÄ¡£
 
 
2¡¢ÎÒµÄÊ×Ò³ÊÇindex.html£¬ÎÒ¿ÉÒÔ°Ñindex.phpÆÁ±ÎÂð£¿
 
ÀíÂÛÉÏÊÇû´óÎÊÌ⣬µ«ÎªÁË°²È«Æð¼û£¬Çë²»ÒªÆÁ±Î¡£²»ÆÁ±ÎÊÇÒ»¶¨Ã»Ê£¬µ«ÆÁ±ÎÁË£¬¿ÉÄÜ´æÔÚÒþ»¼¡£
 
 
3¡¢ÎÒ²»Ï²»¶ÎÒÍøÕ¾µÄºǫ́µÇ½µØÖ·±»ËÑË÷ÒýÇæÊÕ¼£¬Í¬Ê±Ò²²»Ï£Íû·ÅÔÚrobots.txtÀï±»ÆäËûÈËÖªµÀ¡£ÎÒÔõôÀ´ÆÁ±ÎÄØ£¿
 
Äã¿ÉÒÔÔÚºǫ́µÇ½µØÖ·µÄÊ×Ò³ÀÌí¼Ónofollow±êÇ©¡£
 
 
4¡¢Èç¹ûÎÒÖ»ÊǾßÌåijһ¸öÒ³Ã治ϣÍû±»ÊÕ¼£¬Ôõô°ì£¿ 
 
¿ÉÒÔÓÃrobots.txtÆÁ±ÎÕâ¸öÒ³Ã棬Ҳ¿ÉÒÔÓà nofollow±êÇ©ÔÚ¸ÃÒ³ÃæÀïÆÁ±ÎÕâ¸öÒ³Ãæ¡£
 
 
5¡¢ÓÐʲôעÒâµÄ¾­Ñ飿
 
1¡¢ÎÒÃÇ¿´µ½Ò»Ð©Í¬Ñ§£¬ÔÚrobots.txtÀïÆÁ±ÎÁËÊ×Ò³Îļþ¡£±ÈÈ磺index.html¡¢index.php¡¢Default.php£¬Ô­ÒòÊÇ£¬ËûµÄÊ×Ò³¿ÉÄÜÊÇindex.asp£¬µ«Í¨¹ýÒÔÉÏÕ⼸¸öÒ²ÄÜ·ÃÎÊÊ×Ò³£¬ÓÚÊÇ£¬Ëû¾ÍÏëÆÁ±ÎÁËËûÃÇ¡£ÕâÑùµÄ×ö·¨ÊDz»¶ÔµÄ¡£Ê×Ò³£¬¾¡Á¿¶¼²»ÒªÆÁ±Î¡£
 
2¡¢Èç¹ûÍøÕ¾ÉÏ´æÔÚһЩ±È½Ï´óµÄÎļþ¡¢±ÈÈ磺´ò°üÎļþ¡¢´óͼƬÎļþ¡¢ÒôÀÖÎļþ¡¢»òµçÓ°Îļþ¡¢ÈÕÖ¾Îļþ¼ÐµÈµÈ£¬¿ÉÒÔÆÁ±Îµô£¬ÒòΪÕâЩÎļþ¿ÉÄÜÈÃÄãµÄÁ÷Á¿¹ý´ó£¬Õ¼Óùý¶à¿í´ø¡£
 
Ïà¹ØÔĶÁ£º
 
Î塢ʲôÊÇÈÈËѹؼü´Ê£¿
Áù¡¢Ê²Ã´ÊÇÍøÕ¾pvÖµ£¿