# If the Joomla site is installed within a folder such as at # e.g. www.example.com/joomla/ the robots.txt file MUST be # moved to the site root at e.g. www.example.com/robots.txt # AND the joomla folder name MUST be prefixed to the disallowed # path, e.g. the Disallow rule for the /administrator/ folder # MUST be changed to read Disallow: /joomla/administrator/ # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/orig.html # # For syntax checking, see: # http://tool.motoricerca.info/robots-checker.phtml User-agent: * #THIS ALLOWS FULL RENDER AT ENGINES Allow: /*.js*************** Allow: /*.css************** Allow: /*.png************** Allow: /*.jpg************** Allow: /*.jpeg************** Allow: /*.gif************** Allow: /*.eot************** Allow: /*.woff************** Allow: /*.ttf************** Allow: /*.svg************** Allow: /*.otf************** Allow: /*.pdf************** Allow: /*.PNG************** Allow: /*.JPG************** Allow: /*.JPEG************** Allow: /*.mp3************** Allow: /*.pdf************** Allow: /*.webp************** # 4SEO-opt Disallow: /cache/ # THESE FOLDERS SHOULD NEVER BE CRAWLED Disallow: /administrator/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /logs/ # Disallow: /flowsocialmedia.com/ Disallow: /layouts/ Disallow: /libraries/ Disallow: /tmp/ Disallow: /cli/ #SEO Testing To Block Random Pages With Variables Disallow: /?types* Disallow: /?pages* Disallow: /?format* Disallow: /?limit* Disallow: /page-*/ Disallow: /component/tags/ Disallow: /*feed* Disallow: /*rss* Disallow: /*wp-content* Disallow: /?amp* Disallow: /?font* Disallow: /?amp* Disallow: /?amp* Disallow: /?filter_tag* Disallow: /images/jch-optimize* Disallow: /index.php/?* Disallow: /tag/* #Disallow: /js/editors/* Disallow: /?start* Disallow: /?id=* Disallow: /media/system/js/* # 4SEO-sitemap: sitemap - added on 2024-08-14 04:02:39 - Please do not modify manually. Sitemap: https://menwhoblog.com/sitemap-4seo.xml User-agent: * Allow: /sitemap-4seo # /4SEO-sitemap