# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # Used: http://example.com/robots.txt # Ignored: http://example.com/site/robots.txt # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html # # For syntax checking, see: # http://www.frobee.com/robots-txt-check User-agent: * # Paths (clean URLs) Disallow: /system/ Disallow: /about-us/ Disallow: /assets/ Disallow: /icons/ Disallow: /images/ Disallow: /javascript/ Disallow: /js/ Disallow: /latest-news/ Disallow: /layouts/ Disallow: /laouts_CLP/ Disallow: /mobile/ Disallow: /moduletemplates/ Disallow: /services/ Disallow: /styles/ Disallow: /stylesheets/ Disallow: /templates/ Disallow: /v2/assets/ Disallow: /v2/client/ Disallow: /v2/css/ Disallow: /v2/debtor/ Disallow: /v2/images/slider/ Disallow: /v2/images/slider demo/ Disallow: /v2/phone/ Disallow: /v2/scripts/ Disallow: /whowehelp Disallow: /debtor Disallow: /howwework Disallow: /client/articles Disallow: /ContactUs.htm Disallow: /forms Disallow: /client/resources/policiesy Disallow: /clients/Forums # Paths (no clean URLs) Disallow: /?q=/system/ Disallow: /?q=/about-us/ Disallow: /?q=/assets/ Disallow: /?q=/icons/ Disallow: /?q=/images/ Disallow: /?q=/javascript/ Disallow: /?q=/js/ Disallow: /?q=/latest-news/ Disallow: /?q=/layouts/ Disallow: /?q=/laouts_CLP/ Disallow: /?q=/mobile/ Disallow: /?q=/moduletemplates/ Disallow: /?q=/newsletters/ Disallow: /?q=/services/ Disallow: /?q=/styles/ Disallow: /?q=/stylesheets/ Disallow: /?q=/templates/ Disallow: /?q=/v2/assets/ Disallow: /?q=/v2/client/ Disallow: /?q=/v2/css/ Disallow: /?q=/v2/debtor/ Disallow: /?q=/v2/images/slider/ Disallow: /?q=/v2/images/slider demo/ Disallow: /?q=/v2/phone/ Disallow: /?q=/v2/scripts/ Disallow: /?q=whowehelp Disallow: /?q=debtor Disallow: /?q=howwework Disallow: /?q=client/articles Disallow: /?q=ContactUs.htm Disallow: /?q=forms Disallow: /?q=client/resources/policiesy Disallow: /?q=clients/Forums Allow: /root Allow: /client Allow: /debtor Sitemap: http://www.lcollect.com.au/sitemap_v18.xml Sitemap: http://www.lcollect.com.au/landing_sitemap.xml Sitemap: http://www.lcollect.com.au/Client/client_sitemap.xml Sitemap: http://www.lcollect.com.au/Debtor/debtor_sitemap.xml Sitemap: http://www.lcollect.com.au/mobile-sitemap.xml Sitemap: http://www.lcollect.com.au/News/blog_sitemap.xml