# Disallow all crawlers access to certain pages. User-agent: * Disallow: /admin Disallow: /common Disallow: /contacts Disallow: /framescontacts Disallow: /email # Disallow: /images Disallow: /homefinder Disallow: /frameshomefinder Disallow: /messages Disallow: /framespages Disallow: /framespropertysearch Disallow: /reports Disallow: /scripts Disallow: /w3c Disallow: /custom Disallow: /forms Disallow: /include Disallow: /listings Disallow: /listing Disallow: /seller Disallow: /TalonRealEstateWeb Disallow: /TalonRealEstateWeb/agents Disallow: /TalonRealEstateWeb/common Disallow: /TalonRealEstateWeb/commom Disallow: /TalonRealEstateWeb/propertysearch Disallow: /TalonRealEstateWeb/scripts Disallow: /TalonRealEstateWeb/scripts/propertysearch