robots.txt downloads
WebSite Auditor Professional
4.58.6 download... your site; -Find resources restricted from indexing (in robots.txt, by Noindex meta tag or Noindex X-Robots tag); ... in one place; -An XML Sitemap editor; -A robots.txt generator; -A reporting module; -A Domain Strength table ...
SEO PowerSuite Enterprise
99.6 download... site (detecting broken links, duplicate content, 404 pages, robots.txt issues, etc.); - Effortlessly optimize your site's content ... - Generate an XML sitemap and edit your robots.txt file; - Automate your hreflang audit and generate ...
LinkAssistant Professional
6.47.6 download... nofollow links, links restricted from indexing with a robots.txt file; or links with wrong anchors; - Set up automated tasks to update the status of each link and get immediate ...
SEO PowerSuite
99.6 download... you can generate an XML sitemap, edit your robots.txt file, make hreflang audit and even automate hreflang generation. 2. SEO SpyGlass lets you analyze backlinks to any website and monitor ...
WebSite Auditor Enterprise
4.58.6 download... Auditor will help you create or edit your robots.txt file and an XML sitemap and let you upload them via FTP. Need reports to show off your SEO work to ...
Visual SEO Studio
2.5.3.1 download... and see where the fold lays, visually edit robots.txt and XML Sitemaps files, Export to native Excel format... With in depth SEO / HTML / URL reports no other SEO ...
Visual SEO Studio for Mac
2.5.3.1 download... and see where the fold lays, visually edit robots.txt and XML Sitemaps files, Export to native Excel format... With in depth SEO / HTML / URL reports no other SEO ...
A1 Sitemap Generator for Mac
11.0.0 download... of simultaneous connections to use. Supports crawler filters, robots.txt, custom connection and read timeout values, removal of session IDs, scanning of javascript and css files, proxy setup, website login, and ...
A1 Sitemap Generator
11.0.0 download... of simultaneous connections to use. Supports crawler filters, robots.txt, custom connection and read timeout values, removal of session IDs, scanning of javascript and css files, proxy setup, website login, and ...
SiteAnalyzer
2.0.2.206 downloadSiteAnalyzer it is a web crawler to scan the websites and check their technical and of SEO-parameters for errors and correct them effectively. Key features of the SiteAnalyzer - Scanning of ...
LinkChecker for Mac OS X
9.3 download... authorization for HTTP and FTP and Telnet honors robots.txt exclusion protocol Cookie support HTML and CSS syntax check Antivirus check Different interfaces: command line, GUI and web interface ...
LinkChecker Portable
8.2 download... authorization for HTTP and FTP and Telnet honors robots.txt exclusion protocol Cookie support HTML and CSS syntax check Antivirus check Different interfaces: command line, GUI and web interface ...
openElement
1.57.9 downloadopenElement is a complete web authoring solution for creative professionals. Free: openElement is available free, with no ads or restrictions, so you can take full advantage of its powerful features. More ...
C# Web Scraping Library
4.0.4.2 download... an appropriate pace. In addition, it can obey robots.txt directives including bot specific crawl rates and limitation. The exact urls and content types to be strapped can be set using ...
Sitemap Writer Pro
5.4.7 download... the unique URL/part of site) 8. Importation of robots.txt file disallow content to exclude list 9. Very quick Search through sitemaps with 3.000.000 items 10. Generate URL by name (mainly ...
LinkChecker for Linux
9.3 download... authorization for HTTP and FTP and Telnet honors robots.txt exclusion protocol Cookie support HTML and CSS syntax check Antivirus check Different interfaces: command line, GUI and web interface ...
LinkChecker
9.3 download... authorization for HTTP and FTP and Telnet honors robots.txt exclusion protocol Cookie support HTML and CSS syntax check Antivirus check Different interfaces: command line, GUI and web interface ...
Convert Email Addresses To Images Software
7.0 downloadThis software offers a solution to users who want to convert one or more e-mails into JPG or PNG files. The user adds individual e-mail addresses or loads a batch from ...
SEOLExA
1.0 downloadSEOLExA is a Java Programm that checks a list of link exchanges for SEO value. It will read the file seolexainput.txt where the link exchanges are listed. This seolexainput.txt lists in ...
Text To Image Converter Software
7.0 downloadThis software offers a solution to users who want to convert one or more text files into images. The user chooses the file/s or an entire folder to be processed and ...
RoboGen ROBOTS.TXT Editor
1.52 download... the user to quickly and easily create the ROBOTS.TXT files required to instruct web search engines which parts of a web site are not to be indexed and made searchable ...