Bisteinoff SEO Robots.txt
Explore this tool and check the official listing for its latest features and requirements.
About this tool.
Have you encountered an obstacle while creating and editing robots.txt file on your website?
Bisteinoff SEO Robots.txt is an easy-to-use plugin that helps you generate and configure a correct robots.txt file, which is essential for search engine optimization (SEO). This file defines crawling rules for search engine bots such as Google, Bing, Yahoo!, Yandex, and others.
The plugin works perfectly both if the file robots.txt has never been created or if it already exists. Once installed the plugin makes an optimized robots.txt file that includes special rules common for WordPress websites. After that you can proceed further customization specific for your own website if needed.
If the plugin detects one or several Sitemap XML files it will include them into robots.txt file.
No FTP access, manual coding or file editing is required that makes managing settings easy and convenient!
Key Features
- Automatic generation of optimized robots.txt with WordPress-specific rules
- Special rules for Google and Yandex search engines
- Custom rules support for any search engine bot
- Automatic sitemap detection and inclusion
- WooCommerce compatibility with specific rules
- Multisite support
- Easy-to-use admin interface
- Modern PHP architecture with namespaces for conflict-free operation
Getting started.
- 01Upload db-robotstxt folder to the /wp-content/plugins/ directory
- 02Activate the plugin through the ‘Plugins’ menu in WordPress
- 03The plugin will automatically create a virtual robots.txt file
- 04Go to Settings > SEO Robots.txt to customize rules
Frequently asked questions.
Will it conflict with any existing robots.txt file?
No, it will not. If the file robots.txt is found in the root folder it will not be overridden. On the Settings page you will see a notification with two options: rename or delete the existing file robots.txt. The plugin provides this functionality directly in the admin interface.