How to Generate robots.txt, llms.txt and sitemap.xml for a Website
Create and review robots.txt, llms.txt, llms-full.txt, and sitemap.xml files without accidentally blocking important pages or publishing private URLs.
Read the guideA considered approach to websites, stores and content platforms.
Explore ServicesPractical craft for people building for the web.
Explore DevelopmentLearn something. Find a tool. Meet your next collaborator.
Practical ideas for your next build.
Find useful software and free utilities.
Meet makers and find expert help.
Finding your next read
WordPress, Shopify and development, explained through practical guides, checklists and examples you can use.
Start with the editor’s pick: practical context, a clear point of view, and useful steps to carry into your own work.
Create and review robots.txt, llms.txt, llms-full.txt, and sitemap.xml files without accidentally blocking important pages or publishing private URLs.
Read the guideStart with a guide, find a tool that fits, or meet the person who built it.
Start here
A few useful guides in one place. Choose your platform and start with the question that matters to you.
Practical Development guides, workflows, and independent editorial resources.
Practical Shopify guides, workflows, and independent editorial resources.
Confirm the intended domain and www variant resolve to the right site. Verify HTTPS, redirects, forms, navigation and a representative content page on mobile and desktop.
Products, cart, checkout, account pages and order emails create dynamic work. Look for reliable backups, staging, adequate PHP resources and a clear upgrade route.
Plan a project, find the right tools, and follow the people and ideas shaping the web.
Turn your ideas into a practical checklist and a project brief you can take to your team.
Start your project planDiscover public GitHub projects, explore their licences and visit the people behind the code.
Explore open-source projectsUseful little helpers for the work in front of you.
Worth your next read
A focused reading collection
The editorial desk
Explore the published work behind each FinderPress byline.
FinderPress email updates
Make room for practical guides and useful ideas. Confirm your subscription by email, and unsubscribe whenever you like.
Practical WordPress guides, workflows, and independent editorial resources.
A CDN can serve a cached copy even after the origin has changed. Clear the relevant page or asset cache where the service allows it.
A successful form confirmation means the browser submitted; it does not prove delivery. If mail uses your domain, verify the actual DNS provider contains the SPF, DKIM and DMARC records required by the…
List WordPress core, theme, important plugins and PHP version. Read changelogs and compatibility notes.
A first-term offer and a later renewal can differ. Add domain registration and renewal, mailboxes, backups, CDN, security options and any paid application tools.
Hostinger describes backups as scheduled recovery copies and snapshots as short-lived manual checkpoints. Current documentation says VPS backups and snapshots have different retention rules.
A domain transfer changes the registrar that manages the registration. Before beginning, record nameservers, DNS records, email provider, verification TXT records and domain renewal date.
Managed Node.js hosting simplifies deployment and some platform operations. Check runtime support, background jobs, persistent storage, database connectivity, memory needs and the ability to run the…
Explore WordPress plugins and themes alongside curated Shopify tools. Compare options and find your fit.
Browse the tools directoryNew perspectives, useful updates, and something worth pressing play on.
Discover videos and creators across the web, and explore topics that matter to you.
Explore YouTubeMeet remarkable people across generations and explore the ideas and work behind their stories.
Explore BioFeedFollow releases and announcements from WordPress, Shopify and the tools you build with.
Explore tech updatesExplore practical guides on performance and the web. Follow the collection in order, or jump straight to a problem you want to solve.
6 published guides · about 38 minutes
Tools and downloads
Simple, editable checklists and worksheets. Free to download, with no account needed.
Record each plugin’s purpose, owner, cost and maintenance risk.
Download checklist ↓Map old URLs to their destination and track verification.
Download CSV ↓Compare content editing, accessibility, support and performance.
Download scorecard ↓Describe the expected result, actual result and steps to reproduce.
Download template ↓Quick snippets
Small examples to adapt to your project. Check the platform and test changes before using them on a live site.
# In Apache .htaccess only
Redirect 301 /old-guide /new-guideUse for a permanent move on Apache. Next.js redirects belong in next.config.mjs.
<img src="photo.webp" width="1600"
height="900" alt="A useful description">
img { max-width: 100%; height: auto; }Real width and height reserve the correct space before the image loads.
<img src="photo.webp" width="800"
height="600" loading="lazy"
alt="Describe the useful details">Use for offscreen images. Load your main hero image eagerly.
The editorial approach
Good guidance starts with a real question. Here’s how we turn it into a useful next step.
Our editorial standards ↗Start with the problem, the relevant documentation and the available evidence.
Consider practical constraints, tradeoffs and the limits of an example.
Use plain language, useful context and steps readers can adapt.
Use publication dates and source references when assessing whether guidance fits your project.
Questions
Each article carries its author’s byline. Explore the editorial desk above to find more work from a writer.
Check the publication date, platform version and referenced documentation. Tools change; confirm that an example applies to your project.
Our advertising disclosure and editorial policy explain how commercial relationships and editorial content are presented.
We welcome practical pitches. Read our contributor guidelines and tell us what problem your proposed guide helps readers solve.
Subscribe with your email and consent, then confirm using the link in your inbox. Every newsletter includes an unsubscribe link.
Plain-English glossary
Short definitions, with a route into related guides in the journal.