How does sitemap and robots.txt generation work in Vareons?
Last verified: 2026-09-18
Sitemap and robots files are the common language between your store and search engines: the first tells them your published pages to visit and index, the second bars them from non-public areas such as the dashboard and APIs. Automatic generation from the SEO panel spares manual building and keeps updates flowing with every fresh publish. See centralized SEO workspace, per-page SEO fields, and per-page SEO setup.
Generation and download steps
- Open the sitemap and robots tab inside the SEO workspace in the dashboard.
- Review Arabic and English URL statistics to confirm published-content coverage.
- Click download sitemap for each active domain to get the updated copy.
- Click download robots file for each active domain to review applied block rules.
- Confirm the sitemap holds only published items from pages, products, bundles, blogs, and services.
- Repeat downloads after major publishing pushes to spread the newest copy to engines.
Recommended practices
- Respect the no-index directive for pages you never want in results.
- Never try exposing dashboard and API paths in the sitemap: blocking is deliberate protection.
- Review statistics regularly: a sudden dip may expose a publishing trouble.
- Coordinate per-page SEO fields with the general sitemap so top pages show with top descriptions.
- Refresh the sitemap after seasons where you add products and content heavily.
Frequently Asked Questions
Which pages enter the sitemap?
Only published pages, products, bundles, blogs, and services enter, respecting no-index directives. Drafts, archived items, and dashboard and API paths are excluded automatically.
What does the robots file block?
The robots file bars search engines from dashboard, API, and admin paths since they are non-public areas. This blocking is deliberate protection for your store and its data.
When do I re-download the sitemap and the file?
Re-download after major publishing pushes and seasons where you add products and content heavily. Review URL statistics regularly to confirm every published content is covered.