Robots Configuration
General Config
User Agent
*
Sitemap Path
Crawl Delay
10
Allowed Paths
Excluded Pages
Excluded Paths
Excluded Tags
Preview Config