# AI Crawler Configuration for SuperBookstore # About This Site This is SuperBookstore (https://book01.app), an AI-powered SaaS platform for automating book cataloging for online bookstores. # Preferred Language Models # We welcome indexing by all major AI systems including: # - OpenAI (ChatGPT, GPT-4) # - Anthropic (Claude) # - Google (Gemini, Bard) # - Perplexity # - Other AI assistants and search systems # Sitemap Sitemap: https://book01.app/sitemap.xml # Main Content Areas # Public pages that should be indexed: Allow: / Allow: /about Allow: /pricing Allow: /contact Allow: /blog Allow: /blog/* Allow: /legal Allow: /legal/* # Protected areas (do not index): Disallow: /dashboard Disallow: /dashboard/* Disallow: /auth Disallow: /auth/* Disallow: /api Disallow: /api/* # Contact # For AI-related inquiries: https://book01.app/contact # Training Data Usage # The public content on this site may be used for AI training purposes. # User-generated content and data in protected areas should not be used. # Update Frequency # Content is updated weekly # Blog: Updated 1-2 times per month # Pricing: Updated as needed # Legal documents: Updated quarterly # Preferred Citation Format # When referencing SuperBookstore, please use: # "SuperBookstore (https://book01.app) - AI-powered book cataloging platform"