# robots.txt — FORM FILL # Crawl policy for formfill.in # # Everything public is open to crawlers. We only block areas that hold no # indexable content (accounts, admin panels, callbacks) so search engines # spend their budget on pages that can actually rank. User-agent: * Allow: / # ---------- No indexable content ---------- Disallow: /admin Disallow: /admin/ Disallow: /operator Disallow: /operator/ Disallow: /dashboard Disallow: /dashboard/ Disallow: /login Disallow: /register Disallow: /logout Disallow: /api Disallow: /api/ Disallow: /documents Disallow: /documents/ Disallow: /payment Disallow: /payment/ Disallow: /payn Disallow: /paytm # ---------- Session and tracking noise only ---------- # NOTE: pagination (?page=) is deliberately NOT blocked. /schemes, /services, # /articles and /jobs all paginate, and blocking it would hide several hundred # pages from search engines. Filter parameters are crawlable for the same # reason — the canonical link on those pages points at the clean URL. Disallow: /*?*_token= Disallow: /*?*utm_source= Disallow: /*?*utm_medium= Disallow: /*?*utm_campaign= Disallow: /*?*utm_term= Disallow: /*?*utm_content= Disallow: /*?*gclid= Disallow: /*?*fbclid= # ---------- Advertising crawlers ---------- User-agent: Mediapartners-Google Allow: / User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: Googlebot-Image Allow: / # ---------- Sitemap ---------- Sitemap: https://formfill.in/sitemap.xml