User-agent: * Disallow: /api/ Disallow: /admin/ Disallow: /Modules* Disallow: /Bin/ Disallow: /*.config$ Disallow: /(A(* Disallow: /*/product* Disallow: /App_Data Disallow: /Controls