Evaluación y Análisis

# If the Joomla site is installed within a folder 
# eg www.example.com/joomla/ then the robots.txt file 
# MUST be moved to the site root 
# eg www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to all of the
# paths. 
# eg the Disallow rule for the /administrator/ folder MUST 
# be changed to read 
# Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/orig.html
#
# For syntax checking, see:
# http://tool.motoricerca.info/robots-checker.phtml
User-agent: *
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/

La clasificación global de Semrush para canonicalrobots.com es 9,721,083 . canonicalrobots.com tiene un valor estimado de US$1,088,799 según los ingresos publicitarios estimados. canonicalrobots.com es accedido por aproximadamente 125,631 usuarios únicos cada día. Su servidor web está ubicado en United States y tiene una dirección IP de 35.214.10.224. SiteAdvisor dice que es seguro acceder a canonicalrobots.com.

HTTP/1.1 301 Moved Permanently
Server: nginx
Date: Sat, 30 Oct 2021 21:54:58 GMT
Content-Type: text/html
Content-Length: 162
Connection: keep-alive
Location: https://canonicalrobots.com/
Host-Header: 8441280b0c35cbc1147f8ba998a563a7
X-HTTPS-Enforce: 1
X-Proxy-Cache-Info: DT:1

HTTP/2 301 
server: nginx
date: Sat, 30 Oct 2021 21:54:58 GMT
content-type: text/html; charset=utf-8
location: https://www.canonicalrobots.com/es/
pragma: no-cache
expires: Wed, 17 Aug 2005 00:00:00 GMT
cache-control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0
set-cookie: 231aecf4d7e5e96e1ad410dd8c9a0729=95807564d9b946e9a763c740eeb06c0f; path=/; HttpOnly
x-content-type-options: nosniff
last-modified: Sat, 30 Oct 2021 21:54:58 GMT
x-httpd: 1
host-header: 8441280b0c35cbc1147f8ba998a563a7
x-proxy-cache-info: DT:1

HTTP/2 200 
date: Sat, 30 Oct 2021 21:54:59 GMT
content-type: text/html; charset=utf-8
vary: Accept-Encoding
permissions-policy: interest-cohort=()
expires: Wed, 17 Aug 2005 00:00:00 GMT
cache-control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
pragma: no-cache
set-cookie: 231aecf4d7e5e96e1ad410dd8c9a0729=6b5144630f1543754481ed5cdfdc41d8; path=/; HttpOnly
x-content-type-options: nosniff
last-modified: Sat, 30 Oct 2021 21:54:59 GMT
x-httpd: 1
host-header: 8441280b0c35cbc1147f8ba998a563a7
x-proxy-cache-info: DT:1
cf-cache-status: DYNAMIC
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=O0rPtzCI55cqSM2nO6m2voVHJS6e972YxWZJSHD64aRNyl%2FLH9mHdOZTnRxm5xMNW8Sjukezf%2BE8weyAUjrXyls1wFja98OrSdOFtd%2FD9zplwdQMv8am5LNfTKbAiQ73Au14wMoivwwGvA%3D%3D"}],"group":"cf-nel","max_age":604800}
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
cf-ray: 6a67e29f8aa0fdd5-ORD
alt-svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400, h3-28=":443"; ma=86400, h3-27=":443"; ma=86400

Domain Name: CANONICALROBOTS.COM
Registry Domain ID: 2156399456_DOMAIN_COM-VRSN
Registrar WHOIS Server: whois.cdmon.com
Registrar URL: http://www.cdmon.com
Updated Date: 2021-08-19T08:28:10Z
Creation Date: 2017-08-24T05:58:56Z
Registry Expiry Date: 2022-08-24T05:58:56Z
Registrar: 10dencehispahard, S.L.
Registrar IANA ID: 1403
Domain Status: ok https://icann.org/epp#ok
Name Server: NS1.UK13.SITEGROUND.EU
Name Server: NS2.UK13.SITEGROUND.EU
DNSSEC: unsigned
>>> Last update of whois database: 2021-09-18T08:09:09Z <<<