Crawler.ninja valuation and analysis
Robots.txt Information
| Robot | Path | Permission |
| GoogleBot | / | ✔ |
| BingBot | / | ✔ |
| BaiduSpider | / | ✔ |
| YandexBot | / | ✔ |
Meta Tags
| Title | Crawler.Ninja |
| Description | Alexa Top 1 Million crawl data from Scott Helme |
| Keywords | Alexa Top 1 Million Crawl HTTPS CSP HPKP HSTS XCTO XXP FP RP |
Server Information
| WebSite | |
| Host IP | 104.28.26.33 |
| Location | United States |
Related Websites
| Site | Rank |
| torusage-imc2018.github.io | #4,274,567 |
| websitelist.in | #71,872 |
| websitelists.in | #59,873 |
| hitfront.com | #223,080 |
| planetsun.org | #1,265,150 |
More to Explore
| credit.org |
| cronza.com |
| cropti.com |
| ct21.com.au |
| ctas.co.nz |
| ctv-shop.ru |
| cubatesoro.com |
| customcontainerliving.com |
| cwbcareers.com |
| daanimlm.com |
| mirasee.com |
| mitalom.com |
Crawler.ninja Valuation
|
US$40,036
Last updated: Dec 5, 2019
Crawler.ninja has global traffic rank of 431,207 and ranks the 168,179th in India. Its global rank has gone up by 537,703 positions since 3 months ago. Crawler.ninja has an estimated worth of US$ 40,036, based on its estimated Ads revenue. Crawler.ninja receives approximately 7,312 unique visitors each day. Its web server is located in United States, with IP address 104.28.26.33. According to SiteAdvisor, crawler.ninja is safe to visit. |
Traffic & Worth Estimates
| Purchase/Sale Value | US$40,036 |
| Daily Ads Revenue | US$21 |
| Monthly Ads Revenue | US$658 |
| Yearly Ads Revenue | US$8,007 |
| Daily Unique Visitors | 7,312 |
| Note: All traffic and earnings values are estimates. | |
Traffic Ranks
| Global Rank | 431,207 |
| Delta (90 Days) | ⬆️ 537,703 |
| Most Popular In Country | India |
| Country Rank | 168,179 |
DNS Records
| Host | Type | TTL | Data |
| crawler.ninja | A | 299 | IP: 104.28.26.33 |
| crawler.ninja | A | 299 | IP: 104.28.27.33 |
| crawler.ninja | AAAA | 299 | IPv6: 2606:4700:30:0:0:0:681c:1b21 |
| crawler.ninja | AAAA | 299 | IPv6: 2606:4700:30:0:0:0:681c:1a21 |
| crawler.ninja | MX | 299 | Priority: 20 Target: in2-smtp.messagingengine.com. |
| crawler.ninja | MX | 299 | Priority: 10 Target: in1-smtp.messagingengine.com. |
| crawler.ninja | NS | 21599 | Target: sid.ns.cloudflare.com. |
| crawler.ninja | NS | 21599 | Target: karina.ns.cloudflare.com. |
| crawler.ninja | TXT | 299 | TXT: v=spf1 include:spf.messagingengine.com ?all |
| crawler.ninja | SOA | 3599 | MNAME: karina.ns.cloudflare.com. RNAME: dns.cloudflare.com. Serial: 2031155367 Refresh: 10000 Retry: 2400 Expire: 604800 Minimum TTL: 3600 |
HTTP Headers
HTTP/1.1 301 Moved Permanently Date: Thu, 05 Dec 2019 13:55:45 GMT Transfer-Encoding: chunked Connection: keep-alive Cache-Control: max-age=3600 Expires: Thu, 05 Dec 2019 14:55:45 GMT Location: https://crawler.ninja/ Server: cloudflare CF-RAY: 540684feb8a99533-NRT HTTP/2 200 date: Thu, 05 Dec 2019 13:55:47 GMT content-type: text/html set-cookie: __cfduid=ddef4075de4009324d5fc7256a60a51b61575554147; expires=Sat, 04-Jan-20 13:55:47 GMT; path=/; domain=.crawler.ninja; HttpOnly; Secure last-modified: Mon, 11 Mar 2019 09:46:43 GMT strict-transport-security: max-age=31536000; includeSubDomains; preload content-security-policy: upgrade-insecure-requests x-frame-options: DENY x-xss-protection: 1; mode=block x-content-type-options: nosniff referrer-policy: no-referrer feature-policy: accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none' cache-control: max-age=7200 cf-cache-status: HIT expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct" server: cloudflare cf-ray: 5406850eaf7ba570-NRT |
Crawler.ninja Whois Information
Domain Name: crawler.ninja Registry Domain ID: ed8b2fdae89a4b1aa9bc7fbb827ab6d9-DONUTS Registrar WHOIS Server: http://whois.cloudflare.com Registrar URL: http://cloudflare.com Updated Date: 2018-12-17T20:25:22Z Creation Date: 2018-07-19T10:43:10Z Registry Expiry Date: 2020-07-19T10:43:10Z Registrar: Cloudflare, Inc Registrar IANA ID: 1910 Registrar Abuse Contact Email: registrar-abuse@cloudflare.com Registrar Abuse Contact Phone: +1.4153195717 Domain Status: clientTransferProhibited https://icann.org/epp#clientTransferProhibited Registry Registrant ID: REDACTED FOR PRIVACY Registrant Name: REDACTED FOR PRIVACY Registrant Organization: DATA REDACTED Registrant Street: REDACTED FOR PRIVACY Registrant City: REDACTED FOR PRIVACY Registrant State/Province: DATA REDACTED Registrant Postal Code: REDACTED FOR PRIVACY Registrant Country: US Registrant Phone: REDACTED FOR PRIVACY Registrant Phone Ext: REDACTED FOR PRIVACY Registrant Fax: REDACTED FOR PRIVACY Registrant Fax Ext: REDACTED FOR PRIVACY Registry Admin ID: REDACTED FOR PRIVACY Admin Name: REDACTED FOR PRIVACY Admin Organization: REDACTED FOR PRIVACY Admin Street: REDACTED FOR PRIVACY Admin City: REDACTED FOR PRIVACY Admin State/Province: REDACTED FOR PRIVACY Admin Postal Code: REDACTED FOR PRIVACY Admin Country: REDACTED FOR PRIVACY Admin Phone: REDACTED FOR PRIVACY Admin Phone Ext: REDACTED FOR PRIVACY Admin Fax: REDACTED FOR PRIVACY Admin Fax Ext: REDACTED FOR PRIVACY Admin Email: Please query the RDDS service of the Registrar of Record identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. Registry Tech ID: REDACTED FOR PRIVACY Tech Name: REDACTED FOR PRIVACY Tech Organization: REDACTED FOR PRIVACY Tech Street: REDACTED FOR PRIVACY Tech City: REDACTED FOR PRIVACY Tech State/Province: REDACTED FOR PRIVACY Tech Postal Code: REDACTED FOR PRIVACY Tech Country: REDACTED FOR PRIVACY Tech Phone: REDACTED FOR PRIVACY Tech Phone Ext: REDACTED FOR PRIVACY Tech Fax: REDACTED FOR PRIVACY Tech Fax Ext: REDACTED FOR PRIVACY Tech Email: Please query the RDDS service of the Registrar of Record identified in this output for information on how to contact the Registrant, Admin, or Tech contact of the queried domain name. Name Server: sid.ns.cloudflare.com Name Server: karina.ns.cloudflare.com DNSSEC: unsigned URL of the ICANN Whois Inaccuracy Complaint Form: https://www.icann.org/wicf/ |