[{"data":1,"prerenderedAt":533},["ShallowReactive",2],{"docs-\u002Fdocs\u002Ffaq":3,"docs-sib-\u002Fdocs\u002Ffaq":447,"docs-nav":507},{"id":4,"title":5,"body":6,"description":437,"extension":438,"meta":439,"navigation":440,"order":441,"path":442,"section":443,"seo":444,"stem":445,"__hash__":446},"docs\u002Fdocs\u002Ffaq.md","FAQ",{"type":7,"value":8,"toc":394},"minimark",[9,14,19,29,33,45,49,52,56,60,72,76,79,83,90,94,108,112,138,142,154,158,173,177,188,192,196,203,207,214,218,221,225,228,232,243,247,262,266,275,279,282,286,293,297,301,308,312,323,327,333,337,344,348,352,357,361,364,368,377,381],[10,11,13],"h2",{"id":12},"the-basics","The basics",[15,16,18],"h3",{"id":17},"is-crawlstat-really-free","Is CrawlStat really free?",[20,21,22,23,28],"p",{},"Yes. CrawlStat is free and open source under the MIT licence, and every feature is included: unlimited URLs, all 45 audits, UX Testing, crawl comparison, client reports and Competitor Intelligence. There's no time limit and you don't need an account. See ",[24,25,27],"a",{"href":26},"\u002Fdocs\u002Flicensing","Open source and licence",".",[15,30,32],{"id":31},"which-platforms-does-it-run-on","Which platforms does it run on?",[20,34,35,36,40,41,28],{},"macOS (11 or later, Apple Silicon and Intel), Windows 10 and 11 (64 bit), and Linux (x86_64, as an AppImage or ",[37,38,39],"code",{},".deb","). See ",[24,42,44],{"href":43},"\u002Fdocs\u002Finstalling","Installing",[15,46,48],{"id":47},"do-i-need-an-account","Do I need an account?",[20,50,51],{},"No. You download it and use it. There's no account, no sign in and no key.",[10,53,55],{"id":54},"crawling","Crawling",[15,57,59],{"id":58},"does-crawlstat-render-javascript","Does CrawlStat render JavaScript?",[20,61,62,63,67,68,28],{},"Yes, when you ask it to. By default CrawlStat reads the HTML your server sends, which is also what a search engine sees first, and that's fast. For sites built with React, Vue and the like, turn on ",[64,65,66],"strong",{},"Render JavaScript"," in the New crawl dialog: each page is run in the Chrome, Chromium, Edge or Brave you already have before CrawlStat reads it. It's several times slower. See ",[24,69,71],{"href":70},"\u002Fdocs\u002Fyour-first-crawl#render-javascript","Your first crawl",[15,73,75],{"id":74},"how-big-a-site-can-it-crawl","How big a site can it crawl?",[20,77,78],{},"Big ones. Crawl data is written to disk as it's collected rather than held in memory, so memory use stays roughly flat as a crawl grows. In our benchmark, a 50,000 URL crawl used about 128 MB of memory. On disk, expect roughly 2 KB per URL. In practice the limit is your patience and the site's server, not CrawlStat.",[15,80,82],{"id":81},"how-fast-is-it","How fast is it?",[20,84,85,86,89],{},"Mostly as fast as the site's server allows. With the defaults (5 simultaneous requests, no delay) expect tens of URLs per second from a typical site. A ",[37,87,88],{},"Crawl-delay"," in robots.txt, or a slow server, will make it slower. That's on purpose.",[15,91,93],{"id":92},"can-i-crawl-a-site-i-dont-own","Can I crawl a site I don't own?",[20,95,96,97,99,100,103,104,28],{},"Yes, and CrawlStat is built to do it politely. It respects robots.txt, honours ",[37,98,88],{},", identifies itself honestly as ",[37,101,102],{},"CrawlStatBot",", and keeps the number of simultaneous requests low by default. See ",[24,105,107],{"href":106},"\u002Fdocs\u002Fcrawler-and-robots","The crawler and robots.txt",[15,109,111],{"id":110},"can-i-crawl-just-part-of-a-site","Can I crawl just part of a site?",[20,113,114,115,118,119,122,123,126,127,130,131,134,135,28],{},"Yes. Use ",[64,116,117],{},"Only crawl URLs matching"," and ",[64,120,121],{},"Never crawl URLs matching"," under ",[64,124,125],{},"More options"," in the New crawl dialog, or set a ",[64,128,129],{},"Maximum depth",". To check a fixed set of pages, use ",[64,132,133],{},"List"," mode. See ",[24,136,71],{"href":137},"\u002Fdocs\u002Fyour-first-crawl",[15,139,141],{"id":140},"does-it-follow-nofollow-links-canonicals-and-hreflang","Does it follow nofollow links, canonicals and hreflang?",[20,143,144,145,148,149,153],{},"By default it doesn't follow ",[37,146,147],{},"rel=\"nofollow\""," links, which matches what search engines do. You can change this in ",[24,150,152],{"href":151},"\u002Fdocs\u002Fsettings","Settings",". It does add canonical and hreflang targets to the crawl, and reads sitemaps listed in robots.txt, so that pages only reachable that way are still checked.",[15,155,157],{"id":156},"does-it-measure-page-speed-or-core-web-vitals","Does it measure page speed or Core Web Vitals?",[20,159,160,161,164,165,169,170,172],{},"No. CrawlStat measures how long the server takes to respond, which is shown in the ",[64,162,163],{},"Time"," column and checked by the ",[24,166,168],{"href":167},"\u002Fdocs\u002Faudits\u002Fslow-server-response","slow server response"," audit. Even with ",[64,171,66],{}," on, the browser is only used to read the finished page, so rendering metrics like Core Web Vitals aren't measured.",[15,174,176],{"id":175},"can-i-pause-a-crawl-and-come-back-to-it-later","Can I pause a crawl and come back to it later?",[20,178,179,180,183,184,28],{},"Yes. Pause it from its live view, or stop it and later click ",[64,181,182],{},"Resume"," on the Projects screen. Even if CrawlStat quits unexpectedly, the crawl can be resumed where it left off. See ",[24,185,187],{"href":186},"\u002Fdocs\u002Fwatching-a-crawl","Watching a crawl",[10,189,191],{"id":190},"results-and-audits","Results and audits",[15,193,195],{"id":194},"what-does-crawlstat-check","What does CrawlStat check?",[20,197,198,199,28],{},"45 audits: 35 for SEO and 10 for accessibility. They cover broken links and pages, redirects, titles, descriptions, headings, canonicals, hreflang, indexing, duplicate content, images, mixed content and common accessibility problems. See ",[24,200,202],{"href":201},"\u002Fdocs\u002Fissues","Issues",[15,204,206],{"id":205},"if-i-update-crawlstat-do-my-old-crawls-benefit","If I update CrawlStat, do my old crawls benefit?",[20,208,209,210,213],{},"Yes. The audits are part of the app, not saved in your crawl files. Open an old crawl and click ",[64,211,212],{},"Rerun audits"," on its Issues tab to check it with the latest version of every audit.",[15,215,217],{"id":216},"why-isnt-a-pages-title-flagged-when-its-obviously-wrong","Why isn't a page's title flagged when it's obviously wrong?",[20,219,220],{},"Title, description and similar checks only apply to pages that can be indexed. If a page is noindex, redirects, returns an error or is canonicalised elsewhere, CrawlStat doesn't report problems with its title, because search engines won't show it anyway.",[15,222,224],{"id":223},"can-i-export-my-results","Can I export my results?",[20,226,227],{},"Yes. Every tab of the Pages table can be exported to CSV, respecting your current filter, as can the issue list and each issue's affected URLs. The plan's written report can be saved as Markdown. XLSX export is planned.",[15,229,231],{"id":230},"can-i-send-the-results-to-a-client","Can I send the results to a client?",[20,233,234,235,238,239,28],{},"Yes. ",[64,236,237],{},"Export a client report"," in a crawl's header makes a branded A4 PDF, or a single web page that holds everything, with your name on the cover and your colour throughout: the site's health, a ranked action plan, accessibility, every issue and, if you have an earlier crawl, progress since then. See ",[24,240,242],{"href":241},"\u002Fdocs\u002Fclient-reports","Client reports",[15,244,246],{"id":245},"can-i-compare-two-crawls","Can I compare two crawls?",[20,248,249,250,253,254,257,258,28],{},"Yes. Recrawl the site, then click ",[64,251,252],{},"Compare"," on the crawl, or ",[64,255,256],{},"Compare with previous crawl"," when the recrawl finishes. You'll see what was fixed, what's new, and which pages started failing. See ",[24,259,261],{"href":260},"\u002Fdocs\u002Fcomparing-crawls","Comparing crawls",[15,263,265],{"id":264},"can-i-compare-my-site-with-my-competitors","Can I compare my site with my competitors?",[20,267,234,268,271,272,28],{},[64,269,270],{},"Competitor Intelligence"," crawls your site and up to five competitors side by side, then shows the topics and questions they cover that you don't, a content plan, and how ready each site is for AI search. See ",[24,273,270],{"href":274},"\u002Fdocs\u002Fcompetitor-intelligence",[15,276,278],{"id":277},"can-i-extract-custom-data-from-pages","Can I extract custom data from pages?",[20,280,281],{},"Not yet. Custom extraction with CSS selectors, XPath and regular expressions is planned.",[15,283,285],{"id":284},"can-i-schedule-crawls","Can I schedule crawls?",[20,287,288,289,292],{},"Not yet. Scheduled crawls are planned. In the meantime, ",[64,290,291],{},"Recrawl"," on the Projects screen repeats a crawl with the same settings in one click. Competitor Intelligence can already recheck your competitors every month.",[10,294,296],{"id":295},"files-and-data","Files and data",[15,298,300],{"id":299},"is-my-crawl-data-uploaded-anywhere","Is my crawl data uploaded anywhere?",[20,302,303,304,28],{},"No. Crawls are stored as files on your computer and never leave it. The only network traffic is the crawl itself and update checks. See ",[24,305,307],{"href":306},"\u002Fdocs\u002Fprivacy-and-data","Privacy and your data",[15,309,311],{"id":310},"where-are-my-crawls-saved","Where are my crawls saved?",[20,313,314,315,318,319,28],{},"In the ",[37,316,317],{},"projects"," folder inside CrawlStat's application data folder. The path is shown on the Projects screen and in Settings. Each crawl is one file. See ",[24,320,322],{"href":321},"\u002Fdocs\u002Fprojects","Projects",[15,324,326],{"id":325},"can-i-change-where-crawls-and-exports-are-saved","Can I change where crawls and exports are saved?",[20,328,329,330,332],{},"Not from within the app at the moment. Settings shows both locations so you can find them. Crawls go to CrawlStat's ",[37,331,317],{}," folder and exports to your Downloads folder.",[15,334,336],{"id":335},"can-i-share-a-crawl-with-a-colleague","Can I share a crawl with a colleague?",[20,338,339,340,343],{},"You can copy the crawl's ",[37,341,342],{},".db"," file and send it, for example to archive it. CrawlStat itself lists the crawls it has run, and doesn't currently have a way to open a crawl file from elsewhere.",[10,345,347],{"id":346},"open-source","Open source",[15,349,351],{"id":350},"is-every-feature-really-free","Is every feature really free?",[20,353,354,355,28],{},"Yes. CrawlStat is open source under the MIT licence. There's no paid plan, no licence key and no URL limit. Every feature is included for everyone. See ",[24,356,27],{"href":26},[15,358,360],{"id":359},"can-i-use-it-for-client-work","Can I use it for client work?",[20,362,363],{},"Yes. The MIT licence allows commercial use, so you can use CrawlStat for paid work for your clients, and send them its reports.",[15,365,367],{"id":366},"where-is-the-code","Where is the code?",[20,369,370,371,28],{},"On GitHub, at ",[24,372,376],{"href":373,"rel":374},"https:\u002F\u002Fgithub.com\u002Fclotairedamy\u002FCrawlStat",[375],"nofollow","github.com\u002Fclotairedamy\u002FCrawlStat",[15,378,380],{"id":379},"how-can-i-help","How can I help?",[20,382,383,384,389,390,28],{},"Tell us about bugs and ideas by ",[24,385,388],{"href":386,"rel":387},"https:\u002F\u002Fgithub.com\u002Fclotairedamy\u002FCrawlStat\u002Fissues",[375],"opening an issue on GitHub",". If you'd like to help with code, docs or testing, see ",[24,391,393],{"href":392},"\u002Fcontribute","how to contribute",{"title":395,"searchDepth":396,"depth":396,"links":397},"",2,[398,404,414,425,431],{"id":12,"depth":396,"text":13,"children":399},[400,402,403],{"id":17,"depth":401,"text":18},3,{"id":31,"depth":401,"text":32},{"id":47,"depth":401,"text":48},{"id":54,"depth":396,"text":55,"children":405},[406,407,408,409,410,411,412,413],{"id":58,"depth":401,"text":59},{"id":74,"depth":401,"text":75},{"id":81,"depth":401,"text":82},{"id":92,"depth":401,"text":93},{"id":110,"depth":401,"text":111},{"id":140,"depth":401,"text":141},{"id":156,"depth":401,"text":157},{"id":175,"depth":401,"text":176},{"id":190,"depth":396,"text":191,"children":415},[416,417,418,419,420,421,422,423,424],{"id":194,"depth":401,"text":195},{"id":205,"depth":401,"text":206},{"id":216,"depth":401,"text":217},{"id":223,"depth":401,"text":224},{"id":230,"depth":401,"text":231},{"id":245,"depth":401,"text":246},{"id":264,"depth":401,"text":265},{"id":277,"depth":401,"text":278},{"id":284,"depth":401,"text":285},{"id":295,"depth":396,"text":296,"children":426},[427,428,429,430],{"id":299,"depth":401,"text":300},{"id":310,"depth":401,"text":311},{"id":325,"depth":401,"text":326},{"id":335,"depth":401,"text":336},{"id":346,"depth":396,"text":347,"children":432},[433,434,435,436],{"id":350,"depth":401,"text":351},{"id":359,"depth":401,"text":360},{"id":366,"depth":401,"text":367},{"id":379,"depth":401,"text":380},"Short answers to the questions people ask most about CrawlStat, including what it costs, what it crawls, JavaScript, client reports, competitors, where data goes, and what it doesn't do yet.","md",{},true,19,"\u002Fdocs\u002Ffaq","Help",{"title":5,"description":437},"docs\u002Ffaq","HHOVK9SH6ebUEomJ1YcenHC7ZLVjZYEaR-rctfqo1tQ",[448,450,453,457,459,460,462,466,468,472,476,478,482,484,486,488,492,494,496,498,502,506],{"title":242,"path":241,"order":449},null,{"title":451,"path":452,"order":449},"UX testing","\u002Fdocs\u002Fux-testing",{"title":454,"path":455,"order":456},"Getting started","\u002Fdocs\u002Fgetting-started",1,{"title":458,"path":43,"order":396},"Installing CrawlStat",{"title":71,"path":137,"order":401},{"title":187,"path":186,"order":461},4,{"title":463,"path":464,"order":465},"The Pages table","\u002Fdocs\u002Fresults-table",5,{"title":202,"path":201,"order":467},6,{"title":469,"path":470,"order":471},"The plan","\u002Fdocs\u002Fthe-plan",7,{"title":473,"path":474,"order":475},"Journeys","\u002Fdocs\u002Fjourneys",8,{"title":270,"path":274,"order":477},8.7,{"title":479,"path":480,"order":481},"Accessibility","\u002Fdocs\u002Faccessibility",9,{"title":261,"path":260,"order":483},10,{"title":322,"path":321,"order":485},11,{"title":152,"path":151,"order":487},12,{"title":489,"path":490,"order":491},"Keyboard shortcuts","\u002Fdocs\u002Fkeyboard-shortcuts",13,{"title":27,"path":26,"order":493},14,{"title":307,"path":306,"order":495},15,{"title":107,"path":106,"order":497},16,{"title":499,"path":500,"order":501},"Local AI","\u002Fdocs\u002Flocal-ai",17,{"title":503,"path":504,"order":505},"Troubleshooting","\u002Fdocs\u002Ftroubleshooting",18,{"title":5,"path":442,"order":441},[508,509,510,512,513,514,516,517,518,519,520,521,522,523,524,525,526,528,529,530,531,532],{"title":242,"path":241,"section":449,"order":449},{"title":451,"path":452,"section":449,"order":449},{"title":454,"path":455,"section":511,"order":456},"Start here",{"title":458,"path":43,"section":511,"order":396},{"title":71,"path":137,"section":511,"order":401},{"title":187,"path":186,"section":515,"order":461},"Using CrawlStat",{"title":463,"path":464,"section":515,"order":465},{"title":202,"path":201,"section":515,"order":467},{"title":469,"path":470,"section":515,"order":471},{"title":473,"path":474,"section":515,"order":475},{"title":270,"path":274,"section":515,"order":477},{"title":479,"path":480,"section":515,"order":481},{"title":261,"path":260,"section":515,"order":483},{"title":322,"path":321,"section":515,"order":485},{"title":152,"path":151,"section":515,"order":487},{"title":489,"path":490,"section":515,"order":491},{"title":27,"path":26,"section":527,"order":493},"Account & data",{"title":307,"path":306,"section":527,"order":495},{"title":107,"path":106,"section":527,"order":497},{"title":499,"path":500,"section":527,"order":501},{"title":503,"path":504,"section":443,"order":505},{"title":5,"path":442,"section":443,"order":441},1793827598271]