Broken link checker and site crawl

Broken links frustrate visitors and waste the time search engines spend crawling your site, and duplicate titles make pages hard to tell apart. This test collects pages from the internal links on the page you enter and from your XML sitemap, crawls up to 20 of them and tests up to 120 more internal links found on them. It reports error pages, redirects, missing or duplicate titles, descriptions and H1s, thin pages and slow server responses.

Runs only this test. Want everything? Run all 18 tests from the home page.

What this test checks

Broken internal links

Links to pages on your site that return a 4xx or 5xx error or do not respond, with the pages that link to each one.

Page status and redirects

Whether each crawled page returns 200, an error, or a redirect that your internal links should skip.

Titles across pages

Pages without a title tag, and groups of pages that share the same title.

Meta descriptions across pages

Pages without a meta description, and pages that repeat the same one, a common template problem.

H1 on every page

Crawled pages that have no H1 heading.

noindex pages

Pages kept out of search results by a robots meta tag or X-Robots-Tag header, listed so you can confirm that is intentional, and flagged when your sitemap lists them anyway.

Thin pages

Indexable pages with fewer than 200 characters of body text in their HTML.

Response time per page

Average server response time across the crawled pages, and any page that takes longer than 1.5 seconds.

Sample result

A real result for devteam.co.kr, tested 17 hours ago.

Site crawl & broken links

Pages checked: 20, internal links checked: 119. Errors: 2, broken links: 2.

72/100C
Page response status (Problem)
Pages returning an error (4xx/5xx): 2.
18/20 OK
Target: All pages return 200
How to fixRestore error pages or 301-redirect them to a relevant page, and update internal links to point to final URLs.
Errors
  • https://www.devteam.co.kr/global · Connection failed
  • https://www.devteam.co.kr/emergency · Connection failed
Per-page title (Good)
Every page has a unique title.
All unique
Target: Unique on every page
How we test this →
Per-page meta description (Good)
Every page has a unique meta description.
All unique
Target: Unique on every page
How we test this →
Per-page H1 (Good)
Every page has an H1.
All present
Target: One H1 on every page
How we test this →
noindex pages (Good)
None of the crawled pages block indexing.
0
Target: Only indexable pages in the sitemap
How we test this →
Thin-content pages (Good)
No pages with thin content.
0
Target: At least 200 characters of body text per page
How we test this →
18Html
20Pages
2Broken
119Links checked
Crawled pages (20)
URLStatusTitleTextTTFB
https://www.devteam.co.kr/mvp 200 MVP 개발 — 스타트업·정부지원사업 MVP 외주 개발 | DevTeam Ko… 3,585 842 ms
https://www.devteam.co.kr/mvp/government 200 정부지원사업 MVP 개발 — 예비·초기창업패키지 외주 개발 | Dev… 2,652 364 ms
https://www.devteam.co.kr/flutter 200 Flutter 앱 개발 — iOS·Android 앱 외주 개발, 관리자·서버까지… 2,914 1.1 s
https://www.devteam.co.kr/electron 200 Electron 데스크톱 앱 개발 — Windows·macOS 설치형 프로그램 |… 2,457 372 ms
https://www.devteam.co.kr/global error – – 0 ms
https://www.devteam.co.kr/ai 200 AI 연동 개발 — GPT·Claude·Gemini API로 AI 기능·업무 자동화 … 3,241 1.14 s
https://www.devteam.co.kr/ai/enterprise 200 사내 AI 도입 — 보안·통제가 되는 기업용 AI 포털 구축 | DevTe… 2,655 791 ms
https://www.devteam.co.kr/integration 200 ERP·그룹웨어·WMS 연동과 사내 시스템 개발 | DevTeam Korea 2,976 350 ms
https://www.devteam.co.kr/emergency error – – 0 ms
https://www.devteam.co.kr/completion 200 AI 코드 완성 — 바이브 코딩으로 만든 서비스를 오류 수정·보안… 2,496 252 ms
https://www.devteam.co.kr/audit 200 웹사이트 성능·보안 진단 — 속도·보안·접근성·SEO 16가지 종합 … 2,291 788 ms
https://www.devteam.co.kr/seo 200 SEO·GEO 최적화 — 구글·네이버 검색과 AI 답변 노출 전략 | Dev… 2,748 238 ms
https://www.devteam.co.kr/portfolio 200 성공 사례 — MVP·AI·앱·시스템 연동 개발 포트폴리오 | DevTeam… 6,255 250 ms
https://www.devteam.co.kr/article 200 개발 인사이트 — AI API·백엔드·아키텍처 실무 가이드 | DevTea… 2,682 236 ms
https://www.devteam.co.kr/blog 200 운영·보안 가이드 — 502·500 에러, SSL 인증서, 서버 보안 해결… 2,421 230 ms
https://www.devteam.co.kr/about 200 회사 소개 — 주식회사 뎁팀 (DevTeam Korea) 2,269 243 ms
https://www.devteam.co.kr/request 200 무료 상담·견적 신청 — 1영업일 내 회신 | DevTeam Korea 1,625 250 ms
https://www.devteam.co.kr/article/120/ai-cost-optimization-b... 200 AI 비용 최적화 가이드: 배치 처리·토큰 카운팅·모델 선택(Opus… 10,325 234 ms
https://www.devteam.co.kr/article/119/ai-production-error-ha... 200 프로덕션 AI API 에러 처리·재시도·레이트리밋·폴백 전략 — Cla… 14,428 387 ms
https://www.devteam.co.kr/article/118/ai-vision-image-unders... 200 AI 비전 API 완벽 가이드: 이미지 분석·문서 추출·구조화 출력 … 10,789 260 ms

How it works

  1. Our test server in Virginia, USA, reads the URL you enter and collects links to other pages on the same host, then adds a spread of URLs from your XML sitemap, skipping nofollow links, files and paths such as /admin, /login, /cart and /checkout.
  2. Up to 20 of those pages are fetched, 6 at a time, as WebPSQCBot/3.0 with a 15-second timeout and up to 5 redirects each.
  3. Up to 120 more internal link targets found on the crawled pages are then requested to confirm they respond; external links, images and PDFs are not checked.
  4. Pages are read as delivered, without running JavaScript, and every request goes only to public IP addresses on ports 80 and 443.
  5. A crawl usually takes about 45 seconds.

How it is scored

The score uses our item-weighted formula: a pass earns full credit, a warning half and a fail none. Page status and broken links count 3×; titles, descriptions, H1s and noindex pages 2×; thin pages and response time 1×. Pages set to noindex are listed for review and lower the score only when your sitemap also lists them.

CheckGoodNeeds workPoor
Broken internal linksNone1–34 or more
Crawled pagesAll return 200Some redirectAny 4xx/5xx or no response
Pages with a missing or duplicate titleNoneUp to 30%Over 30%
Pages with a missing or duplicate descriptionNoneUp to 30%Over 30%
Pages without an H1NoneUp to 30%Over 30%
noindex pages listed in the sitemapNone—Any
Thin pages (under 200 characters of text)NoneAny—
Server response across pagesAverage 0.8 s or less, none over 1.5 sSlower—

Grades: A+ 95–100 · A 90–94 · B 80–89 · C 70–79 · D 60–69 · F below 60.

FAQ

How do I find broken links on my website?
Enter your homepage URL and run this test. It crawls up to 20 pages linked from it, checks up to 120 more internal links found on those pages, and lists every link that returns an error together with the pages that contain it. For a complete picture of a large site, also review the Page indexing report in Google Search Console.
Do broken links hurt SEO?
A few broken links will not sink your rankings, but they send visitors to dead ends, waste crawl time and keep link value from reaching the pages that need it. Fix internal links that point to deleted pages, and 301-redirect removed pages that still receive links from other sites.
Why are duplicate titles and descriptions a problem?
When many pages share one title or description, search engines struggle to tell them apart and searchers cannot see which result fits. It usually means a template outputs the same tags on every page. This test warns when up to 30% of crawled pages are affected and fails above that.
Does this test check external links?
No. It checks links to pages on your own site, where you control the fix; links to other domains and subdomains, images and PDF files are skipped. Links to your site's www or non-www version count as internal.
Why does the crawl stop at 20 pages?
The crawl is sized to finish in under a minute while still covering your main navigation. Pages are taken from the links on the URL you enter first and then from your sitemap, so start from the homepage, or from a section page to focus on that part of the site.