Full URL of website home page:

Pages to be crawled

How many pages of your website do you want crawled?

Up to 500 Up to 1,000

Advanced Options

Mark spelling errors in document
Limit internal pages crawled to subdomain
Allow use of cookies while crawling



User-Agent Switcher

Select UserAgent Google Bot Google Mobile Bot Chrome Firefox IE



Mark on Export
Not Contain Contains +

Not Contain Contains +

Not Contain Contains +

Not Contain Contains +

Not Contain Contains

Crawler Limitations
Not Contain Contains +

Not Contain Contains +

Not Contain Contains +

Not Contain Contains +

Not Contain Contains

If you own the domain you are trying to spider, you can spider unlimited number of urls by making a change to your robots.txt file. Simply add the following two lines.

User-agent: NinjaBot
Allow: /

This tool can take up to 30 minutes to spider through 1,000 URLs, and even longer for more. If you would like to have the results emailed to you, type your email address below:

Your privacy is important to us. We will never share your information with third parties.

If you would like to prevent this free tool from crawling your website, please add the following lines to your robots.txt file:

User-agent:NinjaBot
Disallow: /

Note that the results table data of the online sitemap generator is interactive. Most of the data items are linked, either to the URLs referenced or to details about the data. For most cells that contain non-URL data, pause the mouse over the cell to see the full results.

---

Results Bar

When the tool starts, a results bar appears at the top of the page showing the following information:

Lastly, if you love the free sitemap generator tool, you can tell the world by clicking any of the following social media buttons:

---

Email notification

Next, you can submit your email address to have a copy of the report emailed to you if you choose not to wait for it to finish crawling. We offer this feature as well as the sitemap generator free to all users.

---

Tool results data

When results are ready, the HTML sitemap generator will organize the data into six tables:

The table data is typically linked to either page URLs or to details about the data. Click on column headers to sort the results.

---

1 Internal Links table

The Internal links table created by the XML sitemap generator includes the following data fields:

• URLs crawled on the site
• Link to The On Page Optimization Analysis Free SEO Tool for that URL
• URL’s level from the domain root
• URL’s returned HTTP status code
• Number of internal links the URL has within the site (click to see the list of URLs)
• Link text used for the URL
• Number of internal links on the page (click to see the list of URLs)
• Number of external links on the page (click to see the list of URLs)
• Size of the page on kilobytes (click to see page load speed test results for this URL from Google)
• Link to the Check Image Sizes, Alt Text, Header Checks and More Free SEO Tool for that URL
• The tag text from the URL’s page
• The description tag text from the URL’s page
• The keywords tag text from the URL’s page
• Contents, if used, of the anchor tag’s “rel=” attribute

---

2 External Links table

The External links table includes the following data fields:

• URL’s returned HTTP status code
• Number of times that URL is linked to from within the site (click to see the list of affected URLs)
• External URL used in the link
• Link text used for the URL
• Internal page URL on which the link was first found

---

3 Internal HTTP code errors table

The Internal errors table gathers all of the pages returning HTTP code errors (4xx and 5xx level codes) in one place to help organize the effort to resolve the problems. It includes the following data fields:

• URL’s returned HTTP status code
• Number of times that URL is linked to from within the site (click to see the list of affected URLs)
• Internal URL used in the link
• Link text used for the URL
• Internal page URL on which the link was first found

The Internal errors table is a subset of the Internal links table showing just those pages returning HTTP status code errors.

---

4 Internal HTTP redirects table

The Internal redirects table combines all of the pages returning HTTP redirects in one list so you can easily review them. You should not have to rely on redirects internally. Instead, you can fix the source code containing the redirected link. This table contains the following data fields:

• URL’s returned HTTP status code (click it to go to the HTTP Response Code Checker tool)
• Number of times that URL is linked to from within the site (click to see the list of affected URLs)
• Internal URL used in the link
• Link text used for the URL
• Redirect’s target URL
• Internal page URL on which the link was first found

The Internal redirects table is a subset of the Internal links table showing just those pages returning 301 and 302 HTTP status code redirects.

---

5 External HTTP code errors table

The External errors table gathers all of the pages returning HTTP code errors (4xx and 5xx level codes) in one place to help organize the effort to resolve the problems. It includes the following data fields:

• URL’s returned HTTP status code (click it to go to the HTTP Response Code Checker tool)
• Number of times that URL is linked to from within the site (click to see the list of affected URLs)
• Internal URL used in the link
• Link text used for the URL
• Redirect’s target URL
• Internal page URL on which the link was first found

The External errors table is a subset of the External links table showing just those pages returning HTTP status code errors.

---

6 External HTTP redirects table

The External redirects table combines all of the pages returning HTTP redirects in one list so you can easily review them. As the redirect to the targeted page does not affect your page, fix these URLs is a lower priority. This table contains the following data fields:

• URL’s returned HTTP status code (click it to go to the HTTP Response Code Checker tool)
• Number of times that URL is linked to from within the site (click to see the list of affected URLs)
• External URL used in the link
• Link text used for the URL
• Redirect’s target URL
• Internal page URL on which the link was first found

The External redirects table is a subset of the External links table showing just those pages returning 301 and 302 HTTP status code redirects.

What people are saying about the Google Sitemap Generator Tool

• Jim's Blog Post
• Blog post by Jen Van Iderstyne
• Review on SEO Book

Rerun this Tool

If you like this tool, please Plus it, Like it, Tweet it, or best yet, link to it - Jim

---