CrawlGram

Available now · v1.0.0

CrawlVault

Keep your Search Console crawl data for longer than 90 days.

A free Chrome extension that saves your Google Search Console crawl stats in your browser, so you can see months or years of crawl history.

  • Free
  • Open Source
  • Runs in your browser
  • Chrome extension

The problem #

Search Console's Crawl stats report shows how Googlebot crawls your site: how many requests, which response codes, which file types and how fast your server answers.

Google deletes this data after about 90 days, and there is no API to save it. Once it's gone, you can't get it back.

What CrawlVault does #

CrawlVault saves the Crawl stats report every few weeks. Each save joins the previous ones, so you build one long history of how Google crawls your site.

Use it to compare this month with last year, check a site migration, or find when a crawl problem started.

Features

Daily crawl history

Crawl requests, download size and response time for every day, joined across backups with no gaps or duplicates.

Every breakdown

See requests by response code, file type, crawl purpose, Googlebot type and host.

Any date range

Pick a month or any start and end date. Compare with the previous period.

All your sites

Your Search Console sites load automatically. Back up one or all of them.

Reminders or automatic backups

Get a reminder every 21 days, or let CrawlVault back up on its own.

Export your data

Download any date range as CSV, or everything as JSON to move it to another browser.

How it works

  1. Install the extension and click its icon. It loads your Search Console properties from the Google account you're signed in with.
  2. Click “Back up crawl stats”. CrawlVault reads the Crawl stats report and saves it. No exports or CSV files.
  3. Repeat every 21 days, or turn on automatic backups. CrawlVault reminds you.

Installation

Latest version: v1.0.0 for Chrome, released .

  1. Download and unzip the release
  2. Open chrome://extensions and turn on Developer mode
  3. Click Load unpacked and select the unzipped folder
  4. Pin CrawlVault and click its icon

Privacy & local storage

CrawlVault has no account, no server and no tracking. Everything it saves stays in your browser.

It only connects to search.google.com, using the session you already have. It never sees your Google password.

You can export everything as CSV or JSON at any time. Uninstalling the extension deletes its data.

Open source

CrawlVault is developed in the open under the MIT license. Read the code, report issues or contribute.

Changelog

Full changelog

v1.0.0

Chrome

First public release of CrawlVault.

New

  • Back up Search Console crawl stats directly from the report data (no CSV)
  • Automatic property list from your Search Console account
  • Dashboard with month and custom date ranges, month-by-month table and breakdowns
  • Reminders every 21 days or automatic backups
  • CSV and JSON export, JSON restore

Frequently asked questions

Is CrawlVault free?

Yes. It is free and open source under the MIT license. There is no paid plan and no account.

Does it use the Search Console API?

No. The API does not include crawl stats. CrawlVault reads the Crawl stats report using your normal Search Console sign-in.

Can it get crawl stats older than 90 days?

No. Google deletes older data. Your history starts from your first backup, so start soon.

Where is my data stored?

In your browser only. Nothing is sent to CrawlGram or anyone else.

Which sites does it work with?

Domain properties and URL-prefix properties at the root of a site, where you have Full or Owner access in Search Console.

What if Google changes Search Console?

Backups may stop until we release an update. The data you already saved stays safe.