What we monitor

Every night we fetch the URLs and sitemaps in your project, compare them with the saved baseline and report only what has really changed. Here is the full list of checks.

Indexability

Whether the page can still appear in search results.

Page is no longer indexable

critical

One clear signal with the cause: noindex in meta robots or in the X-Robots-Tag header, a canonical pointing to another URL, or a robots.txt block for Googlebot. A cause present since the first check is the existing state, not a change.

Canonical differs from the baseline

warning

The canonical changed, but the page still points to itself (or the canonical disappeared). We show what it was and what it is now.

Number of indexable pages

info

The Indexability tab shows how many monitored pages can appear in Google and, for each non-indexable one, why.

robots.txt

The robots.txt file of every host you monitor URLs on — fetched every night.

Monitored pages blocked

critical

A new Disallow rule blocked monitored pages for Googlebot. Each one gets an indexability-lost event naming the rule.

robots.txt unavailable

critical

The file returns a server error (5xx) or doesn't respond. Google then pauses crawling the whole site. Pages are still assessed against the last content we read.

robots.txt changed

info

Which lines disappeared, which were added and how many monitored URLs the new version blocks. If it blocks any — a warning.

Status codes and redirects

Whether the URL responds the way it did when we saved the baseline.

4xx or 5xx error

critical

On a URL that used to return 200. A series of server errors (5xx) is reported right away, others after confirmation in the next check.

New redirect

critical

A URL that used to respond on its own started redirecting. We show the target.

Redirect loop

critical

The chain returns to a URL it already visited — the page will never load.

Back to the previous state

info

A URL that had a problem responds like the baseline again. The case closes itself.

Meta tags and headings

The elements Google shows in results and uses to understand the page.

Title differs from the baseline

warning

We compare the text character by character. Changes limited to numbers (prices, dates, product counts) don't trigger an alert.

Meta description differs from the baseline

warning

Same as title: every change in wording, without noise from numbers.

H1 differs from the baseline

warning

The first H1 heading changed its text.

H1 disappeared

warning

The page had an H1 heading and now it doesn't.

Duplicated element

warning

A second title, description, canonical, meta robots or H1 on the page. We only report new duplicates — if a site has always had two canonicals, we won't flood you with it every day.

Sitemaps

The sitemap files and sitemap indexes you add to the project.

Sitemap file disappeared

critical

The file stopped responding or returns an error.

File can't be read

warning

The file is there, but it isn't valid sitemap XML (e.g. an error page instead of the sitemap).

Drop in URL count

warning

By default when the count changes by 10% or more. Set a percentage and an absolute threshold per project.

Growth in URL count

info

A sudden jump can be a wave of junk pages. You can raise it to a warning.

New file in the sitemap index

info

Another file appeared in the sitemap index.

Speed

How fast the server responds to our crawler and how heavy the page is.

Response time increase

warning

By default when the response time triples compared with the median of recent checks. Change the factor per project.

Response time and page weight charts

info

The project's average response time day by day and a fixed speed sample: page weight and its components.

JavaScript pages

Stores and apps where the browser swaps in the content.

Content swap detection

info

For every site we check whether the title, canonical or H1 after rendering differ from the raw HTML.

Comparison after rendering

info

If content is swapped, we monitor the version a browser and a rendering crawler see — not the empty template.

How we keep alerts meaningful

A baseline instead of rules

On the first check we save the state of every URL. Each next check is compared with it, so you know what changed and since when.

Confirmed critical events

We report a critical event only after the next check confirms it. A momentary server hiccup won't wake you up at night.

Approving changes

Was the change intended? Approve the new baseline with one click and the case is closed.

Honest about blocks

When a site's protection won't let our crawler in, we say so separately. No alerts never means “all good” if a page simply couldn't be fetched.

Coming next

  • Full redirect chains. Every hop with its status and target in the URL history, alerts when a 301 turns into a 302 or the chain gets longer.
  • Old URLs after a migration. Making sure old URLs keep redirecting where they should.

Try it on your own pages

The beta is free and your account is ready right away.

Join the beta