URL index coverage issues Fix

Using Google URL Inspection Tool for URL Index Coverage

For your information, both internal and external features can affect your website URL Index Coverage. Whereby, if a URL is temporarily blocked using the Remove URLs tool, the URL Inspection tool will report the URL as “URL is on Google.” Especially with the URL Index coverage status showing “Crawled“.

However, this does not mean that your URL index coverage is appearing in Search results. As a matter of fact, the canonical URL is not always the one shown in Search results. For example, if a page has a desktop canonical and a mobile version, mobile searches will probably show the mobile page URL. Not forgetting, this value can be a few hours behind the value in our index.

If the page is not the canonical URL, you can inspect the Google-selected canonical URL by selecting Inspect (but only if the URL is in a property that you manage).   

URL Index Coverage
  • Save
The Google URL index coverage platform allows you to see the real time performance of your general website.

How do you fix your URL Index Coverage issues?   

The Article section below describes the basic URL index coverage issues and status fixures. In addition to the details of the indexing process for this URL. Not to mention, the following information can be provided, depending on the index coverage status. Such as the;

1. URL Index Coverage status

A more detailed description of the Presence on Google label, explaining why the URL is or isn’t on Google. This is a success, warning, failure, or excluded value. See the list of values and possible fix instructions. See URL is unknown to Google.

2. URL index coverage Sitemaps

Any known sitemaps that point to this URL. Note: This includes only sitemaps submitted using the Sitemaps report or listed in the robots.txt for this site. Sitemaps discovered through other means won’t be listed. For larger or new sites, it is a good practice to provide a sitemap to help Google know which pages to crawlSee known issues.

3. Referring page

A page that Google possibly used to discover this URL. The referring page might directly link to this URL, or it might be a grandparent or great-grandparent of a page that links to this URL. If this value is absent it doesn’t mean that no referring page exists, just that this information might not be available to the URL Inspection tool at this time.

If you see “URL might be known from other sources that are currently not reported”, it means that Google found this URL through some means other than a sitemap or referring page, but the referring information currently isn’t available to this tool.

4. Last crawl

The last time this page was crawled by Google, in your local time. All information shown in this tool is derived from this last crawled version.

5. Crawl allowed?

Indicates whether your page allowed Google to crawl (visit) the page or blocked it with a robot.txt rule. If you did not intend to block Google, you should remove the robots.txt block. Note that this is not the same as allowing indexing, which is given by the “Indexing allowed?” value.

6. URL index coverage Page fetch

Whether or not Google could actually get the page from your server. If crawling is not allowed, this field will always show a failure. If crawling is allowed, page fetch might still fail for various reasons. See explanations of fetch failures.

Crawl allowed is an indication of whether you want the page to be reachable; page fetch is whether Google could actually reach it if allowed.

7. Indexing allowed?

Whether or not your page explicitly disallowed indexing. If indexing is disallowed, the reason is explained, and the page won’t appear in Google Search results. 

IMPORTANT: If your page is blocked by robots.txt (see “Crawl allowed”), then “Indexing allowed” will always be “Yes” because Google can’t see and respect the noindex directive. In that case, your page might appear in Search results.

8. User-declared canonical

Your declared canonical URL, if the page explicitly declares one. You can declare a canonical URL in several ways: a <link rel="canonical"> tag, an HTTP header, a sitemap, or a few other methods.

If your page is one of a set of similar or duplicate pages, we recommend explicitly declaring the canonical URL. For AMP pages, this should be the non-AMP version (unless it is a self-canonical AMP).

9. Google-selected canonical

The page that Google selected as the canonical (authoritative) URL, when it found similar or duplicate pages on your site. If you declared a canonical URL, Google might select the same URL, but sometimes Google might choose another URL that it considers a better canonical example.

You can’t guarantee the Google-selected canonical for a URL, but you can suggest one. If the page has no alternate versions, the Google-selected canonical is the inspected URL. If you find an unexpected page here, consider explicitly declaring a canonical version.

URL index coverage live Inspection    

Another important key is that you can test a live URL index coverage in your property. For instance, to see whether it is capable of being indexed by Google.

Notably, this will run a test against the live page for information similar to the indexed URLs. In reality, it is useful when you want to test changes on the page. Against the currently indexed version of the page.

Testing a live URL index coverage for potential indexing errors requires;

  1. First, you must inspect the indexed URL as described in Inspect an indexed URLNote: it’s fine if the page hasn’t been indexed yet, or has failed to index (but it must be accessible from the internet without any login information).
  2. Click Test live URL on the index results page.
  3. Read understanding the live test results to understand what you’re looking at.
  4. You can toggle between the live test results and the indexed results by selecting Google Index or Live Test on the page.
  5. To rerun a live test, select the 
    • Save
     (reload) button on the page.
  6. To see details about the page, including a screenshot and HTTP response headers, select View the crawled page.

Differences from URL index coverage inspection    

Please note that there is a per-property daily limit of live URL index coverage inspections. Always remember, this tool fetches and examines the URL index coverage in real time. Therefore, the information shown in the live test can differ from the indexed URL for reasons described below.

  • The live test does not check for the presence of the URL in any sitemaps or any referring pages.
  • The Indexable status in the live URL can be different from the Index coverage status on the indexed URL for these reasons:
  • You have changed or fixed something in the live URL, such as removing (or adding) a noindex tag or a robots.txt block, and the changes were not yet indexed. Examine the difference in the Indexed and Live tests, or check the page version history on your site to discover the differences between the indexed version and the live version.
  • The live test does not support all the index states in the indexed version report. Some states in the indexed report aren’t tested or don’t make sense in a live test, and will be reported differently in the live test. See the indexable section details to learn the unsupported states.

Does a valid result mean that my page will be indexed?

Of course No! This test only confirms that Googlebot can access your page for indexing. Even if you get a valid or warning verdict in the live test, your page must still fulfill other conditions in order to be indexed. For instance, the page cannot be;

  • subject to any manual actions or legal issues.
  • a duplicate of another indexed page; it must either be unique or selected as the canonical version of a set of similar pages.
  • or even the page quality must be high enough to warrant indexing.

URL Index Coverage potential through Google    

The Google Top Card gives a general evaluation of whether or not the live URL has the ability to be indexed. A positive result is not a guarantee that it will appear in Search results.
For your information, Google Custom Search Results require that the page and its structured data conform to quality and security guidelines. However, the URL Inspection tool doesn’t take into account manual actions, content removals, or temporarily blocked URLs.
Moreover, the following values are possible:   

URL is available to Google   

What it means;

The URL isn’t blocked and doesn’t have any detectable errors to prevent full indexing. If Google indexes the URL it can appear in Google Search results.
Provided that it conforms to quality and security guidelines, and is not subject to manual actions, content removals, or temporarily blocked URLs.

What to do next;

If the page is different from the indexed version, you can request indexing by selecting the button on the page. Alternatively, you could submit a sitemap, or wait for it to be crawled naturally.    

URL is available to Google but has issues    

What it means;

The URL can be indexed by Google, but there are some problems that might prevent it from appearing with the enhancements that you tried to implement.

This might mean a problem with an associated AMP page or malformed structured data for a rich result (such as a recipe or job posting) on the page.

What to do next;

Read the warnings or errors information in the report and try to fix the problems described.    

URL is not available to Google    

What it means;

This URL can’t appear in Google Search results due to a critical issue.

What to do next;

Read the details in the Availability section to learn more about the reason.    

For your Takeaway,   

If you own, manage, monetize, or promote online content via Google Search, this guide is meant for you. You might be the owner of a growing and thriving business, there is a collection of help that comes from;

  1. the webmaster of a dozen sites,
  2. the SEO specialist in a Web agency
  3. or a DIY SEO ninja

Not to mention, so adept and passionate about the mechanics of Search. For instance, this guide is meant for you. Whereas if you’re interested in having a complete overview of the basics of SEO according to our SEO best practices, you are indeed in the right place.

The jmexclusives SEO Best Practices Guide won’t provide any secrets that’ll automatically rank your site first in Google (sorry!). But, equally important, following the best practices outlined above will hopefully make it easier.

In that case, for your URL index coverage fixures, search engines to crawl, index and understand your content too. In addition to utilizing various WordPress SEO Plugins and also by researching on content optimization strategic guides.

Resourceful References;

  1. The jmexclusives: Cloud Computing and Technology
  2. Back Linko: Content Optimization Strategies
  3. Google Search Console Help: Search Engine Optimization (SEO) Starter Guide

Leave a Comment

Scroll to Top
Copy link
Powered by Social Snap