Rewrite Url

Find out how to remove parameters and session IDs for more timely and effective seo audid.

Rewrite Url Function

The “Rewrite URL” feature allows you to rewrite URLs in seconds and is extremely useful for “parameter removal” and session IDs.

This function is applied to all URLs discovered during the crawl except the URL entered as the “start crawl” page in the “Spider” mode or the list of URLs added by the user in the “List” mode.

For example, if a website has session IDs that make URLs appear like this “example.com/?sid=6578” simply add ‘sid’ (without the apostrophes) within the “Remove Parameters” field of the “URL Rewriting” function.

Another very common case for sites using paid PPC campaigns, newsletters or other is the use of tracking parameters such as:

Copy to Clipboard

Again, simply enter them into the “URL Rewriting” popup to get the URLs cleaned of parameters.

Having identified the parameters to be removed, I recommend that before starting the scan, you use the “test” option to verify that everything is working properly according to the input you entered.

In addition to the above function you can opt for the advanced “Regex Replace” function.

This advanced function is performed on every URL found during a crawl or in list mode. In a very simple way through the RegEX syntax you are able to replace every substring in a URL that matches the input with the chosen string. This option can also be tested in the “Test” tab of the “URL Rewriting” configuration window.

Url Rewriting Examples

Through the Regex function the Application fields are infinite, let’s look at some of them:

Changing the protocol of URLs from HTTP to HTTPS

Copy to Clipboard

Change all URLs from domain.com to domain.co.uk

Copy to Clipboard

Uniform all links containing page=number to a fixed predefined number, e.g.

  • www.example.com/page.php?page=1
  • www.example.com/page.php?page=2
  • www.example.com/page.php?page=3
  • www.example.com/page.php?page=4
Copy to Clipboard

Remove the www. domain from any URL using an empty ‘Replace’.

Copy to Clipboard

Delete all parameters

Copy to Clipboard

Change links only for example.com subdomains from HTTP to HTTPS

Copy to Clipboard

Remove any elements present in JavaScript rendering mode

Copy to Clipboard

Add some parameters to URLs

Copy to Clipboard

This will add ‘?parameter=value’ to the end of any URL encountered

In situations where the site already has parameters, this requires more complicated expressions for the parameter to be added correctly:

Copy to Clipboard

A final “Url Rewriting” opportunity is the ability to remove from scanning all URLs duplicated by uppercase characters by using “Lowercase discovered URLs” from the Options tab.

Seo Spider Tab