Search

Adding the Website URLs

To add new website URLs, follow the steps below.

  1. Click the Add URLs to Scan button.



     
  2. Enter the Website URL in the field provided. To ensure a successful scan, the URL must utilize a valid Top-Level Domain (TLD) found on the official IANA list (https://data.iana.org/TLD/tlds-alpha-by-domain.txt), and must be publicly accessible. If your security configuration requires restricting access using an IP allowedlist, please contact your Support team or Technical Account Manager (TAM); they can provide a static IP address from which the scan will originate.


     
  3. Under the Page Details tab, enter the Inclusion Patterns, Exclusion Patterns, and Mandatory Pages. 

  •  
    • Inclusion Patterns - Enter a string or a URL. The system includes any URL that matches, if the pattern is found in the scan. Any URL containing the string entered in this field will be crawled, for example, sports. You can add multiple entries by separating them with commas.

       
    • Exclusion Patterns - Enter a string or a URL. The system excludes any URL that matches, if the pattern is found in the scan. Any URL containing the string entered in this field will not be crawled, for example, logout. You can add multiple entries by separating them with commas.

       
    • Mandatory Pages - Enter a URL to include in the scan regardless if it is found or not found in the scanned pages.
  1. Under the Form Actions tab, click the Add New Form Action button to add additional URL-based form action.

  2. Enter the URL in the field provided and click Fetch Forms. This initiates the connection testing using the given credentials and fetches all forms found in the URL. You can also add multiple URLs.

  3. Under the Xpath Actions tab, enter a script to perform prior to beginning a crawl. The first line must be the URL where the form is located. Each subsequent line can be an assignment of value or a click action. Then, click Test Form.



    NOTE: You can import your URLs from a CSV file using the Import button. URLs should be listed one per row. Once URLs are imported, this automatically populates the URL list.

  1. Click Add Website URLs. The URLs are listed and can be edited or deleted as necessary.