On the Crawl and Index > Proxy Servers page, you configure a proxy server to crawl outside your internal network and include the crawled data in your index.
To set options for a proxy server:
- Under Proxy Servers, specify the URL patterns you want crawled through the proxy in the For URLs Matching Pattern text boxes. These patterns must conform to the rules for valid URL patterns.
- Specify the proxy to use for crawling URLs in the Use This Proxy Server text boxes.
- Specify the proxy port in the On Port text boxes.
- If you need more rows for additional patterns or proxy servers, click the Add More Rows
button.
- Click the Save Crawler Proxies Configuration button.