Adding and Managing Web URLs

Last updated: August 10, 2026

Use the Web URLs tab in Knowledge Sources to add website content that can later be selected for Marketing Agents.

Before You Start

  • You need access to app.docketai.com.

  • Prepare the approved URL you want Docket to use as a knowledge source.

  • Confirm the website content is suitable for customer-facing agent conversations.

Open the Web URLs Tab

  1. Log in to app.docketai.com.

  2. In the left navigation, open Knowledge Sources.

  3. Open the Web URLs tab.

The Web URLs view includes Add Source, a search field, Ingestion Jobs, and a source table.

image.png

Add a URL Source

  1. Click Add Source.

  2. Choose Domains or Individual URLs.

  3. For a domain, enter the domain and decide whether to use sitemap auto-discovery through robots.txt or exclude links.

  4. Review Automatic Re-sync. The current choices are 30, 14, or 7 days.

  5. Click Start Ingestion.

  6. Review the source in Ingestion Jobs until its status is Done.

Review URL Sources

The Web URLs table helps you check whether a source is available and current. The current view includes columns for:

  • Source

  • Type

  • Status

  • Pages

  • Last Updated

Use the search field to find a specific source before assigning it to an agent.

Use the URL Source in an Agent

Adding a URL source makes it available as a global knowledge source. To use it in an agent:

  1. Open Marketing Agent Configuration.

  2. Select the agent.

  3. Open the Knowledge tab.

  4. In Knowledge Base, click Sources.

  5. Select the URL source if it is appropriate for that agent.

Verify the URL Source

  1. Confirm the source row shows the expected domain or page, Type, Status, page count, and Last Updated value.

  2. Wait until Status is Done before selecting the source for an agent.

  3. Open the intended agent and select the web source from Knowledge > Sources.

  4. Preview one question that should be answered from an ingested page and one out-of-scope question.

The source is ready when its job is Done, the intended page content can be used in Preview, and unrelated content is not introduced.

Best Practices

  • Add only approved public or customer-safe pages.

  • Use canonical URLs when possible.

  • Review ingestion status before assigning a new source to an agent.

  • Recheck sources after major website updates.

  • Avoid adding broad websites until you confirm the ingestion scope is appropriate.

Troubleshooting

Issue

What to check

URL source is not visible

Check Ingestion Jobs and refresh the Web URLs view.

Source is visible but not ready

Review the source Status and wait for ingestion to finish.

Agent cannot use the source

Confirm the source is selected in the agent's Knowledge tab.

Agent answers with outdated web content

Reingest or replace the source after the website changes.

Related Articles