educative.io

What is the difference between runtime urls and extracted urls

The text says :

  • The user’s added URLs, which include seed and runtime added URLs.
  • The crawler’s extracted URLs.

The question is what’s the difference between extracted urls by crawler and the runtime added urls ?

Hello @Vinay_Lodha,

Let me clarify the terminology for you:

“Extracted URLs” are the web addresses that the crawler automatically gathers during its operation. In contrast, “runtime added URLs” are URLs manually provided by the user.

To further break down the user-provided URLs:

  • “Seed URLs” are URLs that the user adds before initiating the crawler’s operation.
  • “Runtime added URLs” are URLs that the user adds while the crawler is actively running its operations.