Interface WebCrawlerLimits.Builder

  • Method Details

    • rateLimit

      WebCrawlerLimits.Builder rateLimit(Integer rateLimit)

      The max rate at which pages are crawled, up to 300 per minute per host.

      Parameters:
      rateLimit - The max rate at which pages are crawled, up to 300 per minute per host.
      Returns:
      Returns a reference to this object so that method calls can be chained together.