This documentation contains work-in-progress information for future Elastic Stack and Cloud releases. Use the version selector to view supported release docs. It also contains some Elastic Cloud serverless information. Check out our serverless docs for more details.
« View web crawler events logs Web crawler FAQ »
Elastic Docs › ›Guides

App Search web crawler

edit

App Search web crawler

edit

Looking for the Elastic web crawler? See the Elastic web crawler documentation.

Try the Elastic Open Web Crawler!

Check out the new self-managed Elastic Open Web Crawler (technical preview), a lightweight, open code web crawler which doesn’t require running the Enterprise Search or Kibana services. The GitHub repo contains everything you need to get started. Read this launch blog for more context.

The App Search web crawler discovers, extracts, and indexes your web content into your App Search engines.

Use the App Search web crawler to transform your web content into searchable content.

Get started with the App Search web crawler

edit

When you’re ready to get started, watch the quick start video series:


Read the App Search web crawler documentation:

« View web crawler events logs Web crawler FAQ »