ℹ️ For new users, we recommend using our native Elasticsearch tools, rather than the standalone App Search product. We are actively developing new features and capabilities in the Elastic Stack to help you build powerful search applications. Refer to this blog for more information.
« View web crawler events logs Web crawler FAQ »
Elastic Docs › ›Guides

App Search web crawler

edit

App Search web crawler

edit

Looking for the Elastic web crawler? See the Elastic web crawler documentation.

Try the Elastic Open Web Crawler!

Check out the new self-managed Elastic Open Web Crawler (technical preview), a lightweight, open code web crawler which doesn’t require running the Enterprise Search or Kibana services. The GitHub repo contains everything you need to get started. Read this launch blog for more context.

The App Search web crawler discovers, extracts, and indexes your web content into your App Search engines.

Use the App Search web crawler to transform your web content into searchable content.

Get started with the App Search web crawler

edit

When you’re ready to get started, watch the quick start video series:


Read the App Search web crawler documentation:

« View web crawler events logs Web crawler FAQ »