Discover

edit

Gain insight to your data.

Discover enables you to quickly search and filter your data, get information about the structure of the fields, and visualize your data with Lens and Maps. You can customize and save your searches and place them on a dashboard.

Explore and query your data

edit

You have questions about your data. What pages on your website contain a specific word or phrase? What events were logged most recently? What processes take longer than 500 milliseconds to respond? This tutorial shows you how to use Discover to quickly search large amounts of data and understand what’s going on at any given time.

You’ll learn to:

  • Select data for your exploration, set a time range for that data, search it with the Kibana Query Language, and filter the results.
  • Explore the details of your data, view individual documents, and create tables that summarize the contents of the data.
  • Present your findings in a visualization.

At the end of this tutorial, you’ll be ready to start exploring with your own data in Discover.

Prerequisites

edit

Find your data

edit

Tell Kibana where to find the data you want to explore, and then specify the time range in which to view that data.

  1. Open the main menu, and select Discover.
  2. Select the data you want to work with.

    Kibana uses an index pattern to tell it where to find your Elasticsearch data. To view the ecommerce sample data, make sure the index pattern is set to kibana_sample_data_ecommerce.

    How to set the index pattern in Discover
  3. Adjust the time range to view data for the Last 7 days.

    The range selection is based on the default time field in your data. If you are using the sample data, this value was set when you added the data. If you are using your own data, and it does not have a time field, the range selection is not available.

  4. To view the count of documents for a given time in the specified range, click and drag the mouse over the histogram.

Explore the fields in your data

edit

Discover includes a table that shows all the documents that match your search. By default, the table includes columns for the time field and the document _source, which can be overwhelming. You’ll modify this table to display only your fields of interest.

  1. Scan through the list of Available fields until you find the manufacturer field. You can also search for the field by name.

    Fields list that displays the top five search results

  2. Click the manufacturer field to view its five most popular values.

    Fields list that displays the top five search results

  3. Click Add icon to toggle the field into the document table.
  4. Find the customer_first_name and customer_last_name last name fields and add them to your document table. Your table should look similar to this:

    Document table with fields for manufacturer

  5. To rearrange the table columns, hover the mouse over a column header, and then use the move controls.
  6. To view more of the document table, click Hide chart.

Add a field to your index pattern

edit

What happens if you forgot to define an important value as a separate field? Or, what if you want to combine two fields and treat them as one? This is where runtime fields come into play. You can add a runtime field to your index pattern from inside of Discover, and then use that field for analysis and visualizations, the same way you do with other fields.

  1. Click the ellipsis icon (…​), and then click Add field to index pattern.

    Dropdown menu located next to index pattern field with item for adding a field to an index pattern

  2. In the Create field form, enter hello for the name.
  3. Turn on Set value.
  4. Define the script using the Painless scripting language. Runtime fields require an emit().

    emit("Hello World!");
  5. Click Save.
  6. In the fields list, search for the hello field, and then add it to the table to view it’s value.

    hello field in the document table

  7. Create a second field named customer that combines customer last name and first initial.

    String str = doc['customer_first_name.keyword'].value;
    char ch1 = str.charAt(0);
    emit(doc['customer_last_name.keyword'].value + ", " + ch1);
  8. Simplify the the document table by removing customer_first_name and customer_last_name and adding customer in their place.

    Customer last name

    For more information on adding fields and Painless scripting language examples, refer to Explore your data with runtime fields.

Search your data

edit

One of the unique capabilities of Discover is the ability to combine free text search with filtering based on structured data. To search all fields, enter a simple string in the Search field.

Search field in Discover

To search particular fields and build more complex queries, use the Kibana Query language. As you type, KQL prompts you with the fields you can search and the operators you can use to build a structured query.

Search the ecommerce data for documents where the country matches US:

  1. Enter g, and then select geoip.country_iso_code.
  2. Select equals some value and US, and then click Update.
  3. For a more complex search, try:

    geoip.country_iso_code : US and products.taxless_price >= 75

Filter your data

edit

Whereas the query defines the set of documents you are interested in, filters enable you to zero in on different subsets of those documents. You can filter results to include or exclude specific fields, filter for a value in a range, and more.

Exclude documents where day of week is not Wednesday:

  1. Click Add filter.
  2. Set Field to day_of_week, Operator to is not, and Value to Wednesday.

    Add filter dialog in Discover

  3. Save the filter.
  4. Continue your exploration by adding more filters.
  5. To remove a filter, click the close icon (x) next to its name in the filter bar.

Look inside a document

edit

Dive into an individual document to view its fields and the documents that occurred before and after it.

  1. In the document table, expand any document.

    Table view with document expanded

  2. Scan through the fields and their values. If you find a field of interest, hover over its name for filters and other controls.
  3. To view documents that occurred before or after the event you are looking at, click View surrounding documents.
  4. For direct access to a particular document, click View single document.

    You can bookmark this document and share the link.

Save your search for later use

edit

Save your search so you can repeat it later, generate a CSV report, or use it in visualizations, dashboards, and Canvas workpads. Saving a search saves the query text, filters, and current view of Discover—the columns selected in the document table, the sort order, and the index pattern.

  1. In the toolbar, click Save.
  2. Give your search a title, and then click Save.

    Save saved search in Discover

Visualize your findings

edit

If a field can be aggregated, you can quickly visualize it from Discover.

  1. From the Available fields list, click day_of_week, and then click Visualize.

    Discover sidebar field popover with visualize button

    Kibana creates a visualization best suited for this field.

  2. From the Available fields list, drag and drop manufacturer.keyword onto the workspace.

    Visualization that opens from Discover based on your data

  3. Save your visualization for use on a dashboard.

    For geo point fields (Geo point field icon), if you click Visualize, your data appears in a map.

    Map containing documents

Share your findings

edit

To share your findings with a larger audience, click Share in the toolbar. For detailed information about the sharing options, refer to Reporting.

What’s next?

edit