« Task Manager troubleshooting Explore your documents »
Elastic Docs ›Kibana Guide [8.15]

Discover

edit

Discover

edit

You have questions about your data. What pages on your website contain a specific word or phrase? What events were logged most recently? What processes take longer than 500 milliseconds to respond?

With Discover, you can quickly search and filter your data, get information about the structure of the fields, and display your findings in a visualization. You can also customize and save your searches and place them on a dashboard.

A view of the Discover app

Explore and query your data

edit

This tutorial shows you how to use Discover to search large amounts of data and understand what’s going on at any given time.

You’ll learn to:

  • Select data for your exploration, set a time range for that data, search it with the Kibana Query Language, and filter the results.
  • Explore the details of your data, view individual documents, and create tables that summarize the contents of the data.
  • Present your findings in a visualization.

At the end of this tutorial, you’ll be ready to start exploring with your own data in Discover.

Prerequisites:

Find your data

edit

Tell Kibana where to find the data you want to explore, and then specify the time range in which to view that data.

  1. Open the main menu, and select Discover.

  2. Select the data you want to work with.

    Kibana uses a data view to tell it where to find your Elasticsearch data. To view the ecommerce sample data, open the data view menu, and then select Kibana Sample Data Ecommerce.

    How to set the data view in Discover

    To create a data view for your own data, click Create a data view. For details, refer to Create a data view.

  3. Adjust the time range to view data for the Last 7 days.

    The range selection is based on the default time field in your data. If you are using the sample data, this value was set when you added the data. If you are using your own data, and it does not have a time field, the range selection is not available.

  4. To view the count of documents for a given time in the specified range, click and drag the mouse over the chart.

Explore the fields in your data

edit

Discover includes a table that shows all the documents that match your search. By default, the document table includes a column for the time field and a column that lists all other fields in the document. You’ll modify the document table to display your fields of interest.

  1. In the sidebar, enter ma in the search field to find the manufacturer field.

    Fields list that displays the top five search results

    You can use wildcards in field searches. For example, goe*dest finds geo.dest and geo.src.dest.

  2. In the Available fields list, click manufacturer to view its most popular values.

    Discover shows the top 10 values and the number of records used to calculate those values.

  3. Click Add icon to toggle the field into the document table. You can also drag the field from the Available fields list into the document table.

    How to add a field as a column in the table

  4. Find the customer_first_name and customer_last_name fields and add them to the document table. Your table should look similar to this:

    Document table with fields for manufacturer

  5. Optionally try out these actions:

    • To rearrange the table columns, click a column header, and then select Move left or Move right.
    • To copy the name or values in a column to the clipboard, click the column header and select the desired Copy option.
    • To view more of the document table, click icon button for opening Show/Hide chart menu to open the Chart options menu, and then select Hide chart.
    • For keyboard shortcuts on the document table, click icon button for opening list of keyboard shortcuts.
    • To set the row height to one or more lines, or automatically adjust the height to fit the contents, click icon to open the Row height pop-up.
    • To toggle the table in and out of fullscreen mode, click the fullscreen icon icon to display the document table in fullscreen mode.

Add a field to your data view

edit

What happens if you forgot to define an important value as a separate field? Or, what if you want to combine two fields and treat them as one? This is where runtime fields come into play. You can add a runtime field to your data view from inside of Discover, and then use that field for analysis and visualizations, the same way you do with other fields.

  1. In the sidebar, click Add a field.
  2. In the Create field form, enter hello for the name.
  3. Turn on Set value.

  4. Define the script using the Painless scripting language. Runtime fields require an emit().

    emit("Hello World!");
  5. Click Save.

  6. In the sidebar, search for the hello field, and then add it to the document table.

    hello field in the document tables

  7. Create a second field named customer that combines customer last name and first initial.

    String str = doc['customer_first_name.keyword'].value;
char ch1 = str.charAt(0);
emit(doc['customer_last_name.keyword'].value + ", " + ch1);

  8. Remove customer_first_name and customer_last_name from the document table, and then add customer.

    Customer last name

    For more information on adding fields and Painless scripting language examples, refer to Explore your data with runtime fields.

Search your data

edit

One of the unique capabilities of Discover is the ability to combine free text search with filtering based on structured data. To search all fields, enter a simple string in the query bar.

Search field in Discover

To search particular fields and build more complex queries, use the Kibana Query language. As you type, KQL prompts you with the fields you can search and the operators you can use to build a structured query.

Search the ecommerce data for documents where the country matches US:

  1. Enter g, and then select geoip.country_iso_code.
  2. Select : for equals some value and US, and then click the refresh button or press the Enter key.

  3. For a more complex search, try:

    geoip.country_iso_code : US and products.taxless_price >= 75

Filter your data

edit

Whereas the query defines the set of documents you are interested in, filters enable you to zero in on subsets of those documents. You can filter results to include or exclude specific fields, filter for a value in a range, and more.

Exclude documents where day of week is not Wednesday:

  1. Click Add icon next to the query bar.

  2. In the Add filter pop-up, set the field to day_of_week, the operator to is not, and the value to Wednesday.

    Add filter dialog in Discover

  3. Click Add filter.
  4. Continue your exploration by adding more filters.
  5. To remove a filter, click the close icon (x) next to its name in the filter bar.

Look inside a document

edit

Dive into an individual document to view its fields and the documents that occurred before and after it.

  1. In the document table, click the expand icon double arrow icon to open a flyout with the document details to show document details.

    Table view with document expanded

  2. Scan through the fields and their values. If you find a field of interest, hover your mouse over the Actions column for filters and other options.
  3. To create a view of the document that you can bookmark and share, click Single document.
  4. To view documents that occurred before or after the event you are looking at, click Surrounding documents.

Save your search for later use

edit

Save your search so you can use it later, generate a CSV report, or use it to create visualizations, dashboards, and Canvas workpads. Saving a search saves the query text, filters, and current view of Discover, including the columns selected in the document table, the sort order, and the data view.

  1. In the toolbar, click Save.
  2. Give your search a title.
  3. Optionally store tags and the time range with the search.
  4. Click Save.

Visualize your findings

edit

If a field can be aggregated, you can quickly visualize it from Discover.

  1. In the sidebar, find and then click day_of_week.

    Top values for the day_of_week field

  2. In the popup, click Visualize.

    Kibana creates a visualization best suited for this field.

  3. From the Available fields list, drag and drop manufacturer.keyword onto the workspace.

    Visualization that opens from Discover based on your data

  4. Save your visualization for use on a dashboard.

    For geo point fields (Geo point field icon), if you click Visualize, your data appears in a map.

    Map containing documents

Share your findings

edit

To share your findings with a larger audience, click Share in the Discover toolbar. For detailed information about the sharing options, refer to Reporting.

Generate alerts

edit

From Discover, you can create a rule to periodically check when data goes above or below a certain threshold within a given time interval.

  1. Ensure that your data view, query, and filters fetch the data for which you want an alert.

  2. In the toolbar, click Alerts > Create search threshold rule.

    The Create rule form is pre-filled with the latest query sent to Elasticsearch.

  3. Configure your query and select a connector type.
  4. Click Save.

For more about this and other rules provided in alerting features, go to Alerting.

What’s next?

edit

Troubleshooting

edit
« Task Manager troubleshooting Explore your documents »