Logs Explorer

edit

This functionality is in beta and is subject to change. The design and code is less mature than official GA features and is being provided as-is with no warranties. Beta features are not subject to the support SLA of official GA features.

With Logs Explorer, you can quickly search and filter your log data, get information about the structure of log fields, and display your findings in a visualization. You can also customize and save your searches and place them on a dashboard. Instead of having to log into different servers, change directories, and view individual files, all your logs are available in a single view.

From the Observability navigation menu, click Explorer under the Logs heading to open Logs Explorer.

Screen capture of the Logs Explorer
Required Kibana privileges
edit

Viewing data in Logs Explorer requires read privileges for Discover and Integrations. For more on assigning Kibana privileges, refer to the Kibana privileges docs.

Find your logs
edit

By default, Logs Explorer shows all of your logs, according to the index patterns set in the logs source advanced setting. Update this setting by going to Stack ManagementAdvanced Settings and searching for __.

If you need to focus on logs from a specific integration, select the integration from the logs menu:

Screen capture of log menu

Once you have the logs you want to focus on displayed, you can drill down further to find the information you need. For more on filtering your data in Logs Explorer, refer to Filter logs in Logs Explorer.

Review log data in the documents table
edit

The documents table in Logs Explorer functions similarly to the table in Discover. You can add fields, order table columns, sort fields, and update the row height in the same way you would in Discover.

Refer to the Discover documentation for more information on updating the table.

Analyze data with smart fields
edit

Smart fields are dynamic fields that provide valuable insight on where your log documents come from, what information they contain, and how you can interact with them. The following sections detail the smart fields available in Logs Explorer.

Resource smart fieldedit

The resource smart field shows where your logs are coming from by displaying fields like service.name, container.name, orchestrator.namespace, host.name, and cloud.instance.id. Use this information to see where issues are coming from and if issues are coming from the same source.

Content smart fieldedit

The content smart field shows your logs' log.level and message fields. If neither of these fields are available, the content smart field will show the error.message or event.original field. Use this information to see your log content and inspect issues.

Actions smart fieldedit

The actions smart field provides access to additional information about your logs.

Expand: The icon to expand log details Open the log details to get an in-depth look at an individual log file.

Degraded document indicator: The icon that shows ignored fields Shows if any of the document’s fields were ignored when it was indexed. Ignored fields could indicate malformed fields or other issues with your document. Use this information to investigate and determine why fields are being ignored.

Stacktrace indicator: The icon that shows if a document contains stack traces Shows if the document contains stack traces. This indicator makes it easier to navigate through your documents and know if they contain additional information in the form of stack traces.

View log details
edit

Click the expand icon icon to open log details to get an in-depth look at an individual log file.

These details provide immediate feedback and context for what’s happening and where it’s happening for each log. From here, you can quickly debug errors and investigate the services where errors have occurred.

The following actions help you filter and focus on specific fields in the log details:

  • Filter for value (filter for value icon): Show logs that contain the specific field value.
  • Filter out value (filter out value icon): Show logs that do not contain the specific field value.
  • Filter for field present (filter for present icon): Show logs that contain the specific field.
  • Toggle column in table (toggle column in table icon): Add or remove a column for the field to the main Logs Explorer table.
View log data set details
edit

From the main Kibana menu, go to Stack Management*Data Set Quality to view more details about your data sets and monitor their overall quality.

Refer to Data set quality for more information.