Using logsDB index mode with Elastic Security Serverless

LogsDB is enabled by default for Elastic Cloud Serverless. This topic explains the impact of using logsDB index mode with Elastic Security Serverless.

With logsDB index mode, the original _source field is not stored in the index but can be reconstructed using synthetic _source.

When the _source is reconstructed, modifications are possible. Therefore, there could be a mismatch between user’s expectations and how fields are formatted.

Continue reading to find out how this affects specific Elastic Security Serverless components.

When alerts are generated, the _source event is copied into the alert to retain the original data. When the logsDB index mode is applied, the _source event stored in the alert is reconstructed using synthetic _source.

If you’re switching to use logsDB index mode, the _source field stored in the alert might look different in certain situations:

Alerts generated by the following rule types could be affected:

Alerts that are generated by threshold, machine learning, and event correlation sequence rules are not affected since they do not contain copies of the original source.

While we do not recommend using _source for actions, in cases where the action relies on the _source, the same limitations and changes apply.

If you send alert notifications by enabling actions to the external systems that have workflows or automations based on fields formatted from the original source, they may be affected. In particular, this can happen when the fields used are arrays of objects.

We recommend checking and adjusting the rule actions using _source before switching to logsDB index mode.

Runtime fields that reference _source may be affected. Some runtime fields might not work and need to be adjusted. For example, if an event was indexed with the value of agent.name in the dot-notation form, it will be returned in the nested form and might not work.

The following is an example of accessing _source that works with the logsDB index mode enabled:

"source": """  emit(params._source.agent.name + "_____" + doc['agent.name'].value ); """
"source": """  emit(params._source['agent']['name'] + "_____" + doc['agent.name'].value );  """
"source": """  emit(field('agent.name').get(null) + "_____" + doc['agent.name'].value ); """
"source": """  emit($('agent.name', null) + "_____" + doc['agent.name'].value ); """

The following will not work with synthetic source (logsDB index mode enabled):

"source": """  emit(params._source['agent.name'] + "_____" + doc['agent.name'].value );  """