Logstash 7.7.0 Release Notes
editLogstash 7.7.0 Release Notes
editNew features and improvements
editImproving Logging
editContinuing with the Logging improvements made in the past couple of releases, log messages have been expanded to more accurately display information about plugins. These changes allow users to better identify log messages with plugins or pipelines. #11078, #11593, #11567
Changes include:
-
Added
plugin.name
to all log entries. -
Added
plugin.id
andpipeline.id
to docker images.
Improving the Java (Pipeline) Execution Engine
editThe improvements available in Logstash 7.7 give users more control over event ordering for single worker pipelines.
Historically, Logstash event ordering between an input plugin and output plugin were preserved when a single worker executed a pipeline. This behaviour was never officially documented, but it was a feature that many users relied upon.
When the Java Execution engine was introduced, it broke the single worker
ordering preservation. This has now been fixed with the introduction of the
pipeline.ordered
setting.
#11552,
#11710
The pipeline.ordered
setting allows three modes:
-
auto (default)
- to automatically enable ordering if there’s only one pipeline worker. -
true
- enforces ordering while preventing logstash from starting if there are multiple workers. -
false
- ordering will not be guaranteed.
Notable issues fixed
edit-
Fixed: Add
sudo
into the rpm import of GPG-KEY #11684 - Fixed: Use lightweight regex matching (which does not depend on frames) #11653
- Fixed: Issue where monitoring API does not properly resolve ids including environment variable expansion #11592
- Fixed: Change Javadoc to conform to updated requirements for JDK13 #11642
Known issue
editPerformance regression. A potential performance regression may affects some users. This issue can cause a slowdown on pipeline compilation when multiple pipelines are in use. We believe the issue was introduced in 7.7.0. This issue is currently being tracked and investigated in #12031
This issue seems to be affecting only big pipeline installations (that is, big pipeline definitions when multiple pipelines are defined). Symptoms include increased startup time and the appearance that Logstash is not responding to input events.
If you believe this issue is affecting you, we recommended that you downgrade to 7.6.2 while we continue to investigate and provide a resolution.
Logstash Plugin changes
editGrok Filter
- Feature: Added support for placing matches into a target namespace #156
Xml Filter
-
Feature: Added parser_options to allow for more control of the parsing process.
Includes the option of
strict
parsing to force the XML parser to fail early when parsing invalid XML. #68
Azure_event_hubs Input
-
Fixed: Now honors
max_batch_size
setting - previously this was ignored #52 -
Changed: The default number of threads is now
16
instead of `4`to match the default number from the Azure-Sdk EventProcessorHost #54 - Refactor: scope and review global java_imports #57
- [DOC] Changed documentation to update the default number of threads #55
- [DOC] Added clarification for threads parameter #50
Elasticsearch Input
- Feature: Added option to specify proxy for Elasticsearch #114
S3 Input
S3 Output