- Filebeat Reference: other versions:
- Overview
- Getting Started With Filebeat
- Setting up and running Filebeat
- Upgrading Filebeat
- How Filebeat works
- Configuring Filebeat
- Specify which modules to run
- Configure inputs
- Manage multiline messages
- Specify general settings
- Load external configuration files
- Configure the internal queue
- Configure the output
- Configure index lifecycle management
- Load balance the output hosts
- Specify SSL settings
- Filter and enhance the exported data
- Define processors
- Add cloud metadata
- Add fields
- Add labels
- Add the local time zone
- Add tags
- Decode CEF
- Decode CSV fields
- Decode JSON fields
- Decode Base64 fields
- Decompress gzip fields
- Community ID Network Flow Hash
- Convert
- Drop events
- Drop fields from events
- Extract array
- Keep fields from events
- Registered Domain
- Rename fields from events
- Add Kubernetes metadata
- Add Docker metadata
- Add Host metadata
- Add Observer metadata
- Dissect strings
- DNS Reverse Lookup
- Add process metadata
- Script Processor
- Timestamp
- Parse data by using ingest node
- Enrich events with geoIP information
- Configure project paths
- Configure the Kibana endpoint
- Load the Kibana dashboards
- Load the Elasticsearch index template
- Configure logging
- Use environment variables in the configuration
- Autodiscover
- YAML tips and gotchas
- Regular expression support
- HTTP Endpoint
- filebeat.reference.yml
- Beats central management
- Modules
- Modules overview
- Apache module
- Auditd module
- AWS module
- CEF module
- Cisco module
- Coredns Module
- Elasticsearch module
- Envoyproxy Module
- Google Cloud module
- haproxy module
- IBM MQ module
- Icinga module
- IIS module
- Iptables module
- Kafka module
- Kibana module
- Logstash module
- MongoDB module
- MSSQL module
- MySQL module
- nats module
- NetFlow module
- Nginx module
- Osquery module
- Palo Alto Networks module
- PostgreSQL module
- RabbitMQ module
- Redis module
- Santa module
- Suricata module
- System module
- Traefik module
- Zeek (Bro) Module
- Exported fields
- Apache fields
- Auditd fields
- AWS fields
- Beat fields
- Decode CEF processor fields fields
- CEF fields
- Cisco fields
- Cloud provider metadata fields
- Coredns fields
- Docker fields
- ECS fields
- elasticsearch fields
- Envoyproxy fields
- Google Cloud fields
- haproxy fields
- Host fields
- ibmmq fields
- Icinga fields
- IIS fields
- iptables fields
- Jolokia Discovery autodiscover provider fields
- Kafka fields
- kibana fields
- Kubernetes fields
- Log file content fields
- logstash fields
- mongodb fields
- mssql fields
- MySQL fields
- nats fields
- NetFlow fields
- NetFlow fields
- Nginx fields
- Osquery fields
- panw fields
- PostgreSQL fields
- Process fields
- RabbitMQ fields
- Redis fields
- s3 fields
- Google Santa fields
- Suricata fields
- System fields
- Traefik fields
- Zeek fields
- Monitoring Filebeat
- Securing Filebeat
- Troubleshooting
- Get help
- Debug
- Common problems
- Can’t read log files from network volumes
- Filebeat isn’t collecting lines from a file
- Too many open file handlers
- Registry file is too large
- Inode reuse causes Filebeat to skip lines
- Log rotation results in lost or duplicate events
- Open file handlers cause issues with Windows file rotation
- Filebeat is using too much CPU
- Dashboard in Kibana is breaking up data fields incorrectly
- Fields are not indexed or usable in Kibana visualizations
- Filebeat isn’t shipping the last line of a file
- Filebeat keeps open file handlers of deleted files for a long time
- Filebeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Contributing to Beats
haproxy fields
edithaproxy fields
edithaproxy Module
haproxy
edit-
haproxy.frontend_name -
Name of the frontend (or listener) which received and processed the connection.
-
haproxy.backend_name -
Name of the backend (or listener) which was selected to manage the connection to the server.
-
haproxy.server_name -
Name of the last server to which the connection was sent.
-
haproxy.total_waiting_time_ms -
Total time in milliseconds spent waiting in the various queues
type: long
-
haproxy.connection_wait_time_ms -
Total time in milliseconds spent waiting for the connection to establish to the final server
type: long
-
haproxy.bytes_read -
Total number of bytes transmitted to the client when the log is emitted.
type: long
-
haproxy.time_queue -
Total time in milliseconds spent waiting in the various queues.
type: long
-
haproxy.time_backend_connect -
Total time in milliseconds spent waiting for the connection to establish to the final server, including retries.
type: long
-
haproxy.server_queue -
Total number of requests which were processed before this one in the server queue.
type: long
-
haproxy.backend_queue -
Total number of requests which were processed before this one in the backend’s global queue.
type: long
-
haproxy.bind_name -
Name of the listening address which received the connection.
-
haproxy.error_message -
Error message logged by HAProxy in case of error.
type: text
-
haproxy.source -
The HAProxy source of the log
type: keyword
-
haproxy.termination_state -
Condition the session was in when the session ended.
-
haproxy.mode -
mode that the frontend is operating (TCP or HTTP)
type: keyword
connections
editContains various counts of connections active in the process.
-
haproxy.connections.active -
Total number of concurrent connections on the process when the session was logged.
type: long
-
haproxy.connections.frontend -
Total number of concurrent connections on the frontend when the session was logged.
type: long
-
haproxy.connections.backend -
Total number of concurrent connections handled by the backend when the session was logged.
type: long
-
haproxy.connections.server -
Total number of concurrent connections still active on the server when the session was logged.
type: long
-
haproxy.connections.retries -
Number of connection retries experienced by this session when trying to connect to the server.
type: long
client
editInformation about the client doing the request
-
haproxy.client.ip -
type: alias
alias to: source.address
-
haproxy.client.port -
type: alias
alias to: source.port
-
haproxy.process_name -
type: alias
alias to: process.name
-
haproxy.pid -
type: alias
alias to: process.pid
destination
editDestination information
-
haproxy.destination.port -
type: alias
alias to: destination.port
-
haproxy.destination.ip -
type: alias
alias to: destination.ip
geoip
editContains GeoIP information gathered based on the client.ip field. Only present if the GeoIP Elasticsearch plugin is available and used.
-
haproxy.geoip.continent_name -
type: alias
alias to: source.geo.continent_name
-
haproxy.geoip.country_iso_code -
type: alias
alias to: source.geo.country_iso_code
-
haproxy.geoip.location -
type: alias
alias to: source.geo.location
-
haproxy.geoip.region_name -
type: alias
alias to: source.geo.region_name
-
haproxy.geoip.city_name -
type: alias
alias to: source.geo.city_name
-
haproxy.geoip.region_iso_code -
type: alias
alias to: source.geo.region_iso_code
http
editPlease add description
response
editFields related to the HTTP response
-
haproxy.http.response.captured_cookie -
Optional "name=value" entry indicating that the client had this cookie in the response.
-
haproxy.http.response.captured_headers -
List of headers captured in the response due to the presence of the "capture response header" statement in the frontend.
type: keyword
-
haproxy.http.response.status_code -
type: alias
alias to: http.response.status_code
request
editFields related to the HTTP request
-
haproxy.http.request.captured_cookie -
Optional "name=value" entry indicating that the server has returned a cookie with its request.
-
haproxy.http.request.captured_headers -
List of headers captured in the request due to the presence of the "capture request header" statement in the frontend.
type: keyword
-
haproxy.http.request.raw_request_line -
Complete HTTP request line, including the method, request and HTTP version string.
type: keyword
-
haproxy.http.request.time_wait_without_data_ms -
Total time in milliseconds spent waiting for the server to send a full HTTP response, not counting data.
type: long
-
haproxy.http.request.time_wait_ms -
Total time in milliseconds spent waiting for a full HTTP request from the client (not counting body) after the first byte was received.
type: long
tcp
editTCP log format
-
haproxy.tcp.connection_waiting_time_ms -
Total time in milliseconds elapsed between the accept and the last close
type: long