- Filebeat Reference: other versions:
- Filebeat overview
- Quick start: installation and configuration
- Set up and run
- Upgrade
- How Filebeat works
- Configure
- Inputs
- Modules
- General settings
- Project paths
- Config file loading
- Output
- Kerberos
- SSL
- Index lifecycle management (ILM)
- Elasticsearch index template
- Kibana endpoint
- Kibana dashboards
- Processors
- Define processors
- add_cloud_metadata
- add_cloudfoundry_metadata
- add_docker_metadata
- add_fields
- add_host_metadata
- add_id
- add_kubernetes_metadata
- add_labels
- add_locale
- add_observer_metadata
- add_process_metadata
- add_tags
- community_id
- convert
- copy_fields
- decode_base64_field
- decode_cef
- decode_csv_fields
- decode_json_fields
- decompress_gzip_field
- dissect
- dns
- drop_event
- drop_fields
- extract_array
- fingerprint
- include_fields
- registered_domain
- rename
- script
- timestamp
- translate_sid
- truncate_fields
- urldecode
- Autodiscover
- Internal queue
- Load balancing
- Logging
- HTTP endpoint
- Regular expression support
- Instrumentation
- filebeat.reference.yml
- How to guides
- Override configuration settings
- Load the Elasticsearch index template
- Change the index name
- Load Kibana dashboards
- Load ingest pipelines
- Enrich events with geoIP information
- Deduplicate data
- Parse data by using ingest node
- Use environment variables in the configuration
- Avoid YAML formatting problems
- Beats central management
- Modules
- Modules overview
- ActiveMQ module
- Apache module
- Auditd module
- AWS module
- Azure module
- Barracuda module
- Bluecoat module
- CEF module
- Check Point module
- Cisco module
- CoreDNS module
- Crowdstrike module
- Cylance module
- Elasticsearch module
- Envoyproxy Module
- F5 module
- Fortinet module
- Google Cloud module
- GSuite module
- haproxy module
- IBM MQ module
- Icinga module
- IIS module
- Imperva module
- Infoblox module
- Iptables module
- Juniper module
- Kafka module
- Kibana module
- Logstash module
- Microsoft module
- MISP module
- MongoDB module
- MSSQL module
- MySQL module
- nats module
- NetFlow module
- Netscout module
- Nginx module
- Office 365 module
- Okta module
- Osquery module
- Palo Alto Networks module
- PostgreSQL module
- RabbitMQ module
- Radware module
- Redis module
- Santa module
- Sonicwall module
- Sophos module
- Squid module
- Suricata module
- System module
- Tomcat module
- Traefik module
- Zeek (Bro) Module
- Zscaler module
- Exported fields
- ActiveMQ fields
- Apache fields
- Auditd fields
- AWS fields
- awscloudwatch fields
- Azure fields
- Barracuda Web Application Firewall fields
- Beat fields
- Blue Coat Director fields
- Decode CEF processor fields fields
- CEF fields
- Checkpoint fields
- Cisco fields
- Cloud provider metadata fields
- Coredns fields
- Crowdstrike fields
- CylanceProtect fields
- Docker fields
- ECS fields
- Elasticsearch fields
- Envoyproxy fields
- Big-IP Access Policy Manager fields
- Fortinet fields
- Google Cloud fields
- gsuite fields
- HAProxy fields
- Host fields
- ibmmq fields
- Icinga fields
- IIS fields
- Imperva SecureSphere fields
- Infoblox NIOS fields
- iptables fields
- Jolokia Discovery autodiscover provider fields
- Juniper JUNOS fields
- Kafka fields
- kibana fields
- Kubernetes fields
- Log file content fields
- logstash fields
- Microsoft fields
- MISP fields
- mongodb fields
- mssql fields
- MySQL fields
- NATS fields
- NetFlow fields
- Arbor Peakflow SP fields
- Nginx fields
- Office 365 fields
- Okta fields
- Osquery fields
- panw fields
- PostgreSQL fields
- Process fields
- RabbitMQ fields
- Radware DefensePro fields
- Redis fields
- s3 fields
- Google Santa fields
- Sonicwall-FW fields
- sophos fields
- Squid fields
- Suricata fields
- System fields
- Apache Tomcat fields
- Traefik fields
- Zeek fields
- Zscaler NSS fields
- Monitor
- Secure
- Troubleshoot
- Get help
- Debug
- Common problems
- Can’t read log files from network volumes
- Filebeat isn’t collecting lines from a file
- Too many open file handlers
- Registry file is too large
- Inode reuse causes Filebeat to skip lines
- Log rotation results in lost or duplicate events
- Open file handlers cause issues with Windows file rotation
- Filebeat is using too much CPU
- Dashboard in Kibana is breaking up data fields incorrectly
- Fields are not indexed or usable in Kibana visualizations
- Filebeat isn’t shipping the last line of a file
- Filebeat keeps open file handlers of deleted files for a long time
- Filebeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- Publishing to Logstash fails with "connection reset by peer" message
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Dashboard could not locate the index-pattern
- Contribute to Beats
Google Cloud fields
editGoogle Cloud fields
editModule for handling logs from Google Cloud.
googlecloud
editFields from Google Cloud logs.
destination.instance
editIf the destination of the connection was a VM located on the same VPC, this field is populated with VM instance details. In a Shared VPC configuration, project_id corresponds to the project that owns the instance, usually the service project.
-
googlecloud.destination.instance.project_id -
ID of the project containing the VM.
type: keyword
-
googlecloud.destination.instance.region -
Region of the VM.
type: keyword
-
googlecloud.destination.instance.zone -
Zone of the VM.
type: keyword
destination.vpc
editIf the destination of the connection was a VM located on the same VPC, this field is populated with VPC network details. In a Shared VPC configuration, project_id corresponds to that of the host project.
-
googlecloud.destination.vpc.project_id -
ID of the project containing the VM.
type: keyword
-
googlecloud.destination.vpc.vpc_name -
VPC on which the VM is operating.
type: keyword
-
googlecloud.destination.vpc.subnetwork_name -
Subnetwork on which the VM is operating.
type: keyword
source.instance
editIf the source of the connection was a VM located on the same VPC, this field is populated with VM instance details. In a Shared VPC configuration, project_id corresponds to the project that owns the instance, usually the service project.
-
googlecloud.source.instance.project_id -
ID of the project containing the VM.
type: keyword
-
googlecloud.source.instance.region -
Region of the VM.
type: keyword
-
googlecloud.source.instance.zone -
Zone of the VM.
type: keyword
source.vpc
editIf the source of the connection was a VM located on the same VPC, this field is populated with VPC network details. In a Shared VPC configuration, project_id corresponds to that of the host project.
-
googlecloud.source.vpc.project_id -
ID of the project containing the VM.
type: keyword
-
googlecloud.source.vpc.vpc_name -
VPC on which the VM is operating.
type: keyword
-
googlecloud.source.vpc.subnetwork_name -
Subnetwork on which the VM is operating.
type: keyword
audit
editFields for Google Cloud audit logs.
-
googlecloud.audit.type -
Type property.
type: keyword
authentication_info
editAuthentication information.
-
googlecloud.audit.authentication_info.principal_email -
The email address of the authenticated user making the request.
type: keyword
-
googlecloud.audit.authentication_info.authority_selector -
The authority selector specified by the requestor, if any. It is not guaranteed that the principal was allowed to use this authority.
type: keyword
-
googlecloud.audit.authorization_info -
Authorization information for the operation.
type: array
-
googlecloud.audit.method_name -
The name of the service method or operation. For API calls, this should be the name of the API method. For example, google.datastore.v1.Datastore.RunQuery.
type: keyword
-
googlecloud.audit.num_response_items -
The number of items returned from a List or Query API method, if applicable.
type: long
request
editThe operation request.
-
googlecloud.audit.request.proto_name -
Type property of the request.
type: keyword
-
googlecloud.audit.request.filter -
Filter of the request.
type: keyword
-
googlecloud.audit.request.name -
Name of the request.
type: keyword
-
googlecloud.audit.request.resource_name -
Name of the request resource.
type: keyword
request_metadata
editMetadata about the request.
-
googlecloud.audit.request_metadata.caller_ip -
The IP address of the caller.
type: ip
-
googlecloud.audit.request_metadata.caller_supplied_user_agent -
The user agent of the caller. This information is not authenticated and should be treated accordingly.
type: keyword
response
editThe operation response.
-
googlecloud.audit.response.proto_name -
Type property of the response.
type: keyword
details
editThe details of the response.
-
googlecloud.audit.response.details.group -
The name of the group.
type: keyword
-
googlecloud.audit.response.details.kind -
The kind of the response details.
type: keyword
-
googlecloud.audit.response.details.name -
The name of the response details.
type: keyword
-
googlecloud.audit.response.details.uid -
The uid of the response details.
type: keyword
-
googlecloud.audit.response.status -
Status of the response.
type: keyword
-
googlecloud.audit.resource_name -
The resource or collection that is the target of the operation. The name is a scheme-less URI, not including the API service name. For example, shelves/SHELF_ID/books.
type: keyword
resource_location
editThe location of the resource.
-
googlecloud.audit.resource_location.current_locations -
Current locations of the resource.
type: keyword
-
googlecloud.audit.service_name -
The name of the API service performing the operation. For example, datastore.googleapis.com.
type: keyword
status
editThe status of the overall operation.
-
googlecloud.audit.status.code -
The status code, which should be an enum value of google.rpc.Code.
type: integer
-
googlecloud.audit.status.message -
A developer-facing error message, which should be in English. Any user-facing error message should be localized and sent in the google.rpc.Status.details field, or localized by the client.
type: keyword
firewall
editFields for Google Cloud Firewall logs.
rule_details
editDescription of the firewall rule that matched this connection.
-
googlecloud.firewall.rule_details.priority -
The priority for the firewall rule.
type: long
-
googlecloud.firewall.rule_details.action -
Action that the rule performs on match.
type: keyword
-
googlecloud.firewall.rule_details.direction -
Direction of traffic that matches this rule.
type: keyword
-
googlecloud.firewall.rule_details.reference -
Reference to the firewall rule.
type: keyword
-
googlecloud.firewall.rule_details.source_range -
List of source ranges that the firewall rule applies to.
type: keyword
-
googlecloud.firewall.rule_details.destination_range -
List of destination ranges that the firewall applies to.
type: keyword
-
googlecloud.firewall.rule_details.source_tag -
List of all the source tags that the firewall rule applies to.
type: keyword
-
googlecloud.firewall.rule_details.target_tag -
List of all the target tags that the firewall rule applies to.
type: keyword
-
googlecloud.firewall.rule_details.ip_port_info -
List of ip protocols and applicable port ranges for rules.
type: array
-
googlecloud.firewall.rule_details.source_service_account -
List of all the source service accounts that the firewall rule applies to.
type: keyword
-
googlecloud.firewall.rule_details.target_service_account -
List of all the target service accounts that the firewall rule applies to.
type: keyword
vpcflow
editFields for Google Cloud VPC flow logs.
-
googlecloud.vpcflow.reporter -
The side which reported the flow. Can be either SRC or DEST.
type: keyword
-
googlecloud.vpcflow.rtt.ms -
Latency as measured (for TCP flows only) during the time interval. This is the time elapsed between sending a SEQ and receiving a corresponding ACK and it contains the network RTT as well as the application related delay.
type: long
On this page