URL Fields

edit

URL fields provide support for complete or partial URLs, and supports the breaking down into scheme, domain, path, and so on.

URL Field Details

edit
Field Description Level

url.domain

Domain of the url, such as "www.elastic.co".

In some cases a URL may refer to an IP and/or port directly, without a domain name. In this case, the IP address would go to the domain field.

If the URL contains a literal IPv6 address enclosed by [ and ] (IETF RFC 2732), the [ and ] characters should also be captured in the domain field.

type: keyword

example: www.elastic.co

OTel Badge relation url.domain

extended

url.extension

The field contains the file extension from the original request url, excluding the leading dot.

The file extension is only set if it exists, as not every url has a file extension.

The leading period must not be included. For example, the value must be "png", not ".png".

Note that when the file name has multiple extensions (example.tar.gz), only the last one should be captured ("gz", not "tar.gz").

type: keyword

example: png

OTel Badge relation url.extension

extended

url.fragment

Portion of the url after the #, such as "top".

The # is not part of the fragment.

type: keyword

OTel Badge relation url.fragment

extended

url.full

If full URLs are important to your use case, they should be stored in url.full, whether this field is reconstructed or present in the event source.

type: wildcard

Multi-fields:

  • url.full.text (type: match_only_text)

example: https://www.elastic.co:443/search?q=elasticsearch#top

OTel Badge relation url.full

extended

url.original

Unmodified original url as seen in the event source.

Note that in network monitoring, the observed URL may be a full URL, whereas in access logs, the URL is often just represented as a path.

This field is meant to represent the URL as it was observed, complete or not.

type: wildcard

Multi-fields:

  • url.original.text (type: match_only_text)

example: https://www.elastic.co:443/search?q=elasticsearch#top or /search?q=elasticsearch

OTel Badge relation url.original

extended

url.password

Password of the request.

type: keyword

extended

url.path

Path of the request, such as "/search".

type: wildcard

OTel Badge relation url.path

extended

url.port

Port of the request, such as 443.

type: long

example: 443

OTel Badge relation url.port

extended

url.query

The query field describes the query string of the request, such as "q=elasticsearch".

The ? is excluded from the query string. If a URL contains no ?, there is no query field. If there is a ? but no query, the query field exists with an empty string. The exists query can be used to differentiate between the two cases.

type: keyword

OTel Badge relation url.query

extended

url.registered_domain

The highest registered url domain, stripped of the subdomain.

For example, the registered domain for "foo.example.com" is "example.com".

This value can be determined precisely with a list like the public suffix list (http://publicsuffix.org). Trying to approximate this by simply taking the last two labels will not work well for TLDs such as "co.uk".

type: keyword

example: example.com

OTel Badge relation url.registered_domain

extended

url.scheme

Scheme of the request, such as "https".

Note: The : is not part of the scheme.

type: keyword

example: https

OTel Badge relation url.scheme

extended

url.subdomain

The subdomain portion of a fully qualified domain name includes all of the names except the host name under the registered_domain. In a partially qualified domain, or if the the qualification level of the full name cannot be determined, subdomain contains all of the names below the registered domain.

For example the subdomain portion of "www.east.mydomain.co.uk" is "east". If the domain has multiple levels of subdomain, such as "sub2.sub1.example.com", the subdomain field should contain "sub2.sub1", with no trailing period.

type: keyword

example: east

OTel Badge relation url.subdomain

extended

url.top_level_domain

The effective top level domain (eTLD), also known as the domain suffix, is the last part of the domain name. For example, the top level domain for example.com is "com".

This value can be determined precisely with a list like the public suffix list (http://publicsuffix.org). Trying to approximate this by simply taking the last label will not work well for effective TLDs such as "co.uk".

type: keyword

example: co.uk

OTel Badge relation url.top_level_domain

extended

url.username

Username of the request.

type: keyword

extended

Field Reuse

edit

The url fields are expected to be nested at:

  • threat.enrichments.indicator.url
  • threat.indicator.url

Note also that the url fields may be used directly at the root of the events.