Include additional Kibana plugins

In certain cases you may choose to expand the Kibana Docker image included in an Elastic Stack pack to include one or more additional plugins that are not bundled in the image by default. Plugins can extend the features included in Kibana, for example to include specialized visualizations. Adding plugins allows you to tailor your ECE deployments that include Kibana to suit your specific use cases.

The process involves two main steps:

Before you begin

edit

Note the following restrictions:

These instructions have been tested for Elastic Stack versions starting with 6.7.0 and may not work for earlier versions.
Plugins that you bundle yourself to be included in the Elastic Stack are not covered by Elastic Customer Support and include no guarantee from Elastic.
After uploading a modified version of an Elastic Stack pack, if you reapply the original stack the changes will be lost and new Kibana instances will use the original Docker image provided by Elastic.
The Dockerfile used in this example includes an optimization process that is relatively expensive and may require a machine with several GB of RAM to run successfully.

Extend a Kibana Docker image to include additional plugins

edit

This example runs a Dockerfile to install the analyze_api_ui plugin or kibana-enhanced-table into different versions of Kibana Docker image. The contents of the Dockerfile varies depending on the version of the Elastic Stack pack that you want to modify.

Choose a directory on your ECE installation and save the Dockerfile code for your Elastic Stack version as a file named Dockerfile.

For Elastic Stack versions 7.11 and higher:

FROM docker.elastic.co/cloud-assets/kibana:7.11.0-0
MAINTAINER Cloud Developers <cloud-pioneer@elastic.co>

RUN /usr/share/kibana/bin/kibana-plugin install https://github.com/fbaligand/kibana-enhanced-table/releases/download/v1.11.1/enhanced-table-1.11.1_7.11.0.zip

For Elastic Stack versions 7.10 and higher:

FROM docker.elastic.co/cloud-assets/kibana:7.10.0-0
MAINTAINER Cloud Developers <cloud-pioneer@elastic.co>

RUN /usr/share/kibana/bin/kibana-plugin install https://github.com/fbaligand/kibana-enhanced-table/releases/download/v1.11.0/enhanced-table-1.11.0_7.10.0.zip --allow-root

For Elastic Stack versions 7.7 and higher:

FROM docker.elastic.co/cloud-assets/kibana:7.7.0-0
MAINTAINER Cloud Developers <cloud-pioneer@elastic.co>

RUN /usr/share/kibana/bin/kibana-plugin install https://github.com/fbaligand/kibana-enhanced-table/releases/download/v1.11.0/enhanced-table-1.11.0_7.7.0.zip --allow-root

# Fuss about with permissions
RUN chown -R kibana:root /usr/share/kibana && \
    find /usr/share/kibana/optimize -type d -perm 755 -exec chmod g+w {} \; && \
    find /usr/share/kibana/optimize -type f -perm 644 -exec chmod g+w {} \;

# Clean up
RUN rm -rf /usr/share/kibana/build && \
    yum clean all && \
    rm -rf /var/cache/yum /tmp/* /var/tmp/*

RUN find / -xdev -perm -4000 -exec chmod u-s {} +

For Elastic Stack versions 7.3 and higher:

FROM docker.elastic.co/cloud-assets/kibana:7.4.0-0
MAINTAINER Cloud Developers <cloud-pioneer@elastic.co>

RUN /kibana/bin/kibana-plugin install https://github.com/johtani/analyze-api-ui-plugin/releases/download/7.4.0/analyze_api_ui-7.4.0.zip --allow-root

# Force kibana to re-optimize
RUN /kibana/bin/kibana --optimize --allow-root

# Fuss about with permissions
RUN chown -R kibana: /kibana && \
    find /kibana/optimize -type d -perm 755 -exec chmod g+w {} \; && \
    find /kibana/optimize -type f -perm 644 -exec chmod g+w {} \;

# Clean up
RUN rm -rf /kibana/build && \
    yum clean all && \
    rm -rf /var/cache/yum /tmp/* /var/tmp/*

RUN find / -xdev -perm -4000 -exec chmod u-s {} +

For Elastic Stack version 7.2:

FROM docker.elastic.co/cloud-assets/kibana:7.2.0-0
MAINTAINER Cloud Developers <cloud-pioneer@elastic.co>

RUN /kibana/bin/kibana-plugin install https://github.com/johtani/analyze-api-ui-plugin/releases/download/7.2.0/analyze_api_ui-7.2.0.zip --allow-root

# Force kibana to reoptimize
RUN /kibana/bin/kibana --allow-root 2>&1 | grep -m1 'No living connections' > /dev/null && \
    rm /kibana/data/uuid

# Fuss about with permissions
RUN chown -R kibana: /kibana && \
    find /kibana/optimize -type d -perm 755 -exec chmod g+w {} \; && \
    find /kibana/optimize -type f -perm 644 -exec chmod g+w {} \;

# Clean up
RUN rm -rf /kibana/build && \
    yum clean all && \
    rm -rf /var/cache/yum /tmp/* /var/tmp/*

RUN find / -xdev -perm -4000 -exec chmod u-s {} +

For Elastic Stack versions 6.7 to 7.1:

FROM docker.elastic.co/cloud-assets/kibana:6.7.0-0
MAINTAINER Cloud Developers <cloud-pioneer@elastic.co>

RUN /kibana/bin/kibana-plugin install https://github.com/johtani/analyze-api-ui-plugin/releases/download/6.7.0/analyze-api-ui-plugin-6.7.0.zip

# Force kibana to reoptimize
RUN /kibana/bin/kibana 2>&1 | grep -m1 'No living connections' > /dev/null && \
    rm /kibana/data/uuid

# Fuss about with permissions
RUN chown -R kibana: /kibana && \
    find /kibana/optimize -type d -perm 755 -exec chmod g+w {} \; && \
    find /kibana/optimize -type f -perm 644 -exec chmod g+w {} \;

# Clean up
RUN rm -rf /kibana/build && \
    apt-get clean && \
    rm -rf /var/lib/apt/lists/* /tmp/* /var/tmp/*

RUN find / -xdev -perm -4000 -exec chmod u-s {} +

Update the Dockerfile for your specific use case by changing these settings:
- The maintainer
- The version of the image
- The plugin name and version number
  
  When you modify a Kibana Docker image, make sure you maintain the original image structure and only add the additional plugins.
Build the modified Docker image, specifying an image name and version number. If you are using your own Docker repository, the docker.elastic.co/cloud-assets section must match your specific configuration. The image build process can take several minutes.
```
docker build . -t docker.elastic.co/cloud-assets/kibana-with-plugin:7.4.0-0
```
If you have your own Docker repository, you can push the modified Docker image to your repository. Otherwise, run the following commands to compress and load the image into Docker:
1. Create a .tar file of the Docker image, specifying the image name and version number:
```
docker save -o kibana.7.4.0-0.tar docker.elastic.co/cloud-assets/kibana-with-plugin:7.4.0-0
```
2. Copy the .tar file to a location on your network where it is available to each ECE host. Alternatively, you can copy the .tar file to each host directly. A third option is to run the previous steps on each host to create the modified Docker image and .tar file.
3. On each host, load the image into Docker, where FILE_PATH is the location of your modified Docker image:
```
docker load < FILE_PATH/kibana.7.4.0-0.tar
```

Modify the Elastic Stack pack to point to your modified image

edit

Follow these steps to update the Elastic Stack pack zip files in your ECE setup to point to your modified Docker image:

Download to a local directory the Elastic Stack pack that you want to modify.

Save the following bash script with the name change-kibana-image.sh:

#!/usr/bin/env bash

set -eo pipefail

# Repack a stackpack to modify the Kibana image it points to

NO_COLOR='\033[0m'
ERROR_COLOR='\033[1;31m'
WARN_COLOR='\033[0;33m'
ERROR="${ERROR_COLOR}[ERROR]${NO_COLOR}"
WARNING="${WARN_COLOR}[WARNING]${NO_COLOR}"

if [[ -z "$1" ]]; then
    echo -e "$ERROR Missing required stackpack argument"
    exit 1
fi

if [[ -z "$2" ]]; then
    echo -e "$ERROR Missing required kibana docker image argument"
    exit 1
fi

STACKPACK=$1
KIBANA_IMAGE=$2

if [[ ! -s "$STACKPACK" ]]; then
    echo -e "$ERROR $STACKPACK: No such stackpack"
    exit 1
fi

TMP_DIR=$(mktemp -d)

TMP_FILE="$TMP_DIR/$(basename "$STACKPACK")"
cp "$STACKPACK" "$TMP_FILE"

pushd "$TMP_DIR" > /dev/null

MANIFEST=$(zipinfo -1 "$TMP_FILE" | grep -E "stack.*\.json")
unzip "$TMP_FILE" "$MANIFEST" > /dev/null

jq ".kibana.docker_image |= \"${KIBANA_IMAGE}\"" "$MANIFEST" > "${MANIFEST}.updated"
mv "${MANIFEST}.updated" "$MANIFEST"
zip "$TMP_FILE" "$MANIFEST" > /dev/null

popd > /dev/null

cp "$TMP_FILE" "$STACKPACK"

rm -rf "$TMP_DIR"

Modify the script permissions so that you can run it:
```
sudo chmod 755 change-kibana-image.sh
```
Run the script to update the Elastic Stack pack, where FILE_PATH is the location where you downloaded the Elastic Stack pack zip file:
```
./change-kibana-image.sh FILE_PATH/7.4.0.zip docker.elastic.co/cloud-assets/kibana-with-plugin:7.4.0-0
```
Upload the modified Elastic Stack pack to your ECE installation:
1. Log into the Cloud UI.
2. Go to Platform and then Elastic Stack.
3. Select Upload Elastic Stack pack to add the new Elastic Stack pack or replace an existing one. You can create a new deployment using the new or updated Elastic stack pack. When you launch Kibana the additional plugin is available.

Common causes of problems

edit

If the custom Docker image is not available, make sure that the image has been uploaded to your Docker repository or loaded locally onto each ECE allocator.
If the container takes a long time to start, the problem might be that the reoptimize step in the Dockerfile did not complete successfully.

« Default instance configurations Manage snapshot repositories »