Commit Graph

375 Commits

Author SHA1 Message Date
dependabot[bot] 84e37a221f
chore(deps): Bump peter-evans/create-pull-request from 3 to 4 (#718) 2022-05-29 08:17:12 +00:00
dependabot[bot] de90bd06b4
chore(deps): Bump actions/setup-node from 2 to 3 (#719) 2022-05-29 08:17:09 +00:00
dependabot[bot] 0319b7e128
chore(deps): Bump actions/github-script from 5 to 6 (#720) 2022-05-29 08:17:07 +00:00
Antoine Cotten 66ff963e0a
ci: Let Dependabot update GitHub actions 2022-05-29 10:08:19 +02:00
docker-elk-updater[bot] 3e2230e09a
Update to v8.2.2 2022-05-29 00:24:41 +00:00
Antoine Cotten 9fd8a09f0d
ci: Use GitHub runner based on Ubuntu 22.04
Includes Compose v2. See the full list of included software at
https://github.com/actions/virtual-environments/blob/ubuntu22/20220522.1/images/linux/Ubuntu2204-Readme.md
2022-05-25 22:35:55 +02:00
Antoine Cotten 1557e27bff
doc: Render notes and warnings using GitHub admonitions
https://github.com/github/feedback/discussions/16925
2022-05-21 12:14:56 +02:00
Antoine Cotten 4319be7cd0
fix: Revert removal of -Xms JVM option
Logstash has '-Xms1g' set inside 'config/jvm.options', so either -Xms
must be set, or -Xmx must be greater than 1g (which is too high of a
default for docker-elk).

Elastic explicitly recommends setting -Xms and -Xmx to the same value
for Elasticsearch:
  https://www.elastic.co/guide/en/elasticsearch/reference/8.2/advanced-configuration.html#set-jvm-heap-size
2022-05-16 21:29:08 +02:00
Antoine Cotten 239099874a
chore: Raise max heap size of Elasticsearch to 512 MB
This value should be a sane default. Modern versions require more
resources, and nowadays any consumer hardware should be able to have
access to this amount of memory.

Additionally, do not set a lower bound on the heap size, so that unused
space isn't unnecessarily committed to the JVM.
2022-05-16 20:53:17 +02:00
docker-elk-updater[bot] 164588d301
Update to v8.2.0 2022-05-08 00:25:12 +00:00
docker-elk-updater[bot] 5d844f3c91
Update to v8.1.3 2022-04-24 00:23:56 +00:00
docker-elk-updater[bot] d9d43c2a40
Update to v8.1.2 2022-04-03 00:21:55 +00:00
docker-elk-updater[bot] 2ec05d65b2
Update to v8.1.1 2022-03-27 00:22:47 +00:00
docker-elk-updater[bot] 0f5dcf1d70
Update to v8.1.0 2022-03-13 08:10:50 +00:00
Antoine Cotten 1f26484b61
doc: Mention support for Compose V2
Closes #684
2022-03-12 17:25:20 +01:00
Antoine Cotten 12dc0a4b74
Revert "ci: Pin Compose version to v2.2.3"
This reverts commit 897720fa91.

A new version of Compose was released, with a fix for the issue we were
encountering.
2022-03-09 01:57:19 +01:00
Antoine Cotten 4fe6f68339
ci: Update list of auto-mergeable branch names 2022-03-06 11:07:29 +01:00
Antoine Cotten 488a88b4ca
doc: Revert in-paragraph string replacement by update bot 2022-03-06 11:02:29 +01:00
docker-elk-updater[bot] 21aa0ce9af
Update to v8.0.1 2022-03-06 10:00:13 +00:00
Antoine Cotten 897720fa91
ci: Pin Compose version to v2.2.3
v2.3.0 introduced a regression which causes the test CI workflow to
fail: https://github.com/docker/compose/issues/9234
2022-03-06 10:28:48 +01:00
Antoine Cotten 82b1e653b0
fix(logstash): Adjust role for ECS compatibility
'ecs_compatibility' is now on by default, therefore Logstash indices are
created with the naming pattern "ecs-logstash-*" when data streams are
disabled ('data_stream => false').
2022-03-02 17:13:24 +01:00
Antoine Cotten 02dabf6fb1
fix(logstash): Allow managing "logstash" index
When data streams are disabled in Logstash's "elasticsearch" output
('data_stream => false'), Logstash falls back to managing "logstash-*"
indices and creates an index template with ILM enabled.
In this process, a write index for the alias "logstash" is created. This
step requires the "manage" privilege on the "logstash" alias.

Fixes #679
2022-03-02 17:13:16 +01:00
Antoine Cotten 159c934ad2
doc: Bump minimum Compose version requirement to 1.26.0
Prior to this version, surrounding quotes (single and double) were
preserved in values coming from the '.env' file, which is counter
intuitive and goes against the recommended practice of quoting values
containing special characters, such as passwords.

Closes #677
2022-02-28 15:33:50 +01:00
Antoine Cotten 9a52c6cf5f
chore: Update animated demo for v8.0.0 2022-02-28 12:03:18 +01:00
Antoine Cotten 924a1e5987
chore: Update Compose file version to 3.7
Allows enabling the 'init' option in the 'setup' service.

Requires Docker 18.06.0 and Compose 1.22.0.
2022-02-28 09:50:52 +01:00
Antoine Cotten a204596be7
fix: Explicitly make entrypoint of 'setup' service executable
The existing executable permission might not be preserved when users
download docker-elk as a Zip file.

Fixes #676
2022-02-28 09:46:27 +01:00
Antoine Cotten eb1c6fa27e
chore: Rename ELK_VERSION to ELASTIC_VERSION
More appropriate name considering that extensions, which aren't part of
the "ELK" stack, also rely on this variable.
2022-02-28 09:10:30 +01:00
Antoine Cotten 0a9c3ebd2c
doc: Update "Philosophy" section to reflect latest changes
We do use a small amount of custom setup automation now.
2022-02-28 09:02:44 +01:00
Antoine Cotten 9877b39900
Automate management of required roles and user passwords (#671) 2022-02-21 11:19:43 +01:00
Antoine Cotten 641290c20a
Apply SELinux options to bind mounts
https://docs.docker.com/storage/bind-mounts/

Related to #639
Closes #661
2022-02-11 20:11:22 +01:00
Antoine Cotten a82e95d94e
doc: Provide examples of config overrides via env vars 2022-02-11 19:51:43 +01:00
Antoine Cotten ca98168da1
Quote passwords to prevent interpreting leading special chars
Closes #667
2022-02-11 19:10:58 +01:00
Antoine Cotten b77b7fb66a
fix: Swap flag with service name in Compose command
Related to #667
2022-02-11 19:10:58 +01:00
Antoine Cotten 370ebbfaf4
doc: Update "Initial Setup" section for v8.0.0
Starting with Elastic v8.0.0, it is no longer possible to run Kibana
using the bootstraped privileged `elastic` user.

Closes #666
2022-02-11 14:48:00 +01:00
Antoine Cotten 33a96e571a
es: Remove deprecated monitoring setting 2022-02-10 19:56:19 +01:00
Antoine Cotten 6704d9f1d7
Update to v8.0.0 (#544)
List of changes impacting docker-elk:

- [logstash]: The output to Elasticsearch is handled as a data stream.

  Starting with v8.0.0, the `elasticsearch` output for Logstash sends
  log data to a data stream instead of `logstash-*` indices by default.
  The name of the default data stream is `logs-generic-default`.
  docker-elk remains unopinionated and simply uses Elastic's defaults
  like it always has, so users who prefer to retain the old behaviour
  need to explicitly opt-out of data streams in their Logstash
  pipelines.

  Refs:
  - https://www.elastic.co/guide/en/elasticsearch/reference/current/data-streams.html
  - https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-data-streams

- [logstash]: The (legacy) monitoring data collection is now disabled.

  This feature was deprecated since v7.9.0, and removed in v8.0.0.

  Ref: https://www.elastic.co/guide/en/logstash/current/monitoring-internal-collection-legacy.html

- [kibana]: An index pattern for `logs-*` indices is automatically
  created.

  It used to be required to manually create an index pattern for indices
  managed by Logstash, even when using the default Logstash indices.
  This is no longer the case since the output data is now being handled
  as a data stream, and Kibana automatically creates index patterns for
  these.

- [elasticsearch]: The command line tool `elasticsearch-setup-passwords`
  was deprecated in favour of a new `elasticsearch-reset-password` tool.

  Passwords for built-in users must now be generated one by one.

  Ref: https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-passwords.html

- [enterprise-search]: Kibana is now the new management interface, and
  the only one available moving forward.

  The old standalone Enterprise Search interface was removed in v8.0.0.

  Ref: https://www.elastic.co/guide/en/enterprise-search/current/user-interfaces.html
2022-02-10 17:19:04 +01:00
Antoine Cotten 3882ce97e1
doc: Update links to Legacy APM Server Reference 2022-02-04 15:44:55 +01:00
docker-elk-updater[bot] 1a30af6e11
Update to v7.17.0 2022-02-04 14:37:42 +00:00
docker-elk-updater[bot] ff35064836
Update to v7.16.3 2022-01-16 00:20:34 +00:00
Antoine Cotten 3ce7fc0ae3
ci: Fix race condition while checking container IP
Be resilient and recheck the container's status if its IP address
couldn't be determined on the first attempt.
2021-12-28 20:16:54 +01:00
docker-elk-updater[bot] 691ffd8764
Update to v7.16.2 2021-12-20 16:01:32 +00:00
docker-elk-updater[bot] c7f4a8eac0
Update to v7.16.1 2021-12-13 16:18:54 +00:00
docker-elk-updater[bot] 4e6c8712fe
Update to v7.16.0 2021-12-12 11:30:14 +00:00
Antoine Cotten 1815972838
Add Filebeat extension 2021-12-04 02:17:41 +01:00
Yuri Pereira Constante 01a0cf94d5
Podman and SELinux compatible volume declaration (#639) 2021-11-29 09:28:17 +01:00
Antoine Cotten e6f9ec49d2
ci: Delete branch after successful Elastic update merge 2021-11-11 19:08:42 +01:00
docker-elk-updater[bot] 8055143d52
Update to v7.15.2 2021-11-11 14:36:47 +00:00
Antoine Cotten 9a523626ef
ci: Automatically merge bot PRs for Elastic updates
Merges pull requests from docker-elk-updater[bot] if CI checks pass.
2021-11-09 02:54:27 +01:00
Antoine Cotten 6f8117e2d8
doc: Increase resolution of animated demo, compress GIF 2021-11-07 11:46:55 +01:00
Antoine Cotten e8d16db9b6
doc: Add animated demo to README 2021-11-06 20:38:49 +01:00