Configuring the ELK stack for logging and dashboards.
For development, we use a the combined ELK stack image which contains Elastic, Logstash, and KIbana in one image.
The default docker-compose.yml file contains most of the required configuration, with the exception of some configuration required for the elastic portion and the kibana portion.
Elastic specific configuration is in the elasticsearch.yml file. In the dev environment, this is done via /open-mdm/docker/elk/elasticsearch.yml, currently the changes to the file from the defaults are:
- action.auto_create_index: -mdm-* This is added to disallow the creation if indices on the fly, forcing mdm's logging system to create the index definition with the appropriate mappings. This may change if templates are used for the mappings, depending on how we choose to handle changes when future versions roll out.
Kibana specific configuration is in the kibana.yml file.
- elasticsearch.url: http://elk:9200 This is added to force kibana to go back through the oauth proxy for hits to elastic, instead of the default of localhost. Elk is the name of the oauth proxy in front of elk-backend, which is the actual combined ELK image.