{"id":30324,"date":"2022-06-19T15:06:19","date_gmt":"2022-06-19T15:06:19","guid":{"rendered":"https:\/\/www.devopsschool.com\/blog\/?p=30324"},"modified":"2025-05-04T06:12:22","modified_gmt":"2025-05-04T06:12:22","slug":"elastic-logstash-what-is-logstash-yml-pipelines-yml-configratuion-file","status":"publish","type":"post","link":"https:\/\/www.devopsschool.com\/blog\/elastic-logstash-what-is-logstash-yml-pipelines-yml-configratuion-file\/","title":{"rendered":"Elastic Logstash: what is logstash.yml &#038; pipelines.yml &#038; configratuion file?"},"content":{"rendered":"\n<p>Logstash has two types of configuration files:&nbsp;<em>pipeline configuration files<\/em>, which define the Logstash processing pipeline, and&nbsp;<em>settings files<\/em>, which specify options that control Logstash startup and execution.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Pipeline Configuration Files<\/h3>\n\n\n\n<p>You create pipeline configuration files when you define the stages of your Logstash processing pipeline. On deb and rpm, you place the pipeline configuration files in the\u00a0<code>\/etc\/logstash\/conf.d<\/code>\u00a0directory. Logstash tries to load only files with\u00a0<code><strong><span style=\"text-decoration: underline;\">.conf<\/span><\/strong><\/code>\u00a0extension in the\u00a0<code>\/etc\/logstash\/conf.d directory<\/code>\u00a0and ignores all other files.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Settings Files<\/h3>\n\n\n\n<p>The settings files are already defined in the Logstash installation. Logstash includes the following settings files:<\/p>\n\n\n\n<p><strong><code>logstash.yml<\/code><\/strong><\/p>\n\n\n\n<p>Contains Logstash configuration flags. You can set flags in this file instead of passing the flags at the command line. Any flags that you set at the command line override the corresponding settings in the&nbsp;<code>logstash.yml<\/code>&nbsp;file. See&nbsp;<a href=\"https:\/\/www.elastic.co\/guide\/en\/logstash\/current\/logstash-settings-file.html\" target=\"_blank\" rel=\"noopener\">logstash.yml<\/a>&nbsp;for more info.<\/p>\n\n\n\n<p><strong><code>pipelines.yml<\/code><\/strong><\/p>\n\n\n\n<p>Contains the framework and instructions for running multiple pipelines in a single Logstash instance. See&nbsp;<a href=\"https:\/\/www.elastic.co\/guide\/en\/logstash\/current\/multiple-pipelines.html\" target=\"_blank\" rel=\"noopener\">Multiple Pipelines<\/a>&nbsp;for more info.<\/p>\n\n\n\n<p><strong><code>jvm.options<\/code><\/strong><\/p>\n\n\n\n<p>Contains JVM configuration flags. Use this file to set initial and maximum values for total heap space. You can also use this file to set the locale for Logstash. Specify each flag on a separate line. All other settings in this file are considered expert settings.<\/p>\n\n\n\n<p><strong><code>log4j2.properties<\/code><\/strong><\/p>\n\n\n\n<p>Contains default settings for&nbsp;<code>log4j 2<\/code>&nbsp;library.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Logstash has two types of configuration files:&nbsp;pipeline configuration files, which define the Logstash processing pipeline, and&nbsp;settings files, which specify options that control Logstash startup and execution. Pipeline Configuration Files You&#8230; <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_joinchat":[],"footnotes":""},"categories":[5936],"tags":[],"class_list":["post-30324","post","type-post","status-publish","format-standard","hentry","category-elastic"],"_links":{"self":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/30324","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/comments?post=30324"}],"version-history":[{"count":2,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/30324\/revisions"}],"predecessor-version":[{"id":30326,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/30324\/revisions\/30326"}],"wp:attachment":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media?parent=30324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/categories?post=30324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/tags?post=30324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}