{"id":31006,"date":"2022-08-11T20:31:47","date_gmt":"2022-08-11T20:31:47","guid":{"rendered":"https:\/\/www.devopsschool.com\/blog\/?p=31006"},"modified":"2025-05-04T06:12:22","modified_gmt":"2025-05-04T06:12:22","slug":"how-to-configure-elastic-filebeat-8-3-with-elasticseach","status":"publish","type":"post","link":"https:\/\/www.devopsschool.com\/blog\/how-to-configure-elastic-filebeat-8-3-with-elasticseach\/","title":{"rendered":"How to configure Elastic filebeat 8.3 with Elasticseach?"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Step 1 &#8211; Download a file beat pacage<\/h2>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-1\" data-shcb-language-name=\"JavaScript\" data-shcb-language-slug=\"javascript\"><span><code class=\"hljs language-javascript\">$ cd \/opt\r\n$ yum install wget -y\r\n$ wget https:<span class=\"hljs-comment\">\/\/artifacts.elastic.co\/downloads\/beats\/filebeat\/filebeat-8.3.3-linux-x86_64.tar.gz<\/span>\r\n$ tar -zxvf filebeat<span class=\"hljs-number\">-8.3<\/span><span class=\"hljs-number\">.3<\/span>-linux-x86_64.tar.gz\r\n$ cd filebeat<span class=\"hljs-number\">-8.3<\/span><span class=\"hljs-number\">.3<\/span>-linux-x86_64<\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-1\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">JavaScript<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">javascript<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<h2 class=\"wp-block-heading\">Step 2 &#8211; Configure input in filebeat.yml<\/h2>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-2\" data-shcb-language-name=\"PHP\" data-shcb-language-slug=\"php\"><span><code class=\"hljs language-php\"><span class=\"hljs-comment\"># Each - is an input. Most options can be set at the input level, so<\/span>\r\n<span class=\"hljs-comment\"># you can use different inputs for various configurations.<\/span>\r\n<span class=\"hljs-comment\"># Below are the input specific configurations.<\/span>\r\n\r\n<span class=\"hljs-comment\"># filestream is an input for collecting log messages from files.<\/span>\r\n- type: filestream\r\n\r\n  <span class=\"hljs-comment\"># Unique ID among all inputs, an ID is required.<\/span>\r\n  id: my-filestream-id\r\n\r\n  <span class=\"hljs-comment\"># Change to true to enable this input configuration.<\/span>\r\n  enabled: <span class=\"hljs-keyword\">true<\/span>\r\n\r\n  <span class=\"hljs-comment\"># Paths that should be crawled and fetched. Glob based paths.<\/span>\r\n  paths:\r\n    - \/<span class=\"hljs-keyword\">var<\/span>\/log<span class=\"hljs-comment\">\/*.log\r\n    #- c:\\programdata\\elasticsearch\\logs\\*<\/span><\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-2\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">PHP<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">php<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"457\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/08\/filebeat-input-1024x457.jpg\" alt=\"\" class=\"wp-image-31009\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/08\/filebeat-input-1024x457.jpg 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/08\/filebeat-input-300x134.jpg 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/08\/filebeat-input-768x343.jpg 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/08\/filebeat-input.jpg 1426w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Step 3 &#8211; Configure output in filebeat.yml<\/h2>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-3\" data-shcb-language-name=\"JavaScript\" data-shcb-language-slug=\"javascript\"><span><code class=\"hljs language-javascript\">output.elasticsearch:\r\n  hosts: &#91;<span class=\"hljs-string\">\"https:\/\/172.18.0.2:9200\"<\/span>]\r\n  <span class=\"hljs-attr\">username<\/span>: <span class=\"hljs-string\">\"elastic\"<\/span>\r\n  <span class=\"hljs-attr\">password<\/span>: <span class=\"hljs-string\">\"qgWrZ8dzJtp*nB4HLIHZ\"<\/span> \r\n  <span class=\"hljs-attr\">ssl<\/span>:\r\n    enabled: <span class=\"hljs-literal\">true<\/span>\r\n    <span class=\"hljs-attr\">ca_trusted_fingerprint<\/span>: <span class=\"hljs-string\">\"069dd4ec9161d86b6299a2823c1f66c5c7a1afd47550c8521bb07e6e0c4cf329\"<\/span> <\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-3\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">JavaScript<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">javascript<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<h2 class=\"wp-block-heading\">Step 4 &#8211; Configure Kibana in filebeat.yml<\/h2>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-4\" data-shcb-language-name=\"JavaScript\" data-shcb-language-slug=\"javascript\"><span><code class=\"hljs language-javascript\">  setup.kibana:\r\n    host: <span class=\"hljs-string\">\"172.18.0.3:5601\"<\/span> \r\n    <span class=\"hljs-attr\">username<\/span>: <span class=\"hljs-string\">\"elastic\"<\/span>  \r\n    <span class=\"hljs-attr\">password<\/span>: <span class=\"hljs-string\">\"{qgWrZ8dzJtp*nB4HLIHZ}\"<\/span><\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-4\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">JavaScript<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">javascript<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<h2 class=\"wp-block-heading\">Step 5 &#8211; To test your configuration file<\/h2>\n\n\n<pre class=\"wp-block-code\"><span><code class=\"hljs\">$ .\/filebeat test config -e<\/code><\/span><\/pre>\n\n\n<h2 class=\"wp-block-heading\">Step 6 &#8211; Setup Assets<\/h2>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-5\" data-shcb-language-name=\"JavaScript\" data-shcb-language-slug=\"javascript\"><span><code class=\"hljs language-javascript\">Filebeat comes <span class=\"hljs-keyword\">with<\/span> predefined assets <span class=\"hljs-keyword\">for<\/span> parsing, indexing, and visualizing your data. To load these assets:\r\n$ .\/filebeat setup -e<\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-5\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">JavaScript<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">javascript<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<h2 class=\"wp-block-heading\">Step 7 &#8211; Start the filebeat daemon<\/h2>\n\n\n<pre class=\"wp-block-code\"><span><code class=\"hljs\">$ sudo chown root filebeat.yml \r\n$ sudo .\/filebeat -e -c filebeat.yml\r\n<\/code><\/span><\/pre>","protected":false},"excerpt":{"rendered":"<p>Step 1 &#8211; Download a file beat pacage Step 2 &#8211; Configure input in filebeat.yml Step 3 &#8211; Configure output in filebeat.yml Step 4 &#8211; Configure Kibana in filebeat.yml Step 5 &#8211; To test your configuration file Step 6 &#8211; Setup Assets Step 7 &#8211; Start the filebeat daemon<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_joinchat":[],"footnotes":""},"categories":[5936],"tags":[],"class_list":["post-31006","post","type-post","status-publish","format-standard","hentry","category-elastic"],"_links":{"self":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31006","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/comments?post=31006"}],"version-history":[{"count":2,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31006\/revisions"}],"predecessor-version":[{"id":31010,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31006\/revisions\/31010"}],"wp:attachment":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media?parent=31006"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/categories?post=31006"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/tags?post=31006"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}