{"id":31261,"date":"2023-09-14T08:53:39","date_gmt":"2023-09-14T08:53:39","guid":{"rendered":"https:\/\/www.devopsschool.com\/blog\/?p=31261"},"modified":"2023-09-14T08:53:42","modified_gmt":"2023-09-14T08:53:42","slug":"datadog-tutorials-log-collection-process-configuration","status":"publish","type":"post","link":"https:\/\/www.devopsschool.com\/blog\/datadog-tutorials-log-collection-process-configuration\/","title":{"rendered":"Datadog Tutorials: Log Collection &#038; configuration using Datadog Agent"},"content":{"rendered":"\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">How to enable Log collection in Datadog?<\/h2>\n\n\n\n<p>To enable log collection with an Agent running on your host, change logs_enabled: false to logs_enabled: true in the Agent\u2019s main configuration file (datadog.yaml).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"500\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-1024x500.png\" alt=\"\" class=\"wp-image-31262\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-1024x500.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-300x146.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-768x375.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28.png 1082w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Custom Log Collection in Datadog<\/h2>\n\n\n\n<p>Datadog Agent v6 can collect logs and forward them to Datadog from files, the network (TCP or UDP), journald, and Windows channels:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Create a new&nbsp;<code>&lt;CUSTOM_LOG_SOURCE&gt;.d\/<\/code>&nbsp;folder in the&nbsp;<code>conf.d\/<\/code>&nbsp;directory at the root of your&nbsp;<a href=\"https:\/\/docs.datadoghq.com\/agent\/guide\/agent-configuration-files\/\">Agent\u2019s configuration directory<\/a>.<\/li>\n\n\n\n<li>Create a new&nbsp;<code>conf.yaml<\/code>&nbsp;file in this new folder.<\/li>\n\n\n\n<li>Add a custom log collection configuration group with the parameters below.<\/li>\n\n\n\n<li><a href=\"https:\/\/docs.datadoghq.com\/agent\/guide\/agent-commands\/#restart-the-agent\">Restart your Agent<\/a>&nbsp;to take into account this new configuration.<\/li>\n\n\n\n<li>Run the&nbsp;<a href=\"https:\/\/docs.datadoghq.com\/agent\/guide\/agent-commands\/#agent-status-and-information\">Agent\u2019s status subcommand<\/a>&nbsp;and look for&nbsp;<code>&lt;CUSTOM_LOG_SOURCE&gt;<\/code>&nbsp;under the Checks section.<\/li>\n<\/ol>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type in Datadog<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"673\" height=\"166\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-29.png\" alt=\"\" class=\"wp-image-31263\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-29.png 673w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-29-300x74.png 300w\" sizes=\"auto, (max-width: 673px) 100vw, 673px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: File<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"501\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-1024x501.png\" alt=\"\" class=\"wp-image-31264\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-1024x501.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-300x147.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-768x376.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30.png 1045w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: TCP\/UDP<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"561\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-1024x561.png\" alt=\"\" class=\"wp-image-31265\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-1024x561.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-300x164.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-768x420.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31.png 1054w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: journald<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"375\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-1024x375.png\" alt=\"\" class=\"wp-image-31266\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-1024x375.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-300x110.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-768x281.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32.png 1060w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: Windows Events<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"958\" height=\"445\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33.png\" alt=\"\" class=\"wp-image-31267\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33.png 958w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33-300x139.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33-768x357.png 768w\" sizes=\"auto, (max-width: 958px) 100vw, 958px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"538\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-1024x538.png\" alt=\"\" class=\"wp-image-31268\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-1024x538.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-300x158.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-768x403.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34.png 1051w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-1\" data-shcb-language-name=\"PHP\" data-shcb-language-slug=\"php\"><span><code class=\"hljs language-php\">- Install the Datadog Agent\n\n- Verify Datadog Agent Status <span class=\"hljs-keyword\">and<\/span> Look <span class=\"hljs-keyword\">for<\/span> <span class=\"hljs-string\">\"Logs Agent\"<\/span> which is not running.\n$ sudo datadog-agent status\n\n- Enable log collection\nTo enable log collection with the Agent, edit the datadog.yaml configuration file located at \/etc\/datadog-agent\/datadog.yaml <span class=\"hljs-keyword\">and<\/span> set logs_enabled:<span class=\"hljs-keyword\">true<\/span>\n\n- Monitor a custom file\n\n$ sudo mkdir \/etc\/datadog-agent\/conf.d\/custom_log_collection.d\/\n$ sudo vi \/etc\/datadog-agent\/conf.d\/custom_log_collection.d\/conf.yaml\nlogs:\n    - type: file\n      path: \/<span class=\"hljs-keyword\">var<\/span>\/log\/syslog\n      source: syslog\n      service: syslog\n$ sudo service datadog-agent restart\n\n-  Validation. Verify \n$ sudo datadog-agent status\nDatadog Agent Status <span class=\"hljs-keyword\">and<\/span> Look <span class=\"hljs-keyword\">for<\/span> <span class=\"hljs-string\">\"Logs Agent\"<\/span> which is running.\n$ chmod -R <span class=\"hljs-number\">755<\/span> \/<span class=\"hljs-keyword\">var<\/span>\/log\/\n$ datadog-agent status<\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-1\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">PHP<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">php<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"709\" height=\"601\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-369.png\" alt=\"\" class=\"wp-image-39768\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-369.png 709w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-369-300x254.png 300w\" sizes=\"auto, (max-width: 709px) 100vw, 709px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"459\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-1024x459.png\" alt=\"\" class=\"wp-image-39769\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-1024x459.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-300x135.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-768x344.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-1536x689.png 1536w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370.png 1806w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>How to enable Log collection in Datadog? To enable log collection with an Agent running on your host, change logs_enabled: false to logs_enabled: true in the Agent\u2019s&#8230; <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_joinchat":[],"footnotes":""},"categories":[2],"tags":[],"class_list":["post-31261","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"_links":{"self":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31261","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/comments?post=31261"}],"version-history":[{"count":6,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31261\/revisions"}],"predecessor-version":[{"id":39771,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31261\/revisions\/39771"}],"wp:attachment":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media?parent=31261"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/categories?post=31261"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/tags?post=31261"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}