{"id":31261,"date":"2023-09-14T08:53:39","date_gmt":"2023-09-14T08:53:39","guid":{"rendered":"https:\/\/www.devopsschool.com\/blog\/?p=31261"},"modified":"2023-09-14T08:53:42","modified_gmt":"2023-09-14T08:53:42","slug":"datadog-tutorials-log-collection-process-configuration","status":"publish","type":"post","link":"https:\/\/www.devopsschool.com\/blog\/datadog-tutorials-log-collection-process-configuration\/","title":{"rendered":"Datadog Tutorials: Log Collection &#038; configuration using Datadog Agent"},"content":{"rendered":"\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">How to enable Log collection in Datadog?<\/h2>\n\n\n\n<p>To enable log collection with an Agent running on your host, change logs_enabled: false to logs_enabled: true in the Agent\u2019s main configuration file (datadog.yaml).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"500\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-1024x500.png\" alt=\"\" class=\"wp-image-31262\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-1024x500.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-300x146.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28-768x375.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-28.png 1082w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Custom Log Collection in Datadog<\/h2>\n\n\n\n<p>Datadog Agent v6 can collect logs and forward them to Datadog from files, the network (TCP or UDP), journald, and Windows channels:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Create a new&nbsp;<code>&lt;CUSTOM_LOG_SOURCE&gt;.d\/<\/code>&nbsp;folder in the&nbsp;<code>conf.d\/<\/code>&nbsp;directory at the root of your&nbsp;<a href=\"https:\/\/docs.datadoghq.com\/agent\/guide\/agent-configuration-files\/\" target=\"_blank\" rel=\"noopener\">Agent\u2019s configuration directory<\/a>.<\/li>\n\n\n\n<li>Create a new&nbsp;<code>conf.yaml<\/code>&nbsp;file in this new folder.<\/li>\n\n\n\n<li>Add a custom log collection configuration group with the parameters below.<\/li>\n\n\n\n<li><a href=\"https:\/\/docs.datadoghq.com\/agent\/guide\/agent-commands\/#restart-the-agent\" target=\"_blank\" rel=\"noopener\">Restart your Agent<\/a>&nbsp;to take into account this new configuration.<\/li>\n\n\n\n<li>Run the&nbsp;<a href=\"https:\/\/docs.datadoghq.com\/agent\/guide\/agent-commands\/#agent-status-and-information\" target=\"_blank\" rel=\"noopener\">Agent\u2019s status subcommand<\/a>&nbsp;and look for&nbsp;<code>&lt;CUSTOM_LOG_SOURCE&gt;<\/code>&nbsp;under the Checks section.<\/li>\n<\/ol>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type in Datadog<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"673\" height=\"166\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-29.png\" alt=\"\" class=\"wp-image-31263\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-29.png 673w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-29-300x74.png 300w\" sizes=\"auto, (max-width: 673px) 100vw, 673px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: File<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"501\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-1024x501.png\" alt=\"\" class=\"wp-image-31264\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-1024x501.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-300x147.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30-768x376.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-30.png 1045w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: TCP\/UDP<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"561\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-1024x561.png\" alt=\"\" class=\"wp-image-31265\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-1024x561.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-300x164.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31-768x420.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-31.png 1054w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: journald<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"375\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-1024x375.png\" alt=\"\" class=\"wp-image-31266\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-1024x375.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-300x110.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32-768x281.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-32.png 1060w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Log Type: Windows Events<\/h2>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"958\" height=\"445\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33.png\" alt=\"\" class=\"wp-image-31267\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33.png 958w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33-300x139.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-33-768x357.png 768w\" sizes=\"auto, (max-width: 958px) 100vw, 958px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"538\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-1024x538.png\" alt=\"\" class=\"wp-image-31268\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-1024x538.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-300x158.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34-768x403.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2022\/09\/image-34.png 1051w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n<pre class=\"wp-block-code\" aria-describedby=\"shcb-language-1\" data-shcb-language-name=\"PHP\" data-shcb-language-slug=\"php\"><span><code class=\"hljs language-php\">- Install the Datadog Agent\n\n- Verify Datadog Agent Status <span class=\"hljs-keyword\">and<\/span> Look <span class=\"hljs-keyword\">for<\/span> <span class=\"hljs-string\">\"Logs Agent\"<\/span> which is not running.\n$ sudo datadog-agent status\n\n- Enable log collection\nTo enable log collection with the Agent, edit the datadog.yaml configuration file located at \/etc\/datadog-agent\/datadog.yaml <span class=\"hljs-keyword\">and<\/span> set logs_enabled:<span class=\"hljs-keyword\">true<\/span>\n\n- Monitor a custom file\n\n$ sudo mkdir \/etc\/datadog-agent\/conf.d\/custom_log_collection.d\/\n$ sudo vi \/etc\/datadog-agent\/conf.d\/custom_log_collection.d\/conf.yaml\nlogs:\n    - type: file\n      path: \/<span class=\"hljs-keyword\">var<\/span>\/log\/syslog\n      source: syslog\n      service: syslog\n$ sudo service datadog-agent restart\n\n-  Validation. Verify \n$ sudo datadog-agent status\nDatadog Agent Status <span class=\"hljs-keyword\">and<\/span> Look <span class=\"hljs-keyword\">for<\/span> <span class=\"hljs-string\">\"Logs Agent\"<\/span> which is running.\n$ chmod -R <span class=\"hljs-number\">755<\/span> \/<span class=\"hljs-keyword\">var<\/span>\/log\/\n$ datadog-agent status<\/code><\/span><small class=\"shcb-language\" id=\"shcb-language-1\"><span class=\"shcb-language__label\">Code language:<\/span> <span class=\"shcb-language__name\">PHP<\/span> <span class=\"shcb-language__paren\">(<\/span><span class=\"shcb-language__slug\">php<\/span><span class=\"shcb-language__paren\">)<\/span><\/small><\/pre>\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"709\" height=\"601\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-369.png\" alt=\"\" class=\"wp-image-39768\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-369.png 709w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-369-300x254.png 300w\" sizes=\"auto, (max-width: 709px) 100vw, 709px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"459\" src=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-1024x459.png\" alt=\"\" class=\"wp-image-39769\" srcset=\"https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-1024x459.png 1024w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-300x135.png 300w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-768x344.png 768w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370-1536x689.png 1536w, https:\/\/www.devopsschool.com\/blog\/wp-content\/uploads\/2023\/09\/image-370.png 1806w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>How to enable Log collection in Datadog? To enable log collection with an Agent running on your host, change logs_enabled: false to logs_enabled: true in the Agent\u2019s main configuration file (datadog.yaml). Custom Log Collection in Datadog Datadog Agent v6 can collect logs and forward them to Datadog from files, the network (TCP or UDP), journald,&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","_joinchat":[],"footnotes":""},"categories":[2],"tags":[],"class_list":["post-31261","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"_links":{"self":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31261","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/comments?post=31261"}],"version-history":[{"count":6,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31261\/revisions"}],"predecessor-version":[{"id":39771,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/posts\/31261\/revisions\/39771"}],"wp:attachment":[{"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/media?parent=31261"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/categories?post=31261"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.devopsschool.com\/blog\/wp-json\/wp\/v2\/tags?post=31261"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}