{"id":18606,"date":"2024-03-15T17:17:26","date_gmt":"2024-03-15T17:17:26","guid":{"rendered":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/"},"modified":"2024-03-21T13:42:37","modified_gmt":"2024-03-21T13:42:37","slug":"how-can-filebeat-collect-multiple-log-files","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/","title":{"rendered":"How can filebeat collect multiple log files?"},"content":{"rendered":"<p>Filebeat can collect multiple log files by configuring multiple inputs.<\/p>\n<ol>\n<li>YAML configuration file for Filebeat<\/li>\n<li>inputs in filebeat<\/li>\n<li>Write it in English.<\/li>\n<li>ways<\/li>\n<li>You can customize additional parameters for each input block as needed, such as the encoding of log files and excluding certain files.<\/li>\n<li>Save and close the configuration file.<\/li>\n<li>Start or restart Filebeat, it will begin collecting all the log files specified in the configuration file.<\/li>\n<\/ol>\n<p>Here is an example configuration file that collects two log files:<\/p>\n<pre class=\"post-pre\"><code><span class=\"hljs-attr\">filebeat.inputs:<\/span>\r\n<span class=\"hljs-bullet\">-<\/span> <span class=\"hljs-attr\">type:<\/span> <span class=\"hljs-string\">log<\/span>\r\n  <span class=\"hljs-attr\">paths:<\/span>\r\n    <span class=\"hljs-bullet\">-<\/span> <span class=\"hljs-string\">\/var\/log\/app1\/*.log<\/span>\r\n  <span class=\"hljs-attr\">exclude_files:<\/span> [<span class=\"hljs-string\">'.gz$'<\/span>]\r\n\r\n<span class=\"hljs-bullet\">-<\/span> <span class=\"hljs-attr\">type:<\/span> <span class=\"hljs-string\">log<\/span>\r\n  <span class=\"hljs-attr\">paths:<\/span>\r\n    <span class=\"hljs-bullet\">-<\/span> <span class=\"hljs-string\">\/var\/log\/app2\/*.log<\/span>\r\n  <span class=\"hljs-attr\">encoding:<\/span> <span class=\"hljs-string\">utf-8<\/span>\r\n<\/code><\/pre>\n<p>In the example above, there are two input configuration blocks under filebeat.inputs, each corresponding to all .log files in the directories \/var\/log\/app1\/ and \/var\/log\/app2\/. The first block excludes files ending in .gz, while the second block specifies the encoding of the log files as UTF-8.<\/p>\n<p>Note: each input configuration block can have its own set of parameters, which can be configured as needed.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Filebeat can collect multiple log files by configuring multiple inputs. YAML configuration file for Filebeat inputs in filebeat Write it in English. ways You can customize additional parameters for each input block as needed, such as the encoding of log files and excluding certain files. Save and close the configuration file. Start or restart Filebeat, [&hellip;]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_import_markdown_pro_load_document_selector":0,"_import_markdown_pro_submit_text_textarea":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-18606","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How can filebeat collect multiple log files? - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How can filebeat collect multiple log files?\" \/>\n<meta property=\"og:description\" content=\"Filebeat can collect multiple log files by configuring multiple inputs. YAML configuration file for Filebeat inputs in filebeat Write it in English. ways You can customize additional parameters for each input block as needed, such as the encoding of log files and excluding certain files. Save and close the configuration file. Start or restart Filebeat, [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/SiliCloudGlobal\/\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-15T17:17:26+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-03-21T13:42:37+00:00\" \/>\n<meta name=\"author\" content=\"Ava Mitchell\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SiliCloudGlobal\" \/>\n<meta name=\"twitter:site\" content=\"@SiliCloudGlobal\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ava Mitchell\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\"},\"author\":{\"name\":\"Ava Mitchell\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/#\/schema\/person\/a3e2658c2cb9fb2be95ae0a8861f4a64\"},\"headline\":\"How can filebeat collect multiple log files?\",\"datePublished\":\"2024-03-15T17:17:26+00:00\",\"dateModified\":\"2024-03-21T13:42:37+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\"},\"wordCount\":154,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/#organization\"},\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\",\"url\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\",\"name\":\"How can filebeat collect multiple log files? - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/#website\"},\"datePublished\":\"2024-03-15T17:17:26+00:00\",\"dateModified\":\"2024-03-21T13:42:37+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.silicloud.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How can filebeat collect multiple log files?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/blog\/\",\"name\":\"Silicon Cloud Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/#organization\"},\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/#organization\",\"name\":\"Silicon Cloud Blog\",\"url\":\"https:\/\/www.silicloud.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.silicloud.com\/blog\/wp-content\/uploads\/2023\/11\/EN-SILICON-Full.png\",\"contentUrl\":\"https:\/\/www.silicloud.com\/blog\/wp-content\/uploads\/2023\/11\/EN-SILICON-Full.png\",\"width\":1024,\"height\":1024,\"caption\":\"Silicon Cloud Blog\"},\"image\":{\"@id\":\"https:\/\/www.silicloud.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/SiliCloudGlobal\/\",\"https:\/\/twitter.com\/SiliCloudGlobal\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/#\/schema\/person\/a3e2658c2cb9fb2be95ae0a8861f4a64\",\"name\":\"Ava Mitchell\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.silicloud.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/15c63cd0564b4a2e07d611bcdffa296f6ea80e8db07c3091f43a84010514899d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/15c63cd0564b4a2e07d611bcdffa296f6ea80e8db07c3091f43a84010514899d?s=96&d=mm&r=g\",\"caption\":\"Ava Mitchell\"},\"url\":\"https:\/\/www.silicloud.com\/blog\/author\/avamitchell\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How can filebeat collect multiple log files? - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/","og_locale":"en_US","og_type":"article","og_title":"How can filebeat collect multiple log files?","og_description":"Filebeat can collect multiple log files by configuring multiple inputs. YAML configuration file for Filebeat inputs in filebeat Write it in English. ways You can customize additional parameters for each input block as needed, such as the encoding of log files and excluding certain files. Save and close the configuration file. Start or restart Filebeat, [&hellip;]","og_url":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/","og_site_name":"Blog - Silicon Cloud","article_publisher":"https:\/\/www.facebook.com\/SiliCloudGlobal\/","article_published_time":"2024-03-15T17:17:26+00:00","article_modified_time":"2024-03-21T13:42:37+00:00","author":"Ava Mitchell","twitter_card":"summary_large_image","twitter_creator":"@SiliCloudGlobal","twitter_site":"@SiliCloudGlobal","twitter_misc":{"Written by":"Ava Mitchell","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/#article","isPartOf":{"@id":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/"},"author":{"name":"Ava Mitchell","@id":"https:\/\/www.silicloud.com\/blog\/#\/schema\/person\/a3e2658c2cb9fb2be95ae0a8861f4a64"},"headline":"How can filebeat collect multiple log files?","datePublished":"2024-03-15T17:17:26+00:00","dateModified":"2024-03-21T13:42:37+00:00","mainEntityOfPage":{"@id":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/"},"wordCount":154,"commentCount":0,"publisher":{"@id":"https:\/\/www.silicloud.com\/blog\/#organization"},"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/","url":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/","name":"How can filebeat collect multiple log files? - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/blog\/#website"},"datePublished":"2024-03-15T17:17:26+00:00","dateModified":"2024-03-21T13:42:37+00:00","breadcrumb":{"@id":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/blog\/how-can-filebeat-collect-multiple-log-files\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.silicloud.com\/blog\/"},{"@type":"ListItem","position":2,"name":"How can filebeat collect multiple log files?"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/blog\/#website","url":"https:\/\/www.silicloud.com\/blog\/","name":"Silicon Cloud Blog","description":"","publisher":{"@id":"https:\/\/www.silicloud.com\/blog\/#organization"},"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.silicloud.com\/blog\/#organization","name":"Silicon Cloud Blog","url":"https:\/\/www.silicloud.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.silicloud.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.silicloud.com\/blog\/wp-content\/uploads\/2023\/11\/EN-SILICON-Full.png","contentUrl":"https:\/\/www.silicloud.com\/blog\/wp-content\/uploads\/2023\/11\/EN-SILICON-Full.png","width":1024,"height":1024,"caption":"Silicon Cloud Blog"},"image":{"@id":"https:\/\/www.silicloud.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/SiliCloudGlobal\/","https:\/\/twitter.com\/SiliCloudGlobal"]},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/blog\/#\/schema\/person\/a3e2658c2cb9fb2be95ae0a8861f4a64","name":"Ava Mitchell","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.silicloud.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/15c63cd0564b4a2e07d611bcdffa296f6ea80e8db07c3091f43a84010514899d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/15c63cd0564b4a2e07d611bcdffa296f6ea80e8db07c3091f43a84010514899d?s=96&d=mm&r=g","caption":"Ava Mitchell"},"url":"https:\/\/www.silicloud.com\/blog\/author\/avamitchell\/"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/posts\/18606","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/comments?post=18606"}],"version-history":[{"count":1,"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/posts\/18606\/revisions"}],"predecessor-version":[{"id":52298,"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/posts\/18606\/revisions\/52298"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/media?parent=18606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/categories?post=18606"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/blog\/wp-json\/wp\/v2\/tags?post=18606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}