{"id":121580,"date":"2024-03-24T03:03:40","date_gmt":"2024-03-23T18:03:40","guid":{"rendered":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/"},"modified":"2024-04-05T03:52:27","modified_gmt":"2024-04-04T18:52:27","slug":"hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/","title":{"rendered":"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a"},"content":{"rendered":"

Hadoop\u306b\u3088\u308bJava\u304b\u3089\u306e\u30dd\u30fc\u30c8\u63a5\u7d9a\u65b9\u6cd5\u306b\u306f\u3001Hadoop\u306eHDFS API\u307e\u305f\u306fYARN API\u3092\u5229\u7528\u3059\u308b\u65b9\u6cd5\u304c\u3042\u308a\u307e\u3059\u3002Java\u304b\u3089Hadoop\u306eHDFS\u30dd\u30fc\u30c8\u306b\u63a5\u7d9a\u3059\u308b\u30b3\u30fc\u30c9\u4f8b\u3092\u4ee5\u4e0b\u306b\u793a\u3057\u307e\u3059\u3002<\/p>\n

“`java
\nimport org.apache.hadoop.conf.Configuration;
\nimport org.apache.hadoop.fs.FileSystem;
\nimport org.apache.hadoop.fs.Path;<\/p>\n

public class HadoopConnection {
\npublic static void main(String[] args) {
\ntry {
\n\/\/ Hadoop\u306e\u8a2d\u5b9a\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u4f5c\u6210
\nConfiguration conf = new Configuration();
\n\/\/ Hadoop\u306e\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u3092HDFS\u306b\u8a2d\u5b9a
\nconf.set(“fs.defaultFS”, “hdfs:\/\/localhost:9000”);<\/p>\n

\/\/ Hadoop\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u4f5c\u6210
\nFileSystem fs = FileSystem.get(conf);<\/p>\n

\/\/ \u30d5\u30a1\u30a4\u30eb\u30d1\u30b9\u3092\u4f5c\u6210
\nPath filePath = new Path(“\/path\/to\/file.txt”);<\/p>\n

\/\/ \u30d5\u30a1\u30a4\u30eb\u306e\u5b58\u5728\u3092\u78ba\u8a8d
\nboolean exists = fs.exists(filePath);<\/p>\n

if (exists) {
\nSystem.out.println(“File exists!”);
\n} else {
\nSystem.out.println(“File does not exist!”);
\n}<\/p>\n

\/\/ \u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u63a5\u7d9a\u3092\u9589\u3058\u308b
\nfs.close();
\n} catch (Exception e) {
\ne.printStackTrace();
\n}
\n}
\n}
\n“`<\/p>\n

\u4e0a\u8a18\u306e\u4f8b\u3067\u306f\u3001\u6700\u521d\u306bHadoop\u306e\u8a2d\u5b9a\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u4f5c\u6210\u3057\u3001\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u3092HDFS\u306b\u8a2d\u5b9a\u3057\u307e\u3059\u3002\u6b21\u306b\u3001`FileSystem.get(conf)`\u3092\u4f7f\u7528\u3057\u3066HDFS\u306e\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u53d6\u5f97\u3057\u307e\u3059\u3002\u7d9a\u3044\u3066\u3001\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3092\u4f7f\u7528\u3057\u3066\u3001\u30d5\u30a1\u30a4\u30eb\u306e\u5b58\u5728\u78ba\u8a8d\u306a\u3069\u306e\u3055\u307e\u3056\u307e\u306a\u64cd\u4f5c\u3092\u5b9f\u884c\u3067\u304d\u307e\u3059\u3002\u6700\u5f8c\u306b\u3001\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u63a5\u7d9a\u3092\u9589\u3058\u307e\u3059\u3002\u306a\u304a\u3001\u3053\u306e\u4f8b\u3067\u306fHadoop\u306eHDFS\u30dd\u30fc\u30c8\u304c9000\u3067\u3042\u308b\u3053\u3068\u3092\u524d\u63d0\u3068\u3057\u3066\u3044\u307e\u3059\u304c\u3001\u5b9f\u969b\u306eHadoop\u8a2d\u5b9a\u306b\u5fdc\u3058\u3066\u5909\u66f4\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

Hadoop\u306b\u3088\u308bJava\u304b\u3089\u306e\u30dd\u30fc\u30c8\u63a5\u7d9a\u65b9\u6cd5\u306b\u306f\u3001Hadoop\u306eHDFS API\u307e\u305f\u306fYARN API\u3092\u5229\u7528\u3059\u308b\u65b9\u6cd5\u304c\u3042\u308a\u307e\u3059\u3002Java\u304b\u3089Hadoop\u306eHDFS\u30dd\u30fc\u30c8\u306b\u63a5\u7d9a\u3059\u308b\u30b3\u30fc\u30c9\u4f8b\u3092\u4ee5\u4e0b\u306b\u793a\u3057\u307e\u3059\u3002 &#8220 […]<\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-121580","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"\nHadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a\/\" \/>\n<meta property=\"og:locale\" content=\"ja_JP\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a\" \/>\n<meta property=\"og:description\" content=\"Hadoop\u306b\u3088\u308bJava\u304b\u3089\u306e\u30dd\u30fc\u30c8\u63a5\u7d9a\u65b9\u6cd5\u306b\u306f\u3001Hadoop\u306eHDFS API\u307e\u305f\u306fYARN API\u3092\u5229\u7528\u3059\u308b\u65b9\u6cd5\u304c\u3042\u308a\u307e\u3059\u3002Java\u304b\u3089Hadoop\u306eHDFS\u30dd\u30fc\u30c8\u306b\u63a5\u7d9a\u3059\u308b\u30b3\u30fc\u30c9\u4f8b\u3092\u4ee5\u4e0b\u306b\u793a\u3057\u307e\u3059\u3002 &#8220 […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-23T18:03:40+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-04T18:52:27+00:00\" \/>\n<meta name=\"author\" content=\"\u7d50\u8863, \u6625\u82b1\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u57f7\u7b46\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u7d50\u8863, \u6625\u82b1\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593\" \/>\n\t<meta name=\"twitter:data2\" content=\"1\u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/\",\"url\":\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/\",\"name\":\"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/#website\"},\"datePublished\":\"2024-03-23T18:03:40+00:00\",\"dateModified\":\"2024-04-04T18:52:27+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/#\/schema\/person\/e52a686063ac76fd8cc6f539d41497ac\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/#breadcrumb\"},\"inLanguage\":\"ja\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.silicloud.com\/ja\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/ja\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"ja\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/#\/schema\/person\/e52a686063ac76fd8cc6f539d41497ac\",\"name\":\"\u7d50\u8863, \u6625\u82b1\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c74c6e2eb915a3c8e795b3934aa25a7333e0b38e7f1c7baf52785286ad51105e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c74c6e2eb915a3c8e795b3934aa25a7333e0b38e7f1c7baf52785286ad51105e?s=96&d=mm&r=g\",\"caption\":\"\u7d50\u8863, \u6625\u82b1\"},\"url\":\"https:\/\/www.silicloud.com\/ja\/blog\/author\/yuiharuka\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"ja\",\"@id\":\"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a\/","og_locale":"ja_JP","og_type":"article","og_title":"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a","og_description":"Hadoop\u306b\u3088\u308bJava\u304b\u3089\u306e\u30dd\u30fc\u30c8\u63a5\u7d9a\u65b9\u6cd5\u306b\u306f\u3001Hadoop\u306eHDFS API\u307e\u305f\u306fYARN API\u3092\u5229\u7528\u3059\u308b\u65b9\u6cd5\u304c\u3042\u308a\u307e\u3059\u3002Java\u304b\u3089Hadoop\u306eHDFS\u30dd\u30fc\u30c8\u306b\u63a5\u7d9a\u3059\u308b\u30b3\u30fc\u30c9\u4f8b\u3092\u4ee5\u4e0b\u306b\u793a\u3057\u307e\u3059\u3002 “ […]","og_url":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2024-03-23T18:03:40+00:00","article_modified_time":"2024-04-04T18:52:27+00:00","author":"\u7d50\u8863, \u6625\u82b1","twitter_card":"summary_large_image","twitter_misc":{"\u57f7\u7b46\u8005":"\u7d50\u8863, \u6625\u82b1","\u63a8\u5b9a\u8aad\u307f\u53d6\u308a\u6642\u9593":"1\u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/","url":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/","name":"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/ja\/blog\/#website"},"datePublished":"2024-03-23T18:03:40+00:00","dateModified":"2024-04-04T18:52:27+00:00","author":{"@id":"https:\/\/www.silicloud.com\/ja\/blog\/#\/schema\/person\/e52a686063ac76fd8cc6f539d41497ac"},"breadcrumb":{"@id":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/#breadcrumb"},"inLanguage":"ja","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.silicloud.com\/ja\/blog\/"},{"@type":"ListItem","position":2,"name":"Hadoop Java\u30dd\u30fc\u30c8\u3078\u306e\u63a5\u7d9a"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/ja\/blog\/#website","url":"https:\/\/www.silicloud.com\/ja\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"ja"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/ja\/blog\/#\/schema\/person\/e52a686063ac76fd8cc6f539d41497ac","name":"\u7d50\u8863, \u6625\u82b1","image":{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/www.silicloud.com\/ja\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/c74c6e2eb915a3c8e795b3934aa25a7333e0b38e7f1c7baf52785286ad51105e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c74c6e2eb915a3c8e795b3934aa25a7333e0b38e7f1c7baf52785286ad51105e?s=96&d=mm&r=g","caption":"\u7d50\u8863, \u6625\u82b1"},"url":"https:\/\/www.silicloud.com\/ja\/blog\/author\/yuiharuka\/"},{"@type":"ImageObject","inLanguage":"ja","@id":"https:\/\/www.silicloud.com\/ja\/blog\/hadoop-java%e3%83%9d%e3%83%bc%e3%83%88%e3%81%b8%e3%81%ae%e6%8e%a5%e7%b6%9a\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/posts\/121580","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/comments?post=121580"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/posts\/121580\/revisions"}],"predecessor-version":[{"id":307175,"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/posts\/121580\/revisions\/307175"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/media?parent=121580"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/categories?post=121580"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/ja\/blog\/wp-json\/wp\/v2\/tags?post=121580"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}