{"id":46321,"date":"2023-06-10T19:17:18","date_gmt":"2023-06-11T20:36:43","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/"},"modified":"2024-04-30T08:14:08","modified_gmt":"2024-04-30T00:14:08","slug":"46321-2","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/","title":{"rendered":""},"content":{"rendered":"<h1>\u6982\u8981<\/h1>\n<p>SynapseML\u3092\u4f7f\u3044\u305f\u3044\u3051\u3069\u3001\u3069\u3046\u3084\u3063\u3066\u74b0\u5883\u3092\u4f5c\u308c\u3070\u3088\u3044\u304b\u308f\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u3001Docker\u3092\u4f7f\u3063\u3066\u74b0\u5883\u69cb\u7bc9\u3059\u308b\u65b9\u6cd5\u3092\u8a66\u3057\u3066\u307f\u307e\u3057\u305f\uff01<\/p>\n<h1>\u4f5c\u696d\u524d\u306e\u74b0\u5883<\/h1>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Windows 10 Home<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">Docker Desktop\u304c\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u6e08\u307f<\/ul>\n<h1>SynapseML\u74b0\u5883\u69cb\u7bc9\u958b\u59cb\uff01<\/h1>\n<h2>\u624b\u9806<\/h2>\n<p>\u624b\u9806\u306f\u305f\u3063\u305f\u306e5\u3064\u3002<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>Docker\u30a4\u30e1\u30fc\u30b8\u306e\u53d6\u5f97<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>Docker\u30b3\u30f3\u30c6\u30ca\u306e\u8d77\u52d5<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u306e\u8d77\u52d5<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\n<li style=\"list-style-type: none;\">\n<ol>\u30d6\u30e9\u30a6\u30b6\u3067Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u306b\u30a2\u30af\u30bb\u30b9<\/ol>\n<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<ol>\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u30a4\u30f3\u30dd\u30fc\u30c8<\/ol>\n<h2>1. Docker\u30a4\u30e1\u30fc\u30b8\u306e\u53d6\u5f97<\/h2>\n<p>\u307e\u305a\u306f\u3001Docker\u30a4\u30e1\u30fc\u30b8\u306e\u53d6\u5f97\u304b\u3089\u59cb\u3081\u308b\u3002<br \/>\nMicrosoft\u306eSynapseML\u306e\u30b5\u30a4\u30c8\u306bDocker\u30a4\u30e1\u30fc\u30b8\u306b\u95a2\u3059\u308b\u60c5\u5831\u304c\u3042\u308b\u3002<br \/>\nUsing the SynapseML Docker Image<\/p>\n<p>WSL Ubuntu\u3084Powershell\u3092\u958b\u3044\u3066\u3001Docker\u30a4\u30e1\u30fc\u30b8\u3092\u30d7\u30eb\u3059\u308b\u3002<\/p>\n<pre class=\"post-pre\"><code>docker pull mcr.microsoft.com\/mmlspark\/release:0.9.4\r\n<\/code><\/pre>\n<p>\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3067\u3001Docker\u30a4\u30e1\u30fc\u30b8\u304c\u30ed\u30fc\u30ab\u30eb\u306b\u30d7\u30eb\u3067\u304d\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u3002<\/p>\n<pre class=\"post-pre\"><code>docker images\r\n<\/code><\/pre>\n<h2>2. Docker\u30b3\u30f3\u30c6\u30ca\u306e\u8d77\u52d5<\/h2>\n<p>Docker\u30a4\u30e1\u30fc\u30b8\u304c\u5b58\u5728\u3057\u3066\u3044\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3067\u304d\u305f\u306e\u3067\u3001\u30a4\u30e1\u30fc\u30b8\u3092\u5143\u306b\u30b3\u30f3\u30c6\u30ca\u3092\u8d77\u52d5\u3059\u308b\u3002<\/p>\n<pre class=\"post-pre\"><code>docker run <span class=\"nt\">-it<\/span> <span class=\"nt\">--rm<\/span> <span class=\"nt\">-p<\/span> 127.0.0.1:80:8888 <span class=\"nt\">-v<\/span> ~\/myfiles:\/notebooks\/myfiles mcr.microsoft.com\/mmlspark\/release:0.9.4\r\n<\/code><\/pre>\n<p>docker run\u30b3\u30de\u30f3\u30c9\u306e\u30aa\u30d7\u30b7\u30e7\u30f3\u8aac\u660e\u306f\u3053\u3061\u3089\u306e\u30b5\u30a4\u30c8\u3092\u53c2\u7167\u3002<br \/>\nUsing the SynapseML Docker Image<\/p>\n<p>\u4ee5\u4e0b\u306e\u3088\u3046\u306aTTY\u304c\u8868\u793a\u3055\u308c\u308c\u3070OK\u3002<\/p>\n<pre class=\"post-pre\"><code>root@c19xxxxxxx:\/notebooks#\r\n<\/code><\/pre>\n<p>\u4f5c\u6210\u3057\u305fJupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u30d5\u30a1\u30a4\u30eb\u306f\u4ee5\u4e0b\u306e\u30ed\u30fc\u30ab\u30eb\u30d5\u30a9\u30eb\u30c0\u306b\u683c\u7d0d\u3055\u308c\u308b\u3002<br \/>\n~\/myfiles<\/p>\n<p>\u6a5f\u68b0\u5b66\u7fd2\u3067\u5229\u7528\u3059\u308b\u5165\u529b\u30c7\u30fc\u30bf\uff08\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u7528\u30c7\u30fc\u30bf\u3001\u30c6\u30b9\u30c8\u7528\u30c7\u30fc\u30bf\uff09\u3092\u30b3\u30f3\u30c6\u30ca\u8d77\u52d5\u524d\u306b\u4fdd\u5b58\u3057\u3066\u304a\u304f\u3068\u8aad\u307f\u8fbc\u307f\u3067\u304d\u308b\u3002\u4ee5\u4e0b\u306f~\/myfiles\u914d\u4e0b\u306btitanic\/train.csv\u3092\u4fdd\u5b58\u3057\u305f\u5834\u5408\u306e\u30c7\u30fc\u30bf\u8aad\u8fbc\u307f\u4f8b\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"kn\">import<\/span> <span class=\"nn\">pyspark<\/span>\r\n\r\n<span class=\"n\">spark<\/span> <span class=\"o\">=<\/span> <span class=\"n\">pyspark<\/span><span class=\"p\">.<\/span><span class=\"n\">sql<\/span><span class=\"p\">.<\/span><span class=\"n\">SparkSession<\/span><span class=\"p\">.<\/span><span class=\"n\">builder<\/span><span class=\"p\">.<\/span><span class=\"n\">appName<\/span><span class=\"p\">(<\/span><span class=\"s\">\"MyApp\"<\/span><span class=\"p\">)<\/span> \\\r\n  <span class=\"p\">.<\/span><span class=\"n\">config<\/span><span class=\"p\">(<\/span><span class=\"s\">\"spark.jars.packages\"<\/span><span class=\"p\">,<\/span> <span class=\"s\">\"com.microsoft.azure:synapseml_2.12:0.9.4\"<\/span><span class=\"p\">)<\/span> \\\r\n  <span class=\"p\">.<\/span><span class=\"n\">config<\/span><span class=\"p\">(<\/span><span class=\"s\">\"spark.jars.repositories\"<\/span><span class=\"p\">,<\/span> <span class=\"s\">\"https:\/\/mmlspark.azureedge.net\/maven\"<\/span><span class=\"p\">)<\/span> \\\r\n  <span class=\"p\">.<\/span><span class=\"n\">getOrCreate<\/span><span class=\"p\">()<\/span>\r\n\r\n<span class=\"n\">train_data<\/span> <span class=\"o\">=<\/span> <span class=\"n\">spark<\/span><span class=\"p\">.<\/span><span class=\"n\">read<\/span><span class=\"p\">.<\/span><span class=\"nb\">format<\/span><span class=\"p\">(<\/span><span class=\"s\">\"csv\"<\/span><span class=\"p\">).<\/span><span class=\"n\">load<\/span><span class=\"p\">(<\/span>\r\n    <span class=\"s\">\"\/notebooks\/myfiles\/titanic\/train.csv\"<\/span>\r\n<span class=\"p\">)<\/span>\r\n<\/code><\/pre>\n<h2>3. Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u306e\u8d77\u52d5<\/h2>\n<p>Jupyter notebook\u3092\u8d77\u52d5\u3059\u308b\u3002<\/p>\n<pre class=\"post-pre\"><code>\/notebooks# jupyter notebook\r\n<\/code><\/pre>\n<h2>4. \u30d6\u30e9\u30a6\u30b6\u3067Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u306b\u30a2\u30af\u30bb\u30b9<\/h2>\n<p>Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u3092\u8d77\u52d5\u3057\u305f\u72b6\u614b\u3067\u3001Chrome\u306a\u3069\u306e\u30d6\u30e9\u30a6\u30b6\u304b\u3089http:\/\/localhost\u306b\u30a2\u30af\u30bb\u30b9\u3059\u308b\u3068\u3001Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u304c\u5229\u7528\u3067\u304d\u308b\u3002<\/p>\n<h2>5. \u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u30a4\u30f3\u30dd\u30fc\u30c8<\/h2>\n<p>Jupyter\u30ce\u30fc\u30c8\u30d6\u30c3\u30af\u4e0a\u3067PySpark\u3068SynapseML\u306e\u30e9\u30a4\u30d6\u30e9\u30ea\u3092\u30a4\u30f3\u30dd\u30fc\u30c8\u3059\u308b\u3002<br \/>\nSynapseML Installation<\/p>\n<pre class=\"post-pre\"><code><span class=\"kn\">import<\/span> <span class=\"nn\">pyspark<\/span>\r\n\r\n<span class=\"n\">spark<\/span> <span class=\"o\">=<\/span> <span class=\"n\">pyspark<\/span><span class=\"p\">.<\/span><span class=\"n\">sql<\/span><span class=\"p\">.<\/span><span class=\"n\">SparkSession<\/span><span class=\"p\">.<\/span><span class=\"n\">builder<\/span><span class=\"p\">.<\/span><span class=\"n\">appName<\/span><span class=\"p\">(<\/span><span class=\"s\">\"MyApp\"<\/span><span class=\"p\">)<\/span> \\\r\n  <span class=\"p\">.<\/span><span class=\"n\">config<\/span><span class=\"p\">(<\/span><span class=\"s\">\"spark.jars.packages\"<\/span><span class=\"p\">,<\/span> <span class=\"s\">\"com.microsoft.azure:synapseml_2.12:0.9.4\"<\/span><span class=\"p\">)<\/span> \\\r\n  <span class=\"p\">.<\/span><span class=\"n\">config<\/span><span class=\"p\">(<\/span><span class=\"s\">\"spark.jars.repositories\"<\/span><span class=\"p\">,<\/span> <span class=\"s\">\"https:\/\/mmlspark.azureedge.net\/maven\"<\/span><span class=\"p\">)<\/span> \\\r\n  <span class=\"p\">.<\/span><span class=\"n\">getOrCreate<\/span><span class=\"p\">()<\/span>\r\n\r\n<span class=\"kn\">import<\/span> <span class=\"nn\">synapse.ml<\/span>\r\n<\/code><\/pre>\n<p>\u3042\u3068\u306f\u597d\u304d\u306bSynapseML\u3092\u4f7f\u3063\u3066\u30b3\u30fc\u30c9\u3092\u66f8\u304d\u307e\u3057\u3087\u3046\u3002<\/p>\n<p>\u304a\u75b2\u308c\u69d8\u3067\u3057\u305f\u2728<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u6982\u8981 SynapseML\u3092\u4f7f\u3044\u305f\u3044\u3051\u3069\u3001\u3069\u3046\u3084\u3063\u3066\u74b0\u5883\u3092\u4f5c\u308c\u3070\u3088\u3044\u304b\u308f\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u3001Docker\u3092\u4f7f\u3063\u3066\u74b0 [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-46321","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>- Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:description\" content=\"\u6982\u8981 SynapseML\u3092\u4f7f\u3044\u305f\u3044\u3051\u3069\u3001\u3069\u3046\u3084\u3063\u3066\u74b0\u5883\u3092\u4f5c\u308c\u3070\u3088\u3044\u304b\u308f\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u3001Docker\u3092\u4f7f\u3063\u3066\u74b0 [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-11T20:36:43+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-30T00:14:08+00:00\" \/>\n<meta name=\"author\" content=\"\u6e05, \u5b87\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u6e05, \u5b87\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/\",\"name\":\"- Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-06-11T20:36:43+00:00\",\"dateModified\":\"2024-04-30T00:14:08+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/1a6ecd3d914d22a5ac32791ffc1fbd8e\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/1a6ecd3d914d22a5ac32791ffc1fbd8e\",\"name\":\"\u6e05, \u5b87\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4b2016c18459a605fc469c7566608f5686491baa112d0871ee613f61b7210565?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4b2016c18459a605fc469c7566608f5686491baa112d0871ee613f61b7210565?s=96&d=mm&r=g\",\"caption\":\"\u6e05, \u5b87\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/qingyu\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"- Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/","og_locale":"zh_CN","og_type":"article","og_description":"\u6982\u8981 SynapseML\u3092\u4f7f\u3044\u305f\u3044\u3051\u3069\u3001\u3069\u3046\u3084\u3063\u3066\u74b0\u5883\u3092\u4f5c\u308c\u3070\u3088\u3044\u304b\u308f\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u3067\u3001Docker\u3092\u4f7f\u3063\u3066\u74b0 [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-06-11T20:36:43+00:00","article_modified_time":"2024-04-30T00:14:08+00:00","author":"\u6e05, \u5b87","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u6e05, \u5b87","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"1 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/","name":"- Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-06-11T20:36:43+00:00","dateModified":"2024-04-30T00:14:08+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/1a6ecd3d914d22a5ac32791ffc1fbd8e"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/"]}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/1a6ecd3d914d22a5ac32791ffc1fbd8e","name":"\u6e05, \u5b87","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4b2016c18459a605fc469c7566608f5686491baa112d0871ee613f61b7210565?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4b2016c18459a605fc469c7566608f5686491baa112d0871ee613f61b7210565?s=96&d=mm&r=g","caption":"\u6e05, \u5b87"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/qingyu\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/46321-2\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46321","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=46321"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46321\/revisions"}],"predecessor-version":[{"id":90745,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/46321\/revisions\/90745"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=46321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=46321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=46321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}