{"id":40754,"date":"2023-12-17T08:02:42","date_gmt":"2023-07-16T07:58:28","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/"},"modified":"2024-05-04T13:58:41","modified_gmt":"2024-05-04T05:58:41","slug":"%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/","title":{"rendered":"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528"},"content":{"rendered":"<p>\u8fd9\u7bc7\u6587\u7ae0\u662fNTT\u6280\u672f\u4ea4\u53c9Advent Calender 2020\u7b2c18\u5929\u7684\u5185\u5bb9\u3002<\/p>\n<p>\u4f60\u597d\uff0c\u6211\u662fNTT\u30c6\u30af\u30ce\u30af\u30ed\u30b9\u7684@yuyhiraka\uff08\u5e73\u5ddd\uff09\u3002\u5e73\u65f6\uff0c\u6211\u4e3b\u8981\u8d1f\u8d23\u865a\u62df\u5316\/\u5bb9\u5668\/\u4e91\u57fa\u7840\u8bbe\u65bd\u3001\u5c0f\u578b\u7f51\u7edc\u7b49\u5148\u8fdb\u6280\u672f\u7684\u6982\u5ff5\u9a8c\u8bc1\u3002<\/p>\n<p>\u8fd9\u7bc7\u6587\u7ae0\u4e2d\u6240\u8ff0\u7684\u5185\u5bb9\u662f\u5173\u4e8e\u4e2a\u4eba\u7684\u4e1a\u4f59\u6d3b\u52a8\uff0c\u4e0e\u6240\u5c5e\u673a\u6784\u65e0\u5173\u3002<\/p>\n<h1>\u9996\u5148<\/h1>\n<p>\u6211\u8bd5\u56fe\u6d4b\u8bd5Koalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u8fdb\u884c\u5408\u4f5c\u3002<br \/>\n\u7531\u4e8e\u4e16\u754c\u4e0a\u5df2\u7ecf\u6709\u4eba\u5c1d\u8bd5\u8fc7Apache Spark TM\u548cElasticsearch\u7684\u5408\u4f5c\uff0c\u6240\u4ee5\u8fd9\u6b21\u6d4b\u8bd5\u662f\u4e3a\u4e86\u9a8c\u8bc1\u5b83\u4eec\u4e4b\u95f4\u7684\u5e94\u7528\u3002<\/p>\n<p>Spark on elasticsearch-hadoop \u30c8\u30e9\u30a4\u30a2\u30eb<\/p>\n<p>Elasticsearch\u306e\u30c7\u30fc\u30bf\u3092Apache Spark\u3067\u52a0\u5de5\u3059\u308b<\/p>\n<p>Elasticsearch\u306e\u30af\u30e9\u30b9\u30bf\u3092\u69cb\u7bc9\u3057\u3066Spark\u3067Index\u3092\u4f5c\u308b\u307e\u3067\u306e\u7c21\u6613\u624b\u9806<\/p>\n<h1>Elasticsearch\u662f\u4ec0\u4e48\uff1f<\/h1>\n<p>Elasticsearch\u662f\u4e00\u79cd\u7528\u4e8e\u641c\u7d22\u3001\u5206\u6790\u7684\u641c\u7d22\u5f15\u64ce\u3001\u6570\u636e\u5e93\u548c\u751f\u6001\u7cfb\u7edf\u3002<\/p>\n<h3>\u6709\u5173Elasticsearch\u7684\u53c2\u8003\u4fe1\u606f<\/h3>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Elasticsearch\u3063\u3066\uff1f<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">Elastic Stack\u30b5\u30d6\u30b9\u30af\u30ea\u30d7\u30b7\u30e7\u30f3 \uff06 \u5c0e\u5165\u652f\u63f4 -NTT\u30c6\u30af\u30ce\u30af\u30ed\u30b9-<\/ul>\n<h1>Apache Spark TM\u662f\u4ec0\u4e48<\/h1>\n<p>Apache Spark TM \u662f\u4e00\u79cd\u5feb\u901f\u7684\u5206\u5e03\u5f0f\u5904\u7406\u6846\u67b6\uff0c\u7528\u4e8e\u5927\u6570\u636e\u5904\u7406\u3002\u5b83\u652f\u6301Python\uff0c\u5e76\u7279\u522b\u79f0\u4e3aPySpark\u3002<\/p>\n<h3>\u5173\u4e8eApache Spark TM\u7684\u53c2\u8003\u4fe1\u606f\u3002<\/h3>\n<p>Apache Spark\u2122 &#8211; Apache Spark \u3068\u306f\uff5e\u5206\u6563\u51e6\u7406\u5165\u9580\u306e\u65b9\u306b\u3082\u308f\u304b\u308a\u3084\u3059\u304f\u3054\u7d39\u4ecb<\/p>\n<p>Apache Spark\u2122 &#8211; Unified Analytics Engine for Big Data<\/p>\n<h1>\u718a\u732b\uff08Pandas\uff09\u662f\u4ec0\u4e48\uff1f<\/h1>\n<p>Pandas\u662f\u4e00\u4e2a\u5f3a\u5927\u7684\u7528\u4e8ePython\u7684\u6570\u636e\u5206\u6790\u5e93\u3002<\/p>\n<h3>\u5173\u4e8e\u718a\u732b\u7684\u53c2\u8003\u4fe1\u606f<\/h3>\n<ul class=\"post-ul\">pandas &#8211; Python Data Analysis Library<\/ul>\n<h1>\u8003\u62c9\u662f\u4ec0\u4e48\uff1f<\/h1>\n<p>Koalas\u662f\u4e00\u4e2a\u5728Apache Spark TM\u4e2d\u5b9e\u73b0\u7c7b\u4f3c\u4e8epandas\u6570\u636e\u64cd\u4f5c\u7684\u5305\u88c5\u5e93\u3002\u5728Apache Spark TM\u4e2d\uff0c\u5b58\u5728\u7740\u7c7b\u4f3c\u4e8ePandas\u4e2d\u7684DataFrame\u7684Spark Dataset\/DataFrame\u6982\u5ff5\uff0c\u4f46\u7531\u4e8e\u5404\u79cdAPI\u7684\u4e0d\u540c\uff0c\u5c06pandas \u21d4 Spark Dataset\/DataFrame\u4e4b\u95f4\u7684\u5bf9\u8c61\u8f6c\u6362\u4f1a\u5bfc\u81f4\u6df7\u6dc6\u3002Koalas\u91c7\u7528\u4e86\u89e3\u51b3\u8fd9\u4e2a\u95ee\u9898\u7684\u65b9\u6cd5\u3002<\/p>\n<h3>\u5173\u4e8e\u8003\u62c9\u7684\u53c2\u8003\u4fe1\u606f<\/h3>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Koalas_ pandas API on Apache Spark<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">Spark+AI Summit 2019\u53c2\u52a0\u30ec\u30dd\u30fc\u30c8 at San Francisco \u2014 Spark3.0\/Koalas\/MLflow\/Delta Lake<\/ul>\n<h1>\u5173\u4e8eElasticsearch\u548cApache Spark TM\u7684\u96c6\u6210<\/h1>\n<p>\u6839\u636e\u5b83\u4eec\u62e5\u6709\u76f8\u540c\u7684\u7248\u672c\u53f7\uff0c\u53ef\u4ee5\u4f7f\u7528Elasticsearch-Hadoop\u63d2\u4ef6\uff08elasticsearch-hadoop 7.10\uff09\u6765\u5b9e\u73b0Elasticsearch 7.10\u548cHadoop\u751f\u6001\u7cfb\u7edf\uff08\u5305\u62ecApache Spark TM\u548cKoalas\uff09\u7684\u534f\u4f5c\u3002\u7136\u800c\uff0c\u622a\u81f32020\u5e7412\u6708\uff0c\u4f7f\u7528Elasticsearch-Hadoop\u63d2\u4ef6\u4f3c\u4e4e\u65e0\u6cd5\u5b9e\u73b0Elasticsearch\u4e0eApache Spark TM 3.0.x\u7684\u534f\u4f5c\u3002<\/p>\n<p>\u6240\u4ee5\u8fd9\u6b21\u6211\u4eec\u51b3\u5b9a\u4f7f\u7528\u6ee1\u8db3\u4ee5\u4e0b\u6761\u4ef6\u7684Apache Spark TM 2.4.7\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Koalas\u306e\u30b5\u30dd\u30fc\u30c8\u30d0\u30fc\u30b8\u30e7\u30f3<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">Elasticsearch-Hadoop\u30d7\u30e9\u30b0\u30a4\u30f3\u306e\u30b5\u30dd\u30fc\u30c8\u30d0\u30fc\u30b8\u30e7\u30f3<\/ul>\n<h3>\u5173\u4e8eElasticsearch-Hadoop\u63d2\u4ef6\u4ee5\u53caElasticsearch\u7248\u672c\u7684\u53c2\u8003\u4fe1\u606f\u3002<\/h3>\n<p>Elastic\u30d7\u30ed\u30c0\u30af\u30c8\u306eEOL\/\u30b5\u30dd\u30fc\u30c8\u7d42\u4e86\u65e5<\/p>\n<p>Elasticsearch-Hadoop(GitHub)<\/p>\n<h3>\u6709\u5173Elasticsearch\u548cApache Spark TM 3.0.x\u7684\u914d\u5408\u53c2\u8003\u4fe1\u606f\u3002<\/h3>\n<p>Documentation Databricks Workspace guide Data guide Data sources ElasticSearch<\/p>\n<p>Restructure Spark Project Cross Compilation #1423<\/p>\n<p>[Feature] Spark3.0 support #1412<\/p>\n<h3>\u5173\u4e8eKoalas\u7684\u4f9d\u8d56\u5173\u7cfb\u7684\u53c2\u8003\u4fe1\u606f<\/h3>\n<ul class=\"post-ul\">Koalas Dependencies<\/ul>\n<h1>\u5173\u4e8e\u9a8c\u8bc1\u73af\u5883\u7684\u4fe1\u606f<\/h1>\n<h2>\u673a\u5668\u89c4\u683c (j\u012b q\u00ec gu\u012b g\u00e9)<\/h2>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">VirtualBox 6.1.10\u4e0a\u306eUbuntu 20.04 LTS<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">vCPU 6\u30b3\u30a2<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">vMem 32GB<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">SSD 100GB<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">via HTTP\/HTTPS Proxy<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<ul class=\"post-ul\">\uff08\u203bHTTP\/HTTPS Proxy\u306e\u5404\u7a2e\u8a2d\u5b9a\u306b\u3064\u3044\u3066\u306f\u624b\u9806\u4e0a\u7701\u7565\u3057\u307e\u3059\u3002\uff09<\/ul>\n<h2>Docker\u7248\u672c<\/h2>\n<pre class=\"post-pre\"><code># docker version\r\nClient: Docker Engine - Community\r\n Version:           20.10.0\r\n<\/code><\/pre>\n<h1>\u521b\u5efa Apache Spark TM 2.4.7 \u7684\u5bb9\u5668\u955c\u50cf\u3002<\/h1>\n<p>\u4e3a\u4e86\u8282\u7701\u9a8c\u8bc1\u73af\u5883\u90e8\u7f72\u7684\u65f6\u95f4\uff0c\u53ef\u4ee5\u53c2\u8003\u521b\u5efa\u4e00\u4e2a\u542b\u6709\u4e0d\u540c\u7248\u672cSpark\u7684\u6620\u50cf\u7684\u65b9\u6cd5\uff0c\u6765\u5236\u4f5c\u4e00\u4e2a\u5b89\u88c5\u4e86PySpark2.4.7\u548cJupyterLab\u7684\u5bb9\u5668\u6620\u50cf\u3002<\/p>\n<pre class=\"post-pre\"><code># mkdir ~\/pyspark-notebook\r\n# curl -O https:\/\/raw.githubusercontent.com\/jupyter\/docker-stacks\/master\/pyspark-notebook\/Dockerfile\r\n# mv Dockerfile ~\/pyspark-notebook\r\n# docker build --rm --force-rm \\\r\n    -t jupyter\/pyspark-notebook:spark-2.4.7 .\/pyspark-notebook \\\r\n    --build-arg spark_version=2.4.7 \\\r\n    --build-arg hadoop_version=2.7 \\\r\n    --build-arg spark_checksum=0F5455672045F6110B030CE343C049855B7BA86C0ECB5E39A075FF9D093C7F648DA55DED12E72FFE65D84C32DCD5418A6D764F2D6295A3F894A4286CC80EF478 \\\r\n    --build-arg openjdk_version=8\r\n<\/code><\/pre>\n<p>\u521b\u5efa\u4e00\u4e2aDockerfile\uff0c\u7528\u4e8e\u5728\u4e0a\u8ff0\u57fa\u7840\u955c\u50cf\u4e0a\u5b89\u88c5Elasticsearch-Hadoop\u63d2\u4ef6\u548cKoalas\u3002\u7136\u800c\uff0c\u7531\u4e8ePySpark2.4\u65e0\u6cd5\u5728Python3.8.x\u4e0a\u6b63\u5e38\u8fd0\u884c\uff0c\u56e0\u6b64\u6211\u4eec\u5c06\u521b\u5efa\u4e00\u4e2aPython3.7.x\u7684conda\u865a\u62df\u73af\u5883\u4f5c\u4e3a\u89e3\u51b3\u65b9\u6848\u3002<\/p>\n<p>\u5728\u672c\u6b21\u4e0d\u4f1a\u5c1d\u8bd5\u66ff\u6362cloudpickle.py\u5e76\u8fdb\u884c\u4fee\u6539\u7684\u65b9\u6cd5\u3002<\/p>\n<pre class=\"post-pre\"><code># mkdir ~\/koalas-spark\r\n# vi ~\/koalas-spark\/Dockerfile\r\nFROM jupyter\/pyspark-notebook:spark-2.4.7\r\nUSER root\r\nRUN apt-get update\r\nRUN apt-get install -y curl\r\nUSER jovyan\r\nRUN mkdir ~\/jars\r\nRUN curl https:\/\/repo1.maven.org\/maven2\/org\/elasticsearch\/elasticsearch-hadoop\/7.10.1\/{elasticsearch-hadoop-7.10.1.jar} --output \"\/home\/jovyan\/jars\/#1\"\r\nRUN conda create -n py37 -c conda-forge python=3.7 jupyter pyspark=2.4 koalas=1.5 openjdk=8 -y\r\n<\/code><\/pre>\n<p>\u4f7f\u7528\u521b\u5efa\u7684Dockerfile\u6765\u6784\u5efa\u5bb9\u5668\u955c\u50cf\u3002<\/p>\n<pre class=\"post-pre\"><code># docker image build --rm --force-rm -t koalas-spark:0.1 ~\/koalas-spark\/\r\n<\/code><\/pre>\n<h1>\u4ece\u672c\u5730\u83b7\u53d6Elasticsearch\u7684\u5bb9\u5668\u955c\u50cf\u3002<\/h1>\n<p>\u7531\u4e8e\u8fd9\u662f\u4e00\u4e2a\u8f83\u5927\u7684\u5bb9\u5668\u56fe\u50cf\uff0c\u6240\u4ee5\u6211\u4f1a\u5148\u83b7\u53d6\u5b83\u3002<\/p>\n<pre class=\"post-pre\"><code># docker pull elasticsearch:7.10.1\r\n<\/code><\/pre>\n<h1>\u7528Docker Compose\u542f\u52a8\u5bb9\u5668<\/h1>\n<p>\u5c06\u8fdb\u884c\u5fc5\u8981\u76ee\u5f55\u7684\u521b\u5efa\u548cdocker-compose.yaml\u7684\u521b\u5efa\u3002<\/p>\n<pre class=\"post-pre\"><code># mkdir \/opt\/es\r\n# mkdir \/opt\/koalas-spark\/\r\n# \u30b3\u30f3\u30c6\u30ca\u304b\u3089\u30a2\u30af\u30bb\u30b9\u3067\u304d\u308b\u3088\u3046\u306b\u30d1\u30fc\u30df\u30c3\u30b7\u30e7\u30f3\u3092\u7de9\u3081\u308b (\u624b\u629c\u304d)\r\n# chmod 777 \/opt\/es \/opt\/koalas-spark\/\r\n# vi docker-compose.yaml\r\nversion: '3'\r\n\r\nservices:\r\n  elasticsearch:\r\n    image: elasticsearch:7.10.1\r\n    container_name: elasticsearch\r\n    environment:\r\n      - discovery.type=single-node\r\n      - cluster.name=docker-cluster\r\n      - bootstrap.memory_lock=true\r\n      - \"ES_JAVA_OPTS=-Xms512m -Xmx512m\"\r\n    ulimits:\r\n      memlock:\r\n        soft: -1\r\n        hard: -1\r\n    ports:\r\n      - 9200:9200\r\n    volumes:\r\n      - \/opt\/es\/:\/usr\/share\/elasticsearch\/data\r\n    networks:\r\n      - devnet\r\n\r\n  koalas-spark:\r\n    build: .\/koalas-spark\r\n    container_name: koalas-spark\r\n    working_dir: '\/home\/jovyan\/work\/'\r\n    tty: true\r\n    volumes:\r\n      - \/opt\/koalas-spark\/:\/home\/jovyan\/work\/\r\n    networks:\r\n      - devnet\r\n\r\nnetworks:\r\n  devnet:\r\n<\/code><\/pre>\n<p>\u4f7f\u7528Docker Compose\u6765\u542f\u52a8Koalas\u5bb9\u5668\u548cElasticsearch\u5bb9\u5668\uff0c\u540c\u65f6\u786e\u8ba4Elasticsearch\u5bb9\u5668\u6210\u529f\u542f\u52a8\u3002<\/p>\n<pre class=\"post-pre\"><code># docker-compose build\r\n# docker-compose up -d\r\n# curl -X GET http:\/\/localhost:9200\r\n{\r\n  \"name\" : \"6700fb19f202\",\r\n  \"cluster_name\" : \"docker-cluster\",\r\n  \"cluster_uuid\" : \"P-uVFNu6RZKKxdklnVypbw\",\r\n  \"version\" : {\r\n    \"number\" : \"7.10.1\",\r\n    \"build_flavor\" : \"default\",\r\n    \"build_type\" : \"docker\",\r\n    \"build_hash\" : \"1c34507e66d7db1211f66f3513706fdf548736aa\",\r\n    \"build_date\" : \"2020-12-05T01:00:33.671820Z\",\r\n    \"build_snapshot\" : false,\r\n    \"lucene_version\" : \"8.7.0\",\r\n    \"minimum_wire_compatibility_version\" : \"6.8.0\",\r\n    \"minimum_index_compatibility_version\" : \"6.0.0-beta1\"\r\n  },\r\n  \"tagline\" : \"You Know, for Search\"\r\n<\/code><\/pre>\n<h1>\u8003\u62c9\u8fdb\u5165Koalas\u5bb9\u5668<\/h1>\n<p>\u53ef\u4ee5\u5f9e\u6b63\u5728\u904b\u884c\u7684\u5bb9\u5668\u5217\u8868\u4e2d\u67e5\u627eKoalas\u5bb9\u5668\u7684\u5bb9\u5668ID\uff0c\u7136\u5f8c\u4f7f\u7528\u8a72\u5bb9\u5668ID\u9032\u5165Koalas\u5bb9\u5668\u3002\u53e6\u5916\u4e00\u7a2e\u65b9\u6cd5\u662f\u4f7f\u7528docker-compose exec\u6307\u5b9a\u5bb9\u5668ID\u3002<\/p>\n<pre class=\"post-pre\"><code># docker ps\r\nCONTAINER ID   IMAGE                  COMMAND                  CREATED          STATUS          PORTS                              NAMES\r\ne33681a37aea   root_koalas-spark      \"tini -g -- start-no\u2026\"   2 minutes ago    Up 2 minutes    8888\/tcp                           koalas-spark\r\nfe65e3351bea   elasticsearch:7.10.1   \"\/tini -- \/usr\/local\u2026\"   16 minutes ago   Up 16 minutes   0.0.0.0:9200-&gt;9200\/tcp, 9300\/tcp   elasticsearch\r\n# docker exec -it e33681a37aea bash\r\n<\/code><\/pre>\n<p>\u4f7f\u7528curl\u547d\u4ee4\u4eceKoalas\u5bb9\u5668\u68c0\u67e5\u4e0eElasticsearch\u5bb9\u5668\u4e4b\u95f4\u7684\u8fde\u63a5\u901a\u4fe1\u3002<\/p>\n<pre class=\"post-pre\"><code>$ curl -X GET http:\/\/elasticsearch:9200\r\n{\r\n  \"name\" : \"6700fb19f202\",\r\n  \"cluster_name\" : \"docker-cluster\",\r\n  \"cluster_uuid\" : \"P-uVFNu6RZKKxdklnVypbw\",\r\n  \"version\" : {\r\n    \"number\" : \"7.10.1\",\r\n    \"build_flavor\" : \"default\",\r\n    \"build_type\" : \"docker\",\r\n    \"build_hash\" : \"1c34507e66d7db1211f66f3513706fdf548736aa\",\r\n    \"build_date\" : \"2020-12-05T01:00:33.671820Z\",\r\n    \"build_snapshot\" : false,\r\n    \"lucene_version\" : \"8.7.0\",\r\n    \"minimum_wire_compatibility_version\" : \"6.8.0\",\r\n    \"minimum_index_compatibility_version\" : \"6.0.0-beta1\"\r\n  },\r\n  \"tagline\" : \"You Know, for Search\"\r\n<\/code><\/pre>\n<h1>\u8003\u62c9\uff08Koalas\uff09\u5411Elasticsearch\u8fdb\u884c\u5199\u5165\u64cd\u4f5c\u3002<\/h1>\n<p>\u6211\u5c06\u7ee7\u7eed\u5728Koalas\u5bb9\u5668\u4e2d\u8fdb\u884c\u5de5\u4f5c\u3002<br \/>\n\u5207\u6362\u5230Python 3.7\u73af\u5883\uff0c\u5e76\u542f\u52a8PySpark\uff08IPython\uff09\uff0c\u5c06\u6570\u636e\u5199\u5165Elasticsearch\u3002<\/p>\n<p>\u6211\u5011\u9019\u6b21\u4f7f\u7528Spark RDD\u7684\u529f\u80fd\u4f86\u5275\u5efa\u4e00\u500b4\u884c4\u5217\u7684\u6578\u64da\u3002\u7136\u5f8c\u5c07\u5176\u8f49\u63db\u6210\u4e00\u500bSpark DataFrame\uff0c\u4e26\u9032\u4e00\u6b65\u8f49\u63db\u6210Koalas DataFrame\u3002<\/p>\n<pre class=\"post-pre\"><code>$ conda activate py37\r\n$ export PYARROW_IGNORE_TIMEZONE=1\r\n$ pyspark --jars \/home\/jovyan\/jars\/elasticsearch-hadoop-7.10.1.jar\r\nimport databricks.koalas as ks\r\nimport pandas as pd\r\nimport json, os, datetime, collections\r\nfrom pyspark.sql import SparkSession, SQLContext, Row\r\nfrom pyspark.sql.types import *\r\n\r\nesURL = \"elasticsearch\"\r\n\r\nrdd1 = sc.parallelize([\r\n    Row(col1=1, col2=1, col3=1, col4=1),\r\n    Row(col1=2, col2=2, col3=2, col4=2),\r\n    Row(col1=3, col2=3, col3=3, col4=3),\r\n    Row(col1=4, col2=4, col3=4, col4=4)\r\n])\r\n\r\ndf1 = rdd1.toDF()\r\ndf1.show()\r\nkdf1 = ks.DataFrame(df1)\r\nprint(kdf1)\r\n\r\nkdf1.to_spark_io(path=\"sample\/test\", \r\n    format=\"org.elasticsearch.spark.sql\", \r\n    options={\"es.nodes.wan.only\": \"false\", \r\n    \"es.port\": 9200,\r\n    \"es.net.ssl\": \"false\", \r\n    \"es.nodes\": esURL}, \r\n    mode=\"Overwrite\")\r\n<\/code><\/pre>\n<p>\u5728 PySpark\uff08IPython\uff09\u4e2d\uff0c\u4f7f\u7528 Ctrl + D \u952e\u6216\u5176\u4ed6\u65b9\u6cd5\u9000\u51fa\u3002\u7136\u540e\uff0c\u786e\u8ba4\u6570\u636e\u5df2\u5b58\u50a8\u5728 Elasticsearch \u4e2d\u3002<\/p>\n<pre class=\"post-pre\"><code>curl -X GET http:\/\/elasticsearch:9200\/sample\/test\/_search?pretty\r\n{\r\n  \"took\" : 3,\r\n  \"timed_out\" : false,\r\n  \"_shards\" : {\r\n    \"total\" : 1,\r\n    \"successful\" : 1,\r\n    \"skipped\" : 0,\r\n    \"failed\" : 0\r\n  },\r\n  \"hits\" : {\r\n    \"total\" : {\r\n      \"value\" : 4,\r\n      \"relation\" : \"eq\"\r\n    },\r\n    \"max_score\" : 1.0,\r\n    \"hits\" : [\r\n      {\r\n        \"_index\" : \"sample\",\r\n        \"_type\" : \"test\",\r\n        \"_id\" : \"kaTbZXYBpKFycpUDLgjO\",\r\n        \"_score\" : 1.0,\r\n        \"_source\" : {\r\n          \"col1\" : 4,\r\n          \"col2\" : 4,\r\n          \"col3\" : 4,\r\n          \"col4\" : 4\r\n        }\r\n      },\r\n      {\r\n        \"_index\" : \"sample\",\r\n        \"_type\" : \"test\",\r\n        \"_id\" : \"kKTbZXYBpKFycpUDLgjG\",\r\n        \"_score\" : 1.0,\r\n        \"_source\" : {\r\n          \"col1\" : 2,\r\n          \"col2\" : 2,\r\n          \"col3\" : 2,\r\n          \"col4\" : 2\r\n        }\r\n      },\r\n      {\r\n        \"_index\" : \"sample\",\r\n        \"_type\" : \"test\",\r\n        \"_id\" : \"j6TbZXYBpKFycpUDLgjG\",\r\n        \"_score\" : 1.0,\r\n        \"_source\" : {\r\n          \"col1\" : 3,\r\n          \"col2\" : 3,\r\n          \"col3\" : 3,\r\n          \"col4\" : 3\r\n        }\r\n      },\r\n      {\r\n        \"_index\" : \"sample\",\r\n        \"_type\" : \"test\",\r\n        \"_id\" : \"jqTbZXYBpKFycpUDLgjD\",\r\n        \"_score\" : 1.0,\r\n        \"_source\" : {\r\n          \"col1\" : 1,\r\n          \"col2\" : 1,\r\n          \"col3\" : 1,\r\n          \"col4\" : 1\r\n        }\r\n      }\r\n    ]\r\n  }\r\n}\r\n<\/code><\/pre>\n<h1>\u603b\u7ed3<\/h1>\n<p>\u6211\u80fd\u591f\u786e\u8ba4\u4f7f\u7528Elasticsearch-Hadoop\u63d2\u4ef6\u4eceKoalas\u5c06\u6570\u636e\u5bfc\u5165Elasticsearch\uff0c\u5c31\u50cf\u4e0a\u8ff0\u6240\u8ff0\u3002\u6700\u521d\u7684\u8ba1\u5212\u662f\u4f7f\u7528PySpark\uff08IPython\uff09 =&gt; JupyterLab\u548cDocker Compose =&gt; Kubernetes\u8fdb\u884c\u9a8c\u8bc1\uff0c\u4f46\u7531\u4e8e\u4e0d\u80fd\u82b1\u8d39\u592a\u591a\u65f6\u95f4\u5728\u6b21\u8981\u95ee\u9898\u4e0a\uff0c\u6240\u4ee5\u6211\u5728\u8fd9\u6b21\u4e2d\u505a\u51fa\u4e86\u59a5\u534f\u3002<\/p>\n<p>\u6211\u5e0c\u671b\u80fd\u591f\u5c1d\u8bd5\u5728JupyterLab\/Kubernetes\u4e0a\u6267\u884c\uff0c\u4eceKoalas\u65e0\u969c\u788d\u5730\u5c06\u6570\u636e\u6295\u5165\u5230Elasticsearch\u3002\u6b64\u5916\uff0c\u7531\u4e8e\u6709\u5f88\u591a\u9700\u6c42\u88ab\u63d0\u51fa\uff0c\u6240\u4ee5\u5f88\u53ef\u80fd\u5f88\u5feb\u5c31\u4f1a\u5f97\u5230\u652f\u6301\u3002\u6211\u5f3a\u70c8\u5e0c\u671bElasticsearch-Hadoop\u63d2\u4ef6\u53ef\u4ee5\u5728Apache Spark TM 3.0.x\u4e0a\u4f7f\u7528\u3002<\/p>\n<p>\u660e\u5929\u662f\u7531@y-ohnuki\u8d1f\u8d23\u7684NTT TechnoCross Advent Calnder 2020\u7684\u6587\u7ae0\u3002\u671f\u5f85\u5427\uff01<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8fd9\u7bc7\u6587\u7ae0\u662fNTT\u6280\u672f\u4ea4\u53c9Advent Calender 2020\u7b2c18\u5929\u7684\u5185\u5bb9\u3002 \u4f60\u597d\uff0c\u6211\u662fNTT\u30c6\u30af\u30ce\u30af\u30ed\u30b9 [&hellip;]<\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-40754","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528 - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u8a66\u8457\u6aa2\u6e2ckoalas\u548celasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528\u3002\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528\" \/>\n<meta property=\"og:description\" content=\"\u8fd9\u7bc7\u6587\u7ae0\u662fNTT\u6280\u672f\u4ea4\u53c9Advent Calender 2020\u7b2c18\u5929\u7684\u5185\u5bb9\u3002 \u4f60\u597d\uff0c\u6211\u662fNTT\u30c6\u30af\u30ce\u30af\u30ed\u30b9 [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u8a66\u8457\u6aa2\u6e2ckoalas\u548celasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528\u3002\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-16T07:58:28+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-04T05:58:41+00:00\" \/>\n<meta name=\"author\" content=\"\u9038, \u79d1\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u9038, \u79d1\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/\",\"name\":\"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528 - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-07-16T07:58:28+00:00\",\"dateModified\":\"2024-05-04T05:58:41+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.silicloud.com\/zh\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487\",\"name\":\"\u9038, \u79d1\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g\",\"caption\":\"\u9038, \u79d1\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/keyi\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528 - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u8a66\u8457\u6aa2\u6e2ckoalas\u548celasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528\u3002\/","og_locale":"zh_CN","og_type":"article","og_title":"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528","og_description":"\u8fd9\u7bc7\u6587\u7ae0\u662fNTT\u6280\u672f\u4ea4\u53c9Advent Calender 2020\u7b2c18\u5929\u7684\u5185\u5bb9\u3002 \u4f60\u597d\uff0c\u6211\u662fNTT\u30c6\u30af\u30ce\u30af\u30ed\u30b9 [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/\u6211\u8a66\u8457\u6aa2\u6e2ckoalas\u548celasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528\u3002\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-07-16T07:58:28+00:00","article_modified_time":"2024-05-04T05:58:41+00:00","author":"\u9038, \u79d1","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u9038, \u79d1","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"4 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/","name":"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528 - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-07-16T07:58:28+00:00","dateModified":"2024-05-04T05:58:41+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487"},"breadcrumb":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.silicloud.com\/zh\/blog\/"},{"@type":"ListItem","position":2,"name":"\u6211\u8a66\u8457\u6aa2\u6e2cKoalas\u548cElasticsearch\u662f\u5426\u53ef\u4ee5\u4e92\u76f8\u914d\u5408\u4f7f\u7528"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/85c1dae56e6ea1e695c73d33c684d487","name":"\u9038, \u79d1","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c94f6d9cbbfbca863fab309840bd690c153c95f8490c290ad2ed54dd693dad16?s=96&d=mm&r=g","caption":"\u9038, \u79d1"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/keyi\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%88%91%e8%a9%a6%e8%91%97%e6%aa%a2%e6%b8%ackoalas%e5%92%8celasticsearch%e6%98%af%e5%90%a6%e5%8f%af%e4%bb%a5%e4%ba%92%e7%9b%b8%e9%85%8d%e5%90%88%e4%bd%bf%e7%94%a8%e3%80%82\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/40754","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=40754"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/40754\/revisions"}],"predecessor-version":[{"id":98736,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/40754\/revisions\/98736"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=40754"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=40754"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=40754"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}