{"id":35459,"date":"2023-10-25T07:02:38","date_gmt":"2023-07-17T17:42:17","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/"},"modified":"2024-05-04T05:50:05","modified_gmt":"2024-05-03T21:50:05","slug":"%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/","title":{"rendered":"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb"},"content":{"rendered":"<p>\u8fd9\u7bc7\u6587\u7ae0\u662f\u5173\u4e8eOpenShift Advent Calendar 2022\u548cvExpert Advent Calendar 2022\uff0c\u53d1\u8868\u572812\u670823\u65e5\u7684\u5e16\u5b50\u3002<\/p>\n<h2>\u9996\u5148<\/h2>\n<p>\u5982\u679c\u5728 vSphere \u73af\u5883\u4e2d\u4f7f\u7528 OpenShift\uff0c\u4eca\u540e\u5c06\u63a8\u8350\u4f7f\u7528 CSI \u9a71\u52a8\u4f5c\u4e3a\u7528\u4e8e\u4f7f\u7528 PV\/PVC \u7684\u5377\u63d2\u4ef6\uff0c\u5e76\u8ba1\u5212\u5728\u5c06\u6765\u5220\u9664 In-Tree \u9a71\u52a8\u7a0b\u5e8f\u3002\u901a\u8fc7\u542f\u7528 CSI \u8fc1\u79fb\uff0c\u6211\u4eec\u53ef\u4ee5\u786e\u8ba4\u5f53\u524d\u4f7f\u7528\u7684\u7531 In-Tree \u5377\u63d2\u4ef6\u521b\u5efa\u7684 PV\/PVC \u8d44\u6e90\u5c06\u5982\u4f55\u5904\u7406\u3002<\/p>\n<h2>\u6811\u5185\u5377\u63d2\u4ef6\u548c\u5bb9\u5668\u5b58\u50a8\u63a5\u53e3\uff08CSI\uff09<\/h2>\n<p>\u5728Kubernetes\u73af\u5883\u4e2d\uff0c\u53ef\u4ee5\u4f7f\u7528\u5d4c\u5165\u5f0fIn-Tree Volume Plugin\u548cCSI\u4f5c\u4e3aPersistent Volume\u7684\u5377\u63d2\u4ef6\u3002\u76ee\u524d\uff0c\u63a8\u8350\u4f7f\u7528CSI\uff0c\u5e76\u4e14\u5df2\u7ecf\u5220\u9664\u4e86\u4e00\u4e9bIn-Tree Volume Plugin\u3002\u901a\u8fc7\u5b9e\u73b0Container Storage Interface (CSI)\u800c\u4e0d\u662fIn-Tree\u5377\u63d2\u4ef6\uff0c\u7b2c\u4e09\u65b9\u5b58\u50a8\u4f9b\u5e94\u5546\u53ef\u4ee5\u5728\u4e0d\u66f4\u6539Kubernetes\u4ee3\u7801\u7684\u60c5\u51b5\u4e0b\u4f7f\u7528\u6807\u51c6\u63a5\u53e3\u63d0\u4f9b\u5b58\u50a8\u63d2\u4ef6\u3002<\/p>\n<ul class=\"post-ul\">CSI Volume Plugins in Kubernetes Design Doc<\/ul>\n<h2>\u5728vSphere\u73af\u5883\u4e2d\u4f7f\u7528In-Tree Volume Plugin\u548cvSphere CSI<\/h2>\n<p>vSphere\u73af\u5883\u4e2d\uff0c\u9ed8\u8ba4\u53ef\u4ee5\u4f7f\u7528vsphereVolume(kubernetes.io\/vsphere-volume)\u4f5c\u4e3aIn-Tree\u5377\u63d2\u4ef6\uff0c\u4f46\u8be5\u63d2\u4ef6\u5df2\u88ab\u5e9f\u5f03\uff0c\u63a8\u8350\u4f7f\u7528vSphere CSI\u3002\u5728OpenShift\u4e2d\uff0cvSphere CSI\u57284.8\u7248\u672c\u4e2d\u662fTechPreview\uff0c\u57284.10\u7248\u672c\u4e2d\u53d8\u4e3aGA\u3002\u5982\u679c\u57282022\u5e7412\u6708\u7684\u6700\u65b0\u7248\u672c4.11\u4e2d\u4f7f\u7528IPI\u8fdb\u884c\u5b89\u88c5\uff0c\u5219In-Tree\u9a71\u52a8\u7a0b\u5e8f(kubernetres.io\/vsphere-volume)\u548cCSI\u9a71\u52a8\u7a0b\u5e8f(csi.vsphere.vmware.com)\u90fd\u5c06\u914d\u7f6e\u4e3aStorageClass\uff0c\u4e14\u9ed8\u8ba4\u6807\u5fd7\u4e3athin(In-Tree\u9a71\u52a8\u7a0b\u5e8f)\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc version\r\nClient Version: 4.11.0-202210262118.p0.g142cb44.assembly.stream-142cb44\r\nKustomize Version: v4.5.4\r\nServer Version: 4.11.13\r\nKubernetes Version: v1.24.6+5157800\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc get sc\r\nNAME             PROVISIONER                    RECLAIMPOLICY   VOLUMEBINDINGMODE      ALLOWVOLUMEEXPANSION   AGE\r\nthin <span class=\"o\">(<\/span>default<span class=\"o\">)<\/span>   kubernetes.io\/vsphere-volume   Delete          Immediate              <span class=\"nb\">false                  <\/span>37m\r\nthin-csi         csi.vsphere.vmware.com         Delete          WaitForFirstConsumer   <span class=\"nb\">true                   <\/span>35m\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc get csidrivers.storage.k8s.io\r\nNAME                     ATTACHREQUIRED   PODINFOONMOUNT   STORAGECAPACITY   TOKENREQUESTS   REQUIRESREPUBLISH   MODES        AGE\r\ncsi.vsphere.vmware.com   <span class=\"nb\">true             false            false<\/span>             &lt;<span class=\"nb\">unset<\/span><span class=\"o\">&gt;<\/span>         <span class=\"nb\">false               <\/span>Persistent   37m\r\n<\/code><\/pre>\n<p>\u5728OpenShift 4.11\u7684\u6587\u6863\u4e2d\uff0c\u5173\u4e8e&#8221;VMware vSphere CSI \u9a71\u52a8\u7a0b\u5e8f Operator&#8221;\u7684\u63cf\u8ff0\u4e2d\u6307\u51fa\uff0c\u672a\u6765\u8ba1\u5212\u660e\u786e\u5220\u9664In-Tree\u9a71\u52a8\u7a0b\u5e8f\u3002<\/p>\n<blockquote><p>OpenShift Container Platform \u5728\u9ed8\u8ba4\u60c5\u51b5\u4e0b\u4f1a\u8bbe\u7f6e\u4f7f\u7528 in-tree \u6216\u8005\u975e CSI \u9a71\u52a8\u7684\u65b9\u5f0f\u6765\u8fdb\u884c vSphere \u5b58\u50a8\u7684\u4f9b\u7ed9\u3002<br \/>\n\u5728\u672a\u6765\u7684 OpenShift Container Platform \u7248\u672c\u4e2d\uff0c\u901a\u8fc7\u73b0\u6709\u7684 in-tree \u63d2\u4ef6\u8fdb\u884c\u4f9b\u7ed9\u7684\u5bb9\u91cf\u5c06\u4f1a\u8fc1\u79fb\u5230\u76f8\u5e94\u7684 CSI \u9a71\u52a8\u4e0a\u3002CSI \u81ea\u52a8\u8fc1\u79fb\u5c06\u4f1a\u65e0\u7f1d\u8fdb\u884c\u3002\u8fc1\u79fb\u540e\uff0c\u4f7f\u7528\u6c38\u4e45\u5377\u3001\u6c38\u4e45\u5377\u8bf7\u6c42\u3001\u5b58\u50a8\u7c7b\u7b49\u73b0\u6709\u7684 API \u5bf9\u8c61\u7684\u65b9\u5f0f\u5c06\u4e0d\u4f1a\u53d1\u751f\u53d8\u5316\u3002\u6709\u5173\u8fc1\u79fb\u7684\u8be6\u7ec6\u4fe1\u606f\uff0c\u8bf7\u53c2\u9605 CSI \u7684\u81ea\u52a8\u8fc1\u79fb\u3002<br \/>\n\u5728\u5b8c\u5168\u8fc1\u79fb\u4e4b\u540e\uff0cin-tree \u63d2\u4ef6\u6700\u7ec8\u5c06\u5728 OpenShift Container Platform \u672a\u6765\u7684\u7248\u672c\u4e2d\u88ab\u5220\u9664\u3002<\/p><\/blockquote>\n<h2>CSI\u79fb\u6c11<\/h2>\n<p>CSI Migration\u662f\u4e00\u79cd\u529f\u80fd\uff0c\u5b83\u5c06\u5bf9In-Tree\u9a71\u52a8\u7a0b\u5e8f\u7684\u64cd\u4f5c\u8f6c\u6362\u4e3a\u7b49\u6548\u7684CSI API\uff0c\u5e76\u901a\u8fc7\u66ff\u4ee3\u7684CSI\u9a71\u52a8\u7a0b\u5e8f\u6765\u5b9e\u73b0\u3002\u5f53\u5728Kubernetes\u96c6\u7fa4\u4e2d\u542f\u7528CSI Migration\u65f6\uff0c\u7528\u6237\u53ef\u4ee5\u76f4\u63a5\u4f7f\u7528\u73b0\u6709\u7684StorageClass\u3001PersistentVolume\u548cPersistentVolumeClaim\uff0c\u4f46Kubernetes\u4f1a\u5c06\u5bf9In-Tree\u9a71\u52a8\u7a0b\u5e8f\u7684\u5b58\u50a8\u64cd\u4f5c\u4f20\u9012\u7ed9CSI\u9a71\u52a8\u7a0b\u5e8f\u3002\u901a\u8fc7CSI Migration\uff0c\u7528\u6237\u53ef\u4ee5\u5e73\u6ed1\u5730\u8fc1\u79fb\u81f3CSI\u9a71\u52a8\u7a0b\u5e8f\uff0c\u6700\u7ec8\u53ef\u4ee5\u4eceKubernetes\u7684\u6838\u5fc3\u4e8c\u8fdb\u5236\u6587\u4ef6\u4e2d\u79fb\u9664In-Tree\u5b58\u50a8\u9a71\u52a8\u7a0b\u5e8f\u3002<\/p>\n<p>OpenShift 4.11(Kubernetes v1.24)\u3067\u306fAzure Disk\u3068OpenStack Cinder\u306eAutomatic CSI Migration\u304c\u5229\u7528\u53ef\u80fd\u306b\u306a\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<ul class=\"post-ul\">\n<li style=\"list-style-type: none;\">\n<ul class=\"post-ul\">Kubernetes 1.24 Stargazer : Storage Plugin Migration<\/ul>\n<\/li>\n<\/ul>\n<p>OpenShift 4.11 : Automatic CSI migration for OpenStack Cinder is generally available \/ Automatic CSI migration for Microsoft Azure Disk is generally available<\/p>\n<p>vSphere\u5411\u3051\u306eIn-Tree\u30d7\u30e9\u30b0\u30a4\u30f3\u3067\u3042\u308bkubernetes.io\/vsphere-volume\u3092vSphere CSI (csi.vsphere.vmware.com)\u3068\u3057\u3066\u5229\u7528\u53ef\u80fd\u306b\u3059\u308b\u305f\u3081\u306e\u3001vSphere CSI Migration\u306f\u4eca\u6708\u30ea\u30ea\u30fc\u30b9\u306eKubernetes v1.26\u3067Stable \u306b\u306a\u3063\u3066\u3044\u307e\u3059\u3002<\/p>\n<ul class=\"post-ul\">vSphere in-tree to CSI driver migration #1491<\/ul>\n<p>\u636e\u79f0\uff0cvSphere\u7684In-Tree\u9a71\u52a8\u7a0b\u5e8f\u5c06\u5728Kubernetes v1.28\u4e2d\u88ab\u79fb\u9664\u3002<\/p>\n<ul class=\"post-ul\">Kubernetes 1.25: Kubernetes In-Tree to CSI Volume Migration Status Update<\/ul>\n<h2>\u5728OpenShift 4.11\u4e2d\u542f\u7528vSphere CSI\u8fc1\u79fb<\/h2>\n<p>OpenShift 4.11\u3067PVC\u3092\u4f5c\u6210\u3057\u3066\u3001vSphere CSI Migration\u3092\u6709\u52b9\u5316\u3057\u3066\u6319\u52d5\u3092\u78ba\u8a8d\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d235637434c4406c2a5ea\/23-0.png\" alt=\"image.png\" \/><\/div>\n<h3>\u5236\u4f5c\u6d4b\u8bd5PV\/PVC<\/h3>\n<p>vSphere IPI\u3067\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u305f\u74b0\u5883\u3067StorageClassthin\u3068thin-csi\u3092\u5229\u7528\u3057\u3066PVC\u3092\u4f5c\u6210\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc get pvc\r\nNAME              STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE \r\nvsphere-csi-pvc   Bound    pvc-cfd35e01-9b4c-41d9-a229-ffaca40c5496   10Gi       RWO            thin-csi       126m\r\nvsphere-pvc       Bound    pvc-188bdcc2-943b-4788-8c33-297c917bbd77   10Gi       RWO            thin           126m\r\n<\/code><\/pre>\n<p>vSphere Client\u3067\u78ba\u8a8d\u3059\u308b\u3068\u3001thin-csi\u3068\u3057\u3066\u4f5c\u6210\u3057\u305fPVC(pvc-cfd35e01-9b4c-41d9-a229-ffaca40c5496)\u306f\u30b3\u30f3\u30c6\u30ca\u30dc\u30ea\u30e5\u30fc\u30e0\u3068\u3057\u3066\u8a8d\u8b58\u3055\u308c\u3066\u3044\u307e\u3059\u304c\u3001thin\u3092\u6307\u5b9a\u3057\u3066\u4f5c\u6210\u3057\u305fPVC(pvc-188bdcc2-943b-4788-8c33-297c917bbd77)\u306f\u30b3\u30f3\u30c6\u30ca\u30dc\u30ea\u30e5\u30fc\u30e0\u3068\u3057\u3066\u8a8d\u8b58\u3055\u308c\u3066\u3044\u307e\u305b\u3093\u3002<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d235637434c4406c2a5ea\/28-0.png\" alt=\"image.png\" \/><\/div>\n<p>govc\u3067CNS Volumes\u3092\u78ba\u8a8d\u3059\u308b\u3068\u3001thin-csi\u3068\u3057\u3066\u4f5c\u6210\u3057\u305f\u30dc\u30ea\u30e5\u30fc\u30e0\u3060\u3051\u304c\u8868\u793a\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>govc volume.ls <span class=\"nt\">-l<\/span>\r\n098ea18d-457d-4349-b8b3-8e86c525a652    pvc-cfd35e01-9b4c-41d9-a229-ffaca40c5496        10.0GB  KUBERNETES      nvaie-9pfjt\r\n<\/code><\/pre>\n<h3>\u542f\u7528\u7279\u6027\u95e8\u95f8<\/h3>\n<p>Feature Gate\u662f\u4ee5featuregates.config.openshift.io\u8d44\u6e90\u7684\u5f62\u5f0f\u8fdb\u884c\u7ba1\u7406\u7684\u3002<\/p>\n<pre class=\"post-pre\"><code>$ oc get featuregates.config.openshift.io \r\nNAME      AGE\r\ncluster   20h\r\n<\/code><\/pre>\n<p>featuregates.config.openshift.io\u30ea\u30bd\u30fc\u30b9\u3092\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u4fee\u6b63\u3057\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"na\">apiVersion<\/span><span class=\"pi\">:<\/span> <span class=\"s\">config.openshift.io\/v1<\/span>\r\n<span class=\"na\">kind<\/span><span class=\"pi\">:<\/span> <span class=\"s\">FeatureGate<\/span>\r\n<span class=\"na\">metadata<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">cluster<\/span>\r\n<span class=\"na\">spec<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">featureSet<\/span><span class=\"pi\">:<\/span> <span class=\"s\">CustomNoUpgrade<\/span>\r\n  <span class=\"na\">customNoUpgrade<\/span><span class=\"pi\">:<\/span>\r\n    <span class=\"na\">enabled<\/span><span class=\"pi\">:<\/span>\r\n      <span class=\"pi\">-<\/span> <span class=\"s\">CSIMigrationvSphere<\/span>\r\n<\/code><\/pre>\n<p>\u542f\u7528CSIMigrationvSphere\u5e76\u66f4\u65b0featuregates.config.openshift.io\u8d44\u6e90\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc apply <span class=\"nt\">-f<\/span> featuregate.yaml \r\nWarning: resource featuregates\/cluster is missing the kubectl.kubernetes.io\/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create <span class=\"nt\">--save-config<\/span> or oc apply. The missing annotation will be patched automatically.\r\nfeaturegate.config.openshift.io\/cluster configured\r\n<\/code><\/pre>\n<p>\u3057\u3070\u3089\u304f\u3059\u308b\u3068\u5404\u30ce\u30fc\u30c9\u306e\u8a2d\u5b9a\u304c\u5909\u66f4\u3055\u308c\u307e\u3059\u3002Master\u306ekubee-scheduler\u3068kube-controller-manager\u3067\u306f\u3001&#8211;feature-gatess=CSIMigrationvSPhere=ture\u304c\u8ffd\u52a0\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code>sh-4.4# <span class=\"nb\">hostname\r\n<\/span>nvaie-9pfjt-master-0\r\nsh-4.4# ps ax | <span class=\"nb\">grep<\/span> <span class=\"nt\">-i<\/span> CSIMigrationvSphere\r\n   1946 ?        Ssl    0:06 kube-controller-manager <span class=\"nt\">--openshift-config<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/config\/config.yaml <span class=\"nt\">--kubeconfig<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/controller-manager-kubeconfig\/kubeconfig <span class=\"nt\">--authentication-kubeconfig<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/controller-manager-kubeconfig\/kubeconfig <span class=\"nt\">--authorization-kubeconfig<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/controller-manager-kubeconfig\/kubeconfig <span class=\"nt\">--client-ca-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-certs\/configmaps\/client-ca\/ca-bundle.crt <span class=\"nt\">--requestheader-client-ca-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-certs\/configmaps\/aggregator-client-ca\/ca-bundle.crt <span class=\"nt\">-v<\/span><span class=\"o\">=<\/span>2 <span class=\"nt\">--tls-cert-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/secrets\/serving-cert\/tls.crt <span class=\"nt\">--tls-private-key-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/secrets\/serving-cert\/tls.key <span class=\"nt\">--allocate-node-cidrs<\/span><span class=\"o\">=<\/span><span class=\"nb\">false<\/span> <span class=\"nt\">--cert-dir<\/span><span class=\"o\">=<\/span>\/var\/run\/kubernetes <span class=\"nt\">--cloud-config<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/cloud-config\/cloud.conf <span class=\"nt\">--cloud-provider<\/span><span class=\"o\">=<\/span>vsphere <span class=\"nt\">--cluster-cidr<\/span><span class=\"o\">=<\/span>10.128.0.0\/14 <span class=\"nt\">--cluster-name<\/span><span class=\"o\">=<\/span>nvaie-9pfjt <span class=\"nt\">--cluster-signing-cert-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-certs\/secrets\/csr-signer\/tls.crt <span class=\"nt\">--cluster-signing-duration<\/span><span class=\"o\">=<\/span>720h <span class=\"nt\">--cluster-signing-key-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-certs\/secrets\/csr-signer\/tls.key <span class=\"nt\">--configure-cloud-routes<\/span><span class=\"o\">=<\/span><span class=\"nb\">false<\/span> <span class=\"nt\">--controllers<\/span><span class=\"o\">=<\/span><span class=\"k\">*<\/span> <span class=\"nt\">--controllers<\/span><span class=\"o\">=<\/span><span class=\"nt\">-bootstrapsigner<\/span> <span class=\"nt\">--controllers<\/span><span class=\"o\">=<\/span><span class=\"nt\">-tokencleaner<\/span> <span class=\"nt\">--controllers<\/span><span class=\"o\">=<\/span><span class=\"nt\">-ttl<\/span> <span class=\"nt\">--enable-dynamic-provisioning<\/span><span class=\"o\">=<\/span><span class=\"nb\">true<\/span> <span class=\"nt\">--feature-gates<\/span><span class=\"o\">=<\/span><span class=\"nv\">CSIMigrationvSphere<\/span><span class=\"o\">=<\/span><span class=\"nb\">true<\/span> <span class=\"nt\">--flex-volume-plugin-dir<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/kubelet-plugins\/volume\/exec <span class=\"nt\">--kube-api-burst<\/span><span class=\"o\">=<\/span>300 <span class=\"nt\">--kube-api-qps<\/span><span class=\"o\">=<\/span>150 <span class=\"nt\">--leader-elect-resource-lock<\/span><span class=\"o\">=<\/span>configmapsleases <span class=\"nt\">--leader-elect-retry-period<\/span><span class=\"o\">=<\/span>3s <span class=\"nt\">--leader-elect<\/span><span class=\"o\">=<\/span><span class=\"nb\">true<\/span> <span class=\"nt\">--pv-recycler-pod-template-filepath-hostpath<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/recycler-config\/recycler-pod.yaml <span class=\"nt\">--pv-recycler-pod-template-filepath-nfs<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/recycler-config\/recycler-pod.yaml <span class=\"nt\">--root-ca-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/serviceaccount-ca\/ca-bundle.crt <span class=\"nt\">--secure-port<\/span><span class=\"o\">=<\/span>10257 <span class=\"nt\">--service-account-private-key-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/secrets\/service-account-private-key\/service-account.key <span class=\"nt\">--service-cluster-ip-range<\/span><span class=\"o\">=<\/span>172.30.0.0\/16 <span class=\"nt\">--use-service-account-credentials<\/span><span class=\"o\">=<\/span><span class=\"nb\">true<\/span> <span class=\"nt\">--tls-cipher-suites<\/span><span class=\"o\">=<\/span>TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256 <span class=\"nt\">--tls-min-version<\/span><span class=\"o\">=<\/span>VersionTLS12        \r\n  10209 ?        Ssl    0:06 kube-scheduler <span class=\"nt\">--config<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/config\/config.yaml <span class=\"nt\">--cert-dir<\/span><span class=\"o\">=<\/span>\/var\/run\/kubernetes <span class=\"nt\">--authentication-kubeconfig<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/scheduler-kubeconfig\/kubeconfig <span class=\"nt\">--authorization-kubeconfig<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/configmaps\/scheduler-kubeconfig\/kubeconfig \r\n<span class=\"nt\">--feature-gates<\/span><span class=\"o\">=<\/span><span class=\"nv\">CSIMigrationvSphere<\/span><span class=\"o\">=<\/span><span class=\"nb\">true<\/span> <span class=\"nt\">-v<\/span><span class=\"o\">=<\/span>2 <span class=\"nt\">--tls-cert-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/secrets\/serving-cert\/tls.crt <span class=\"nt\">--tls-private-key-file<\/span><span class=\"o\">=<\/span>\/etc\/kubernetes\/static-pod-resources\/secrets\/serving-cert\/tls.key <span class=\"nt\">--tls-cipher-suites<\/span><span class=\"o\">=<\/span>TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256 <span class=\"nt\">--tls-min-version<\/span><span class=\"o\">=<\/span>VersionTLS12\r\n  93836 ?        S+     0:00 <span class=\"nb\">grep<\/span> <span class=\"nt\">-i<\/span> CSIMigrationvSphere\r\n<\/code><\/pre>\n<p>\u5728kubelet\u7684\u8bbe\u7f6e\u4e2d\u6dfb\u52a0\u4e86&#8221;CSIMigrationvSphere&#8221;: true\u4f5c\u4e3afeatureGates\u7684\u914d\u7f6e\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"err\">sh<\/span><span class=\"mf\">-4.4<\/span><span class=\"err\">#<\/span> <span class=\"err\">cat<\/span> <span class=\"err\">\/etc\/kubernetes\/kubelet.conf<\/span>            \r\n<span class=\"p\">{<\/span>\r\n  <span class=\"nl\">\"kind\"<\/span><span class=\"p\">:<\/span> <span class=\"s2\">\"KubeletConfiguration\"<\/span><span class=\"p\">,<\/span>\r\n  <span class=\"nl\">\"apiVersion\"<\/span><span class=\"p\">:<\/span> <span class=\"s2\">\"kubelet.config.k8s.io\/v1beta1\"<\/span><span class=\"p\">,<\/span>\r\n  <span class=\"nl\">\"staticPodPath\"<\/span><span class=\"p\">:<\/span> <span class=\"s2\">\"\/etc\/kubernetes\/manifests\"<\/span><span class=\"p\">,<\/span>\r\n<span class=\"err\">\u3000\u3000\u3000\u3000...<\/span>\r\n  <span class=\"nl\">\"featureGates\"<\/span><span class=\"p\">:<\/span> <span class=\"p\">{<\/span>\r\n    <span class=\"nl\">\"APIPriorityAndFairness\"<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"nl\">\"CSIMigrationAzureFile\"<\/span><span class=\"p\">:<\/span> <span class=\"kc\">false<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"nl\">\"CSIMigrationvSphere\"<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"nl\">\"DownwardAPIHugePages\"<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span><span class=\"p\">,<\/span>\r\n    <span class=\"nl\">\"RotateKubeletServerCertificate\"<\/span><span class=\"p\">:<\/span> <span class=\"kc\">true<\/span>\r\n  <span class=\"p\">},<\/span>\r\n<span class=\"err\">\u3000\u3000\u3000\u3000...<\/span>\r\n<span class=\"p\">}<\/span>\r\n<\/code><\/pre>\n<p>\u5728\u5305\u542bvSphere CSI\u914d\u7f6e\u7684ConfgMap\u4e2d\uff0ccsi-migration\u7684\u503c\u4e5f\u88ab\u8bbe\u7f6e\u4e3a&#8221;true&#8221;\u3002<\/p>\n<pre class=\"post-pre\"><code>$ oc get cm -n openshift-cluster-csi-drivers internal-feature-states.csi.vsphere.vmware.com -oyaml\r\napiVersion: v1\r\ndata:\r\n  csi-auth-check: \"true\"\r\n  csi-migration: \"true\"\r\n  online-volume-extend: \"true\"\r\nkind: ConfigMap\r\nmetadata:\r\n  creationTimestamp: \"2022-12-21T05:38:50Z\"\r\n  name: internal-feature-states.csi.vsphere.vmware.com\r\n  namespace: openshift-cluster-csi-drivers\r\n  resourceVersion: \"8652\"\r\n  uid: e5199f4e-b962-4802-9798-b8256a42376f\r\n<\/code><\/pre>\n<h3>\u786e\u8ba4\u79fb\u6c11<\/h3>\n<p>\u5f53\u68c0\u67e5\u4f7f\u7528In-Tree\u9a71\u52a8\u7a0b\u5e8f\u521b\u5efa\u7684PVC\u65f6\uff0c\u53ef\u4ee5\u770b\u5230Annotations\u4e2d\u5e26\u6709pv.kubernetes.io\/migrated-to: csi.vsphere.vmware.com\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc describe pvc vsphere-pvc\r\nName:          vsphere-pvc\r\nNamespace:     masanara\r\nStorageClass:  thin\r\nStatus:        Bound\r\nVolume:        pvc-188bdcc2-943b-4788-8c33-297c917bbd77\r\nLabels:        &lt;none&gt;\r\nAnnotations:   pv.kubernetes.io\/bind-completed: <span class=\"nb\">yes\r\n               <\/span>pv.kubernetes.io\/bound-by-controller: <span class=\"nb\">yes\r\n               <\/span>pv.kubernetes.io\/migrated-to: csi.vsphere.vmware.com\r\n               volume.beta.kubernetes.io\/storage-provisioner: kubernetes.io\/vsphere-volume\r\n               volume.kubernetes.io\/storage-provisioner: kubernetes.io\/vsphere-volume\r\nFinalizers:    <span class=\"o\">[<\/span>kubernetes.io\/pvc-protection]\r\nCapacity:      10Gi\r\nAccess Modes:  RWO\r\nVolumeMode:    Filesystem\r\nUsed By:       vsphere-pod-dc88dd678-wtqpv\r\nEvents:        &lt;none&gt;\r\n<\/code><\/pre>\n<p>PV\u306eAnnotations\u306b\u3082pv.kubernetes.io\/migrated-to: csi.vsphere.vmware.com\u304c\u3064\u3044\u3066\u3044\u307e\u3059\u304c\u3001Volume\u306fkubernetes.io\/vsphere-volume\u3068\u3057\u3066\u4f5c\u6210\u3057\u305f\u3082\u306e\u304c\u53c2\u7167\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc describe pv pvc-188bdcc2-943b-4788-8c33-297c917bbd77\r\nName:            pvc-188bdcc2-943b-4788-8c33-297c917bbd77\r\nLabels:          &lt;none&gt;\r\nAnnotations:     kubernetes.io\/createdby: vsphere-volume-dynamic-provisioner\r\n                 pv.kubernetes.io\/bound-by-controller: <span class=\"nb\">yes\r\n                 <\/span>pv.kubernetes.io\/migrated-to: csi.vsphere.vmware.com\r\n                 pv.kubernetes.io\/provisioned-by: kubernetes.io\/vsphere-volume\r\nFinalizers:      <span class=\"o\">[<\/span>kubernetes.io\/pv-protection external-attacher\/csi-vsphere-vmware-com]\r\nStorageClass:    thin\r\nStatus:          Bound\r\nClaim:           masanara\/vsphere-pvc\r\nReclaim Policy:  Delete\r\nAccess Modes:    RWO\r\nVolumeMode:      Filesystem\r\nCapacity:        10Gi\r\nNode Affinity:   &lt;none&gt;\r\nMessage:\r\nSource:\r\n    Type:               vSphereVolume <span class=\"o\">(<\/span>a Persistent Disk resource <span class=\"k\">in <\/span>vSphere<span class=\"o\">)<\/span>\r\n    VolumePath:         <span class=\"o\">[<\/span>Unity-Tanzu] kubevols\/nvaie-9pfjt-dynamic-pvc-188bdcc2-943b-4788-8c33-297c917bbd77.vmdk\r\n    FSType:             ext4\r\n    StoragePolicyName:\r\nEvents:                 &lt;none&gt;\r\n<\/code><\/pre>\n<p>\u5f53\u4f7f\u7528vSphere Client\u8fdb\u884c\u786e\u8ba4\u65f6\uff0c\u6211\u4eec\u53d1\u73b0\u4ee5thin\u6307\u5b9a\u521b\u5efa\u7684PVC(pvc-188bdcc2-943b-4788-8c33-297c917bbd77)\u4e5f\u5df2\u7ecf\u88ab\u8fc1\u79fb\u81f3vSphere CSI\u8fdb\u884c\u7ba1\u7406\uff0c\u88ab\u8bc6\u522b\u4e3a\u5bb9\u5668\u5377\u3002<\/p>\n<div><img decoding=\"async\" class=\"post-images\" title=\"\" src=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d235637434c4406c2a5ea\/50-0.png\" alt=\"image.png\" \/><\/div>\n<p>CNS volumes\u3092\u78ba\u8a8d\u3059\u308b\u3068\u3001thin\u3068\u3057\u3066\u4f5c\u6210\u3057\u305f\u30dc\u30ea\u30e5\u30fc\u30e0\u3082CNS volume\u306b\u5909\u63db\u3055\u308c\u305f\u305f\u3081\u4e00\u89a7\u306b\u8868\u793a\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>govc volume.ls <span class=\"nt\">-l<\/span>\r\nb86b065f-bfc2-4eb7-9780-cd388b20d991    429ddb9e-7ed2-11ed-8ee7-005056ae3ff8    10.0GB  KUBERNETES      nvaie-9pfjt\r\n098ea18d-457d-4349-b8b3-8e86c525a652    pvc-cfd35e01-9b4c-41d9-a229-ffaca40c5496        10.0GB  KUBERNETES      nvaie-9pfjt\r\n<\/code><\/pre>\n<h3>\u5efa\u7acb\u65b0\u7684PVC<\/h3>\n<p>Migration\u304c\u6709\u52b9\u306b\u306a\u3063\u305f\u72b6\u614b\u3067\u3001In-Tree\u30c9\u30e9\u30a4\u30d0\u3092\u6307\u5b9a\u3059\u308b\u4ee5\u4e0b\u306e\u30de\u30cb\u30d5\u30a7\u30b9\u30c8\u3067PVC\u3092\u4f5c\u6210\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"na\">apiVersion<\/span><span class=\"pi\">:<\/span> <span class=\"s\">v1<\/span>\r\n<span class=\"na\">kind<\/span><span class=\"pi\">:<\/span> <span class=\"s\">PersistentVolumeClaim<\/span>\r\n<span class=\"na\">metadata<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">name<\/span><span class=\"pi\">:<\/span> <span class=\"s\">vsphere-pvc2<\/span>\r\n<span class=\"na\">spec<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"na\">storageClass<\/span><span class=\"pi\">:<\/span> <span class=\"s\">thin<\/span>\r\n  <span class=\"na\">accessModes<\/span><span class=\"pi\">:<\/span>\r\n  <span class=\"pi\">-<\/span> <span class=\"s\">ReadWriteOnce<\/span>\r\n  <span class=\"na\">resources<\/span><span class=\"pi\">:<\/span>\r\n    <span class=\"na\">requests<\/span><span class=\"pi\">:<\/span>\r\n      <span class=\"na\">storage<\/span><span class=\"pi\">:<\/span> <span class=\"s\">10Gi<\/span>\r\n<\/code><\/pre>\n<p>PVC\u304c\u4f5c\u6210\u3055\u308c\u307e\u3057\u305f\u3002StorageClass\u306fthin\u3092\u5229\u7528\u3057\u3066\u3044\u308b\u305f\u3081\u3001kubernetes.io\/vsphere-volume\u304c\u6307\u5b9a\u3055\u308c\u308b\u3053\u3068\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc apply <span class=\"nt\">-f<\/span> vsphere-pvc2.yaml\r\npersistentvolumeclaim\/vsphere-pvc2 created\r\n<span class=\"nv\">$ <\/span>oc get pvc\r\nNAME              STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE\r\nvsphere-csi-pvc   Bound    pvc-cfd35e01-9b4c-41d9-a229-ffaca40c5496   10Gi       RWO            thin-csi       3d13h\r\nvsphere-pvc       Bound    pvc-188bdcc2-943b-4788-8c33-297c917bbd77   10Gi       RWO            thin           3d13h\r\nvsphere-pvc2      Bound    pvc-1b3e1910-94e7-4394-942a-46098f1aa550   10Gi       RWO            thin           4s\r\n<\/code><\/pre>\n<p>\u4f5c\u6210\u3055\u308c\u305fPVC\/PV\u3092\u78ba\u8a8d\u3059\u308b\u3068\u3001\u5185\u90e8\u3067\u306fCSI\u3092\u5229\u7528\u3057\u3066\u30d7\u30ed\u30d3\u30b8\u30e7\u30cb\u30f3\u30b0\u3055\u308c\u3066\u3044\u308b\u3053\u3068\u304c\u308f\u304b\u308a\u307e\u3059\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>oc describe pvc vsphere-pvc2\r\nName:          vsphere-pvc2\r\nNamespace:     masanara\r\nStorageClass:  thin\r\nStatus:        Bound\r\nVolume:        pvc-1b3e1910-94e7-4394-942a-46098f1aa550\r\nLabels:        &lt;none&gt;\r\nAnnotations:   pv.kubernetes.io\/bind-completed: <span class=\"nb\">yes\r\n               <\/span>pv.kubernetes.io\/bound-by-controller: <span class=\"nb\">yes\r\n               <\/span>volume.beta.kubernetes.io\/storage-provisioner: csi.vsphere.vmware.com\r\n               volume.kubernetes.io\/storage-provisioner: csi.vsphere.vmware.com\r\nFinalizers:    <span class=\"o\">[<\/span>kubernetes.io\/pvc-protection]\r\nCapacity:      10Gi\r\nAccess Modes:  RWO\r\nVolumeMode:    Filesystem\r\nUsed By:       &lt;none&gt;\r\nEvents:\r\n  Type    Reason                 Age    From                                                                              Message\r\n  <span class=\"nt\">----<\/span>    <span class=\"nt\">------<\/span>                 <span class=\"nt\">----<\/span>   <span class=\"nt\">----<\/span>                                                                              <span class=\"nt\">-------<\/span>\r\n  Normal  ExternalProvisioning   2m39s  persistentvolume-controller                                                       waiting <span class=\"k\">for <\/span>a volume to be created, either by external provisioner <span class=\"s2\">\"csi.vsphere.vmware.com\"<\/span> or manually created by system administrator\r\n  Normal  Provisioning           2m39s  csi.vsphere.vmware.com_nvaie-9pfjt-master-2_58e8e693-9e8e-4a85-b45d-54e386a87db7  External provisioner is provisioning volume <span class=\"k\">for <\/span>claim <span class=\"s2\">\"masanara\/vsphere-pvc2\"<\/span>\r\n  Normal  ProvisioningSucceeded  2m38s  csi.vsphere.vmware.com_nvaie-9pfjt-master-2_58e8e693-9e8e-4a85-b45d-54e386a87db7  Successfully provisioned volume pvc-1b3e1910-94e7-4394-942a-46098f1aa550\r\n<\/code><\/pre>\n<pre class=\"post-pre\"><code>$ oc describe pv pvc-1b3e1910-94e7-4394-942a-46098f1aa550\r\nName:            pvc-1b3e1910-94e7-4394-942a-46098f1aa550\r\nLabels:          &lt;none&gt;\r\nAnnotations:     pv.kubernetes.io\/migrated-to: csi.vsphere.vmware.com\r\n                 pv.kubernetes.io\/provisioned-by: kubernetes.io\/vsphere-volume\r\n                 volume.kubernetes.io\/provisioner-deletion-secret-name:\r\n                 volume.kubernetes.io\/provisioner-deletion-secret-namespace:\r\nFinalizers:      [kubernetes.io\/pv-protection]\r\nStorageClass:    thin\r\nStatus:          Bound\r\nClaim:           masanara\/vsphere-pvc2\r\nReclaim Policy:  Delete\r\nAccess Modes:    RWO\r\nVolumeMode:      Filesystem\r\nCapacity:        10Gi\r\nNode Affinity:   &lt;none&gt;\r\nMessage:\r\nSource:\r\n    Type:               vSphereVolume (a Persistent Disk resource in vSphere)\r\n    VolumePath:         [ESA] 8e5c9e63-3078-f184-2bb6-b8cef6a515b8\/ba9e5f035b7943dfa38f694b4492d671.vmdk\r\n    FSType:             ext4\r\n    StoragePolicyName:\r\nEvents:                 &lt;none&gt;\r\n<\/code><\/pre>\n<p>\u5f53\u60a8\u68c0\u67e5govc\u7684CNS Volume\u65f6\uff0c\u53ef\u4ee5\u786e\u8ba4\u5b58\u5728\u7531CSI\u521b\u5efa\u7684\u5377(pvc-1b3e1910-94e7-4394-942a-46098f1aa550)\u3002<\/p>\n<pre class=\"post-pre\"><code><span class=\"nv\">$ <\/span>govc volume.ls <span class=\"nt\">-l<\/span>\r\nf30b40be-89ac-4a4a-8e36-e530529e7f1d    pvc-1b3e1910-94e7-4394-942a-46098f1aa550        10.0GB  KUBERNETES      nvaie-9pfjt\r\nb86b065f-bfc2-4eb7-9780-cd388b20d991    429ddb9e-7ed2-11ed-8ee7-005056ae3ff8    10.0GB  KUBERNETES      nvaie-9pfjt\r\n098ea18d-457d-4349-b8b3-8e86c525a652    pvc-cfd35e01-9b4c-41d9-a229-ffaca40c5496        10.0GB  KUBERNETES      nvaie-9pfjt\r\n<\/code><\/pre>\n<h2>\u603b\u7ed3<\/h2>\n<p>\u901a\u8fc7\u4f7f\u7528vSphere CSI Migration\uff0c\u60a8\u53ef\u4ee5\u5c06\u8fc7\u53bb\u901a\u8fc7In-Tree\u9a71\u52a8\u7a0b\u5e8f\u521b\u5efa\u7684PV\/PVC\u65e0\u9700\u8003\u8651\u8fc1\u79fb\u5230vSphere CSI\u7ba1\u7406\u4e0b\u3002\u7136\u800c\uff0c\u76ee\u524d\u5728\u5f53\u524d\u7684OpenShift\u4e0a\u542f\u7528vSphere CSI Migration\u4f3c\u4e4e\u4e0d\u662f\u4e00\u4e2a\u597d\u4e3b\u610f\u3002\u5728\u5373\u5c06\u53d1\u5e03\u7684\u57fa\u4e8eKubernetes v1.26\u7684OpenShift\u7248\u672c\u4e2d\uff0c\u5e94\u8be5\u53ef\u4ee5\u65e0\u95ee\u9898\u5730\u4f7f\u7528\u5b83\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8fd9\u7bc7\u6587\u7ae0\u662f\u5173\u4e8eOpenShift Advent Calendar 2022\u548cvExpert Advent Ca [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-35459","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v21.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/\u5728-openshift-\u4e2d\u7684-vsphere-csi-\u8fc1\u79fb\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb\" \/>\n<meta property=\"og:description\" content=\"\u8fd9\u7bc7\u6587\u7ae0\u662f\u5173\u4e8eOpenShift Advent Calendar 2022\u548cvExpert Advent Ca [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/\u5728-openshift-\u4e2d\u7684-vsphere-csi-\u8fc1\u79fb\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-17T17:42:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-03T21:50:05+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d235637434c4406c2a5ea\/23-0.png\" \/>\n<meta name=\"author\" content=\"\u79d1, \u96c5\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u79d1, \u96c5\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/\",\"name\":\"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-07-17T17:42:17+00:00\",\"dateModified\":\"2024-05-03T21:50:05+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.silicloud.com\/zh\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a\",\"name\":\"\u79d1, \u96c5\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g\",\"caption\":\"\u79d1, \u96c5\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/keya\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/\u5728-openshift-\u4e2d\u7684-vsphere-csi-\u8fc1\u79fb\/","og_locale":"zh_CN","og_type":"article","og_title":"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb","og_description":"\u8fd9\u7bc7\u6587\u7ae0\u662f\u5173\u4e8eOpenShift Advent Calendar 2022\u548cvExpert Advent Ca [&hellip;]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/\u5728-openshift-\u4e2d\u7684-vsphere-csi-\u8fc1\u79fb\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-07-17T17:42:17+00:00","article_modified_time":"2024-05-03T21:50:05+00:00","og_image":[{"url":"https:\/\/cdn.silicloud.com\/blog-img\/blog\/img\/657d235637434c4406c2a5ea\/23-0.png"}],"author":"\u79d1, \u96c5","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u79d1, \u96c5","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"8 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/","name":"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-07-17T17:42:17+00:00","dateModified":"2024-05-03T21:50:05+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a"},"breadcrumb":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.silicloud.com\/zh\/blog\/"},{"@type":"ListItem","position":2,"name":"\u5728 OpenShift \u4e2d\u7684 vSphere CSI \u8fc1\u79fb"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/41e222757cdd2a3365361328bd79970a","name":"\u79d1, \u96c5","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1b2d3e00a7df03689797ebd4af8c5827ba5af936849a71050ec331f4cf902c5d?s=96&d=mm&r=g","caption":"\u79d1, \u96c5"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/keya\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e5%9c%a8-openshift-%e4%b8%ad%e7%9a%84-vsphere-csi-%e8%bf%81%e7%a7%bb\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/35459","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=35459"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/35459\/revisions"}],"predecessor-version":[{"id":96493,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/35459\/revisions\/96493"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=35459"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=35459"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=35459"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}