{"id":36971,"date":"2023-12-06T09:23:50","date_gmt":"2023-01-29T22:10:07","guid":{"rendered":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/"},"modified":"2024-01-15T09:15:19","modified_gmt":"2024-01-15T01:15:19","slug":"%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8","status":"publish","type":"post","link":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/","title":{"rendered":"\u6253\u5f00 LLM\u5217\u8868"},"content":{"rendered":"

\u6574\u7406\u4e86 Open LLM\u3002<\/p>\n

\u4ee5\u4e0b\u662f\u622a\u81f32023\u5e747\u670810\u65e5\u7684\u4fe1\u606f\uff0c\u8bf7\u91cd\u65b0\u786e\u8ba4\u76f8\u5173\u8bb8\u53ef\u8bc1\u7b49\u3002
\n\u6309\u7167\u53d1\u5e03\u65e5\u671f\u6392\u5e8f\u3002<\/p>\n

\n
Language ModelDeveloperRelease DateCheckpointsLanguageParams (B)TokensContext LengthLicenceHugging FaceXgenSalesforce2023\/06XGen-7B-4K-Base, XGen-7B-8K-Base, XGen-7B-8K-Inst (for research only)22 languages: Bulgarian, Catalan, Czech, Danish, German, English, Spanish, French, Croatian, Hungarian, Italian, Dutch, Polish, Romanian, Russian, Slovenian, Serbian, Swedish, Ukrainian, Japanese, Chinese71.5T4K to 8KApache 2.0Salesforce<\/a>DLiteAI Squared2023\/05dlite-v2-1_5bEnglish0.124 to 1.5
\n1024Apache 2.0AI Squared<\/a>h2oGPTH2O LLM Studio2023\/05h2oGPTEnglish12 to 20
\n256 – 2048Apache 2.0H2O LLM Studio<\/a>RedPajama-INCITETogether and leaders2023\/05RedPajama-INCITEEnglish3 to 7
\n2048Apache 2.0Together and leaders<\/a>OpenLLaMAOpenLM Research2023\/05open_llama_7b_700bt_preview, open_llama_3b_600bt_previewEnglish3, 7, 131T2048Apache 2.0OpenLM Research<\/a>FalconThe Technology Innovation Institute (TII)2023\/05Falcon-40B, Falcon-7B11 languages, English, German, Spanish, French (and limited capabilities in Italian, Portuguese, Polish, Dutch, Romanian, Czech, Swedish)7, 401T2048Apache 2.0TII<\/a>MPTMosaicML2023\/05MPT-7B, MPT-7B-Instruct, MPT-30B, MPT-30B-instructEnglish7, 301T8192 to 65kApache 2.0, CC BY-SA-3.0MosaicML<\/a>PythiaEleutherAI2023\/0470M, 160M, 410M, 1B, 1.4B, 2.8B, 6.9B, 12BEnglish0.07 to 12
\n2048Apache 2.0EleutherAI<\/a>DollyDatabricks2023\/04dolly-v2-3b, dolly-v2-7b, dolly-v2-12bEnglish3, 7, 12
\n2048MITDatabricks<\/a>StableLM-AlphaStableLM2023\/04StableLM-AlphaEnglish3 to 7
\n4096CC BY-SA-4.0StableLM<\/a>FastChat-T5lmsys2023\/04fastchat-t5-3b-v1.0English3
\n512Apache 2.0lmsys<\/a>Cerebras-GPTCerebras2023\/03111M, 256M, 590M, 1.3B, 2.7B, 6.7B, and 13BEnglish0.111 to 13
\n2048Apache 2.0Cerebras<\/a>Open Assistant (Pythia family)Open-Assistant2023\/03OA-Pythia-12B-SFT-8, OA-Pythia-12B-SFT-4, OA-Pythia-12B-SFT-1English12
\n2048Apache 2.0Open-Assistant<\/a>BloomBigScience2022\/11Bloom46 languages (No Japanese)176366B2048OpenRAIL-M v1BigScience<\/a>GPT-NeoX-20BEleutherAI2022\/04GPT-NEOX-20BEnglish20
\n2048Apache 2.0EleutherAI<\/a>RWKVBlinkDL2021\/08RWKV, ChatRWKV100+ languages0.1 to 14
\ninfinity (RNN)Apache 2.0BlinkDL<\/a>GPT-J-6BEleuther AI2021\/06GPT-J-6B, GPT4All-JEnglish6
\n2048Apache 2.0EleutherAI<\/a>mT5Google2020\/11mT5-Small, mT5-Base, mT5-Large, mT5-XL, mT5-XXL101 (with Japanese)0.3 to 13
\n512Apache 2.0Google<\/a>T5Google2019\/10T5 & Flan-T5, Flan-T5-xxl (HF)English0.06 to 11
\n512Apache 2.0Google<\/a><\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

\u6574\u7406\u4e86 Open LLM\u3002 \u4ee5\u4e0b\u662f\u622a\u81f32023\u5e747\u670810\u65e5\u7684\u4fe1\u606f\uff0c\u8bf7\u91cd\u65b0\u786e\u8ba4\u76f8\u5173\u8bb8\u53ef\u8bc1\u7b49\u3002 \u6309\u7167\u53d1\u5e03\u65e5\u671f\u6392\u5e8f\u3002 […]<\/p>\n","protected":false},"author":11,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-36971","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"\n\u6253\u5f00 LLM\u5217\u8868 - Blog - Silicon Cloud<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.silicloud.com\/zh\/blog\/\u6253\u5f00-llm\u5217\u8868\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u6253\u5f00 LLM\u5217\u8868\" \/>\n<meta property=\"og:description\" content=\"\u6574\u7406\u4e86 Open LLM\u3002 \u4ee5\u4e0b\u662f\u622a\u81f32023\u5e747\u670810\u65e5\u7684\u4fe1\u606f\uff0c\u8bf7\u91cd\u65b0\u786e\u8ba4\u76f8\u5173\u8bb8\u53ef\u8bc1\u7b49\u3002 \u6309\u7167\u53d1\u5e03\u65e5\u671f\u6392\u5e8f\u3002 […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.silicloud.com\/zh\/blog\/\u6253\u5f00-llm\u5217\u8868\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog - Silicon Cloud\" \/>\n<meta property=\"article:published_time\" content=\"2023-01-29T22:10:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-15T01:15:19+00:00\" \/>\n<meta name=\"author\" content=\"\u65b0, \u97f5\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u4f5c\u8005\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u65b0, \u97f5\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 \u5206\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/\",\"name\":\"\u6253\u5f00 LLM\u5217\u8868 - Blog - Silicon Cloud\",\"isPartOf\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\"},\"datePublished\":\"2023-01-29T22:10:07+00:00\",\"dateModified\":\"2024-01-15T01:15:19+00:00\",\"author\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/#breadcrumb\"},\"inLanguage\":\"zh-Hans\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u9996\u9875\",\"item\":\"https:\/\/www.silicloud.com\/zh\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"\u6253\u5f00 LLM\u5217\u8868\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#website\",\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/\",\"name\":\"Blog - Silicon Cloud\",\"description\":\"\",\"inLanguage\":\"zh-Hans\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9\",\"name\":\"\u65b0, \u97f5\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g\",\"caption\":\"\u65b0, \u97f5\"},\"url\":\"https:\/\/www.silicloud.com\/zh\/blog\/author\/yunxin\/\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-Hans\",\"@id\":\"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/#local-main-organization-logo\",\"url\":\"\",\"contentUrl\":\"\",\"caption\":\"Blog - Silicon Cloud\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"\u6253\u5f00 LLM\u5217\u8868 - Blog - Silicon Cloud","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.silicloud.com\/zh\/blog\/\u6253\u5f00-llm\u5217\u8868\/","og_locale":"zh_CN","og_type":"article","og_title":"\u6253\u5f00 LLM\u5217\u8868","og_description":"\u6574\u7406\u4e86 Open LLM\u3002 \u4ee5\u4e0b\u662f\u622a\u81f32023\u5e747\u670810\u65e5\u7684\u4fe1\u606f\uff0c\u8bf7\u91cd\u65b0\u786e\u8ba4\u76f8\u5173\u8bb8\u53ef\u8bc1\u7b49\u3002 \u6309\u7167\u53d1\u5e03\u65e5\u671f\u6392\u5e8f\u3002 […]","og_url":"https:\/\/www.silicloud.com\/zh\/blog\/\u6253\u5f00-llm\u5217\u8868\/","og_site_name":"Blog - Silicon Cloud","article_published_time":"2023-01-29T22:10:07+00:00","article_modified_time":"2024-01-15T01:15:19+00:00","author":"\u65b0, \u97f5","twitter_card":"summary_large_image","twitter_misc":{"\u4f5c\u8005":"\u65b0, \u97f5","\u9884\u8ba1\u9605\u8bfb\u65f6\u95f4":"1 \u5206"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/","url":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/","name":"\u6253\u5f00 LLM\u5217\u8868 - Blog - Silicon Cloud","isPartOf":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website"},"datePublished":"2023-01-29T22:10:07+00:00","dateModified":"2024-01-15T01:15:19+00:00","author":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9"},"breadcrumb":{"@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/#breadcrumb"},"inLanguage":"zh-Hans","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u9996\u9875","item":"https:\/\/www.silicloud.com\/zh\/blog\/"},{"@type":"ListItem","position":2,"name":"\u6253\u5f00 LLM\u5217\u8868"}]},{"@type":"WebSite","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#website","url":"https:\/\/www.silicloud.com\/zh\/blog\/","name":"Blog - Silicon Cloud","description":"","inLanguage":"zh-Hans"},{"@type":"Person","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/4ba4019495123db3038fd0809e6959c9","name":"\u65b0, \u97f5","image":{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d484b6c6e4ae82e8a9efea989e1d2af46d9b6ef128101e63b18f559fca0ae627?s=96&d=mm&r=g","caption":"\u65b0, \u97f5"},"url":"https:\/\/www.silicloud.com\/zh\/blog\/author\/yunxin\/"},{"@type":"ImageObject","inLanguage":"zh-Hans","@id":"https:\/\/www.silicloud.com\/zh\/blog\/%e6%89%93%e5%bc%80-llm%e5%88%97%e8%a1%a8\/#local-main-organization-logo","url":"","contentUrl":"","caption":"Blog - Silicon Cloud"}]}},"_links":{"self":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/36971","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/comments?post=36971"}],"version-history":[{"count":2,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/36971\/revisions"}],"predecessor-version":[{"id":58112,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/posts\/36971\/revisions\/58112"}],"wp:attachment":[{"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/media?parent=36971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/categories?post=36971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silicloud.com\/zh\/blog\/wp-json\/wp\/v2\/tags?post=36971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}