AI模型技术
本地大模型量化完整教程：从 HuggingFace 下载到 GGUF 转换，一步跑通 llama.cppWindows 本地把 HuggingFace 模型下载 → 合并转换为 GGUF → 量化 Q4_K_M → 测试运行 的完整教程。你这台 RTX 4080 Super 16GB 跑 8B ...
![](data:image/svg+xml;utf8,<svg t="1775125215343" class="icon" viewBox="0 0 1024 1024" version="1.1" xmlns="http://www.w3.org/2000/svg" p-id="5233" width="200" height="200"><path d="M293.537119 387.458685C293.537119 497.334601 320.00358 687.440559 483.75765 687.440559s191.681343-190.105958 191.681343-299.981874C674.493762 274.08828 610.590434 217.403077 483.786294 217.403077c-126.80414 0-190.220531 56.685203-190.220532 170.055608z" fill="%23FFD7B9" p-id="5234"></path><path d="M391.468755 491.749147c16.21214 0 29.359441 9.881958 29.359441 22.055384 0 12.144783-13.147301 22.026741-29.359441 22.026742-16.240783 0-29.388084-9.881958-29.388084-22.055385 0-12.144783 13.175944-22.026741 29.388084-22.026741z m176.271217 0c16.21214 0 29.359441 9.881958 29.359441 22.055384 0 12.144783-13.147301 22.026741-29.359441 22.026742-16.240783 0-29.388084-9.881958-29.388084-22.055385 0-12.144783 13.175944-22.026741 29.388084-22.026741z" fill="%2351495D" p-id="5235"></path><path d="M357.784168 435.522238c23.115189-19.334266 48.750993-19.334266 72.152615-0.08593a14.321678 14.321678 0 1 1-18.188531 22.141314c-12.80358-10.540755-23.086545-10.540755-35.575049-0.08593a14.321678 14.321678 0 1 1-18.389035-21.969454zM534.055385 435.522238c23.115189-19.334266 48.750993-19.334266 72.152615-0.08593a14.321678 14.321678 0 0 1-18.188531 22.141314c-12.80358-10.540755-23.086545-10.540755-35.603693-0.08593a14.321678 14.321678 0 1 1-18.331748-21.969454z" fill="%2351495D" p-id="5236"></path><path d="M445.318266 594.406937h68.199832c2.463329 29.388084-8.306573 44.082126-32.25242 44.082126-23.97449 0-35.947413-14.694042-35.947412-44.082126z" fill="%23F1F4F0" p-id="5237"></path><path d="M381.672727 584.610909m-28.643356 0a28.643357 28.643357 0 1 0 57.286713 0 28.643357 28.643357 0 1 0-57.286713 0Z" fill="%23C29888" p-id="5238"></path><path d="M577.507357 584.610909m-28.643357 0a28.643357 28.643357 0 1 0 57.286713 0 28.643357 28.643357 0 1 0-57.286713 0Z" fill="%23C29888" p-id="5239"></path><path d="M666.387692 453.510266c-2.090965 17.386517-4.01007 30.276028-5.728671 38.668531-5.814601 28.099133-9.108587 39.413259-9.681455 42.191665-1.145734 5.642741 50.412308-6.988979 48.922854-47.547972-1.002517-26.982042-12.173427-38.095664-33.512728-33.312224z" fill="%23D7B296" p-id="5240"></path><path d="M273.458126 453.538909c-3.236699-9.595524 12.173427-22.570965-4.43972-62.413874-16.613147-39.814266-2.520615-77.22249 19.305622-88.164252-45.858014-17.644308-17.988028-152.182154 82.52151-132.676028 42.048448-73.355636 146.310266-64.905846 171.974714 0 79.685818-29.731804 160.17365 28.672 137.975049 117.179972 34.142881 15.496056 40.186629 99.564308 19.133762 115.862378-14.035245 10.884476-16.498573 29.789091-7.361343 56.742489-9.366378-6.015105-16.269427-8.220643-20.709147-6.530685-20.13628 7.67642-27.440336-0.773371-27.440335-20.508643-28.84386-14.894545-45.256503-71.522462-41.475581-76.391832 3.780923-4.869371-45.48565 11.514629-76.936056-27.096616-10.111105 22.198601-63.072671 48.264056-96.556755 12.832224-10.655329 19.592056-30.161455 26.924755-58.604308 22.055385-3.609063 29.044364-13.605594 51.901762-30.046881 68.600839 2.205538 19.993063-7.017622 28.643357-27.669482 25.893594-7.103552 0-12.259357-3.437203-15.410126-10.311608-9.079944-1.088448-19.87849 1.203021-24.260923 4.926657z" fill="%232F245A" p-id="5241"></path><path d="M297.719049 448.612252c2.062322 17.386517 3.981427 30.276028 5.728671 38.668531 5.785958 28.099133 9.108587 39.413259 9.652811 42.191665 1.145734 5.671385-50.412308-6.988979-48.922853-47.519329 1.031161-27.010685 12.20207-38.124308 33.512728-33.340867z" fill="%23D7B296" p-id="5242"></path><path d="M370.272671 712.27435l-103.373874 5.814601c-34.372028 6.702545-54.221874 26.008168-59.578182 57.85958-5.327664 31.822769-7.533203 79.743105-6.587972 143.732364l285.459693 104.319105v-230.149371c-32.968503-3.236699-58.632951-13.519664-76.9647-30.848895-18.360392-17.329231-31.335832-34.228811-38.954965-50.727384zM602.083357 712.27435l103.402517 5.814601c34.372028 6.702545 54.221874 26.008168 59.549539 57.85958 5.327664 31.822769 7.561846 79.743105 6.645258 143.732364L486.192336 1024v-230.149371c32.93986-3.236699 58.604308-13.519664 76.964699-30.848895 18.331748-17.329231 31.335832-34.228811 38.954965-50.727384z" fill="%234E367D" p-id="5243"></path><path d="M428.218182 848.702657l10.970405 175.297343h95.267805l8.020139-175.297343-56.713846-54.852028z" fill="%23F7F4F4" p-id="5244"></path><path d="M455.114294 825.787972l13.977958 26.351888c4.983944 4.01007 10.683972 6.015105 17.100084 6.015105 6.416112 0 12.832224-2.005035 19.276979-6.015105l10.970405-26.351888-31.937342-31.937343-29.388084 31.965986z" fill="%23E35F6D" p-id="5245"></path><path d="M467.45958 848.702657l-16.699077 172.289791h76.363189l-20.250853-172.289791z" fill="%23E35F6D" p-id="5246"></path><path d="M407.308531 677.300811c-24.690573 16.12621-37.03586 27.784056-37.03586 34.944895 0 10.827189 26.495105 127.176503 41.790658 135.483077 10.197035 5.528168 34.887608-12.431217 74.129007-53.84951-36.462993-20.90965-58.718881-39.699692-66.796308-56.456056-8.077427-16.785007-12.11614-36.806713-12.11614-60.122406z" fill="%23FFFFFF" p-id="5247"></path><path d="M563.414825 677.300811c24.66193 16.12621 37.007217 27.784056 37.007217 34.944895 0 10.827189-26.495105 127.176503-41.790657 135.483077-10.197035 5.528168-34.887608-12.431217-74.129007-53.84951 36.462993-20.90965-58.718881-39.699692-66.796307-56.456056-8.077427-16.785007-12.11614-36.806713-12.11614-60.122406z" fill="%23FFFFFF" p-id="5248"></path><path d="M396.366769 648.256448v122.135272c32.051916 19.362909 59.721399 29.044364 83.037091 29.044364 23.315692 0 52.73242-9.681455 88.336112-29.044364v-122.135272H396.366769z" fill="%23FFD7B9" p-id="5249"></path></svg>)
Article Library
文章库
“所有的伟大，都源于一个勇敢的开始。” —— 自定义格言
1-1/1
内
内容管理系统CONTENT PLATFORM
“所有的伟大，都源于一个勇敢的开始。” —— 自定义格言
Windows 本地把 HuggingFace 模型下载 → 合并转换为 GGUF → 量化 Q4_K_M → 测试运行 的完整教程。你这台 RTX 4080 Super 16GB 跑 8B ...