zsj1029
V2EX  ›  Local LLM

LiteChat 轻量级本地大模型聊天 WebUI,支持 vLLM

  •  
  •   zsj1029 · 7 days ago · 1569 views
    https://github.com/zsj1029/LiteChat

    企业内部场景适用,从 llama-cpp 的 webui 扒出来的,本地改造了下支持 vllm

    全程 Qwen3.6 27B (vLLM), Claude Vscode 改造
    7 replies    2026-05-06 11:09:58 +08:00
    zsj1029
        1
    zsj1029  
    OP
       7 days ago
    wumoumou
        2
    wumoumou  
       7 days ago
    精品项目,值的收藏
    FakerLeung
        3
    FakerLeung  
       6 days ago
    直接部署到 vercel 报错了

    ```bash
    Failed to post-process build: Error: ENOENT: no such file or directory, scandir '/vercel/public'
    at readdirSync (node:fs:1569:26)
    at Timeout._onTimeout (file:///vercel/path0/node_modules/.vite-temp/vite.config.ts.timestamp-1778034294654-96835744ec0528.mjs:66:27)
    at listOnTimeout (node:internal/timers:605:17)
    at process.processTimers (node:internal/timers:541:7) {
    errno: -2,
    code: 'ENOENT',
    syscall: 'scandir',
    path: '/vercel/public'
    }
    ```

    而且打包的 chunk 是不是有点太大了?

    ```bash
    ✓ 5809 modules transformed.
    rendering chunks...
    computing gzip size...
    .svelte-kit/output/client/_app/version.json 0.03 kB │ gzip: 0.05 kB
    .svelte-kit/output/client/.vite/manifest.json 6.61 kB │ gzip: 0.96 kB
    .svelte-kit/output/client/_app/immutable/assets/0.CpYem8t1.css 125.11 kB │ gzip: 20.55 kB
    .svelte-kit/output/client/_app/immutable/assets/ServerLoadingSplash.BHR6JAFJ.css 381.32 kB │ gzip: 267.34 kB
    .svelte-kit/output/client/_app/immutable/chunks/DsnmJJEf.js 0.07 kB │ gzip: 0.08 kB
    .svelte-kit/output/client/_app/immutable/entry/start.OBlS8FjQ.js 0.07 kB │ gzip: 0.09 kB
    .svelte-kit/output/client/_app/immutable/nodes/7.gtxsoKJA.js 0.42 kB │ gzip: 0.28 kB
    .svelte-kit/output/client/_app/immutable/nodes/2.BTiY_06N.js 0.71 kB │ gzip: 0.41 kB
    .svelte-kit/output/client/_app/immutable/chunks/-0TPzXFV.js 1.62 kB │ gzip: 0.68 kB
    .svelte-kit/output/client/_app/immutable/nodes/4.CMkz8A_3.js 2.78 kB │ gzip: 1.09 kB
    .svelte-kit/output/client/_app/immutable/nodes/5.15M2wQ-5.js 4.04 kB │ gzip: 1.53 kB
    .svelte-kit/output/client/_app/immutable/entry/app.D43LMMM4.js 8.18 kB │ gzip: 2.65 kB
    .svelte-kit/output/client/_app/immutable/chunks/Cmc6dqHu.js 11.66 kB │ gzip: 3.90 kB
    .svelte-kit/output/client/_app/immutable/nodes/1.DSr9m_Ji.js 14.80 kB │ gzip: 4.44 kB
    .svelte-kit/output/client/_app/immutable/nodes/6.iUgIWDg0.js 27.87 kB │ gzip: 7.69 kB
    .svelte-kit/output/client/_app/immutable/chunks/CxqaTyJe.js 44.29 kB │ gzip: 13.41 kB
    .svelte-kit/output/client/_app/immutable/nodes/0.BRUCrTiV.js 58.17 kB │ gzip: 15.95 kB
    .svelte-kit/output/client/_app/immutable/chunks/-rn0BqCN.js 71.23 kB │ gzip: 19.32 kB
    .svelte-kit/output/client/_app/immutable/chunks/CUhjqov5.js 590.52 kB │ gzip: 147.79 kB
    .svelte-kit/output/client/_app/immutable/chunks/Cf7Oed9A.js 1,243.15 kB │ gzip: 374.88 kB
    .svelte-kit/output/client/_app/immutable/chunks/DHT6aF71.js 4,554.84 kB │ gzip: 1,226.41 kB
    ✓ built in 24.56s
    ```
    zsj1029
        4
    zsj1029  
    OP
       6 days ago
    @FakerLeung 原版用到了 pdf 解析,这个包确实很大的,vercel 我没部署过,我是 build 后,放入 nginx 静态代理的,看你的日志 build 成功了,部署 vercel 报错了,本地先 bun run build ,然后手动处理部署,再看看吧
    FakerLeung
        5
    FakerLeung  
       6 days ago
    @zsj1029 #4 好了,需要改下 vercel 的部署,将 public 改成 dist 即可
    zsj1029
        6
    zsj1029  
    OP
       6 days ago
    @FakerLeung 重新提交了,请再次尝试,应该是兼容 vercel 了
    Orangeee
        7
    Orangeee  
       6 days ago
    👍
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   923 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 39ms · UTC 20:32 · PVG 04:32 · LAX 13:32 · JFK 16:32
    ♥ Do have faith in what you're doing.