lyang

请教, torchrun 多卡启动大模型,可以用 fastapi 调用吗

  •  
  •   lyang · May 17, 2024 · 1472 views
    This topic created in 916 days ago, the information mentioned may be changed or developed.

    如题,可以把 fastapi 写进代码里面,torchrun 调用吗

    还是通过 torchrun 读取数据库接口等信息,fastapi 写入数据库读取结果

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   2565 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 23ms · UTC 00:36 · PVG 08:36 · LAX 16:36 · JFK 19:36
    ♥ Do have faith in what you're doing.