Home Sign Up Sign In
Advertisement
lyang

请教， torchrun 多卡启动大模型，可以用 fastapi 调用吗

  •   
  •   lyang · May 17, 2024 · 1096 views
    This topic created in 726 days ago, the information mentioned may be changed or developed.

    如题，可以把 fastapi 写进代码里面，torchrun 调用吗

    还是通过 torchrun 读取数据库接口等信息，fastapi 写入数据库读取结果

    No Comments Yet
    torchrunFastAPI多卡
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5860 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 44ms · UTC 01:59 · PVG 09:59 · LAX 18:59 · JFK 21:59
    ♥ Do have faith in what you're doing.