Home Sign Up Sign In
bestehen
V2EX  ›  问与答

自己设计的爬虫框架

  •  1      
  •   bestehen · Aug 22, 2018 · 1353 views
    This topic created in 2844 days ago, the information mentioned may be changed or developed.

    现在是 5 个爬虫，当然现在我想并行，我写在一个 run 的文件里面，现在 5 个爬虫并行，是不是先把这 5 个爬虫执行写在一个函数里面，然后多线程处理？

    No Comments Yet
    爬虫并行函数run
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   2583 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 32ms · UTC 11:02 · PVG 19:02 · LAX 04:02 · JFK 07:02
    ♥ Do have faith in what you're doing.