ConnorZhang776's recent timeline updates
ConnorZhang776

ConnorZhang776

V2EX member #537632, joined on 2021-03-15 15:03:18 +08:00
ConnorZhang776's recent replies
Feb 18, 2024
Replied to a topic by hard2reg Python 断点续爬中的去重问题
我赞同使用 bloomFilter + redis 的方法,非常实用,只需要一个简单的 hash 就可以确定是否存在,且可以自定义重复率,个人觉得非常实用
About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   2984 Online   Highest 6679   ·     Select Language
创意工作者们的社区
World is powered by solitude
VERSION: 3.9.8.5 · 14ms · UTC 14:54 · PVG 22:54 · LAX 07:54 · JFK 10:54
♥ Do have faith in what you're doing.