V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
unidentifiedme
V2EX  ›  宽带症候群

请教 Windows iperf3 10GbE 测速跑不满的问题

  •  
  •   unidentifiedme · 2022-12-15 20:09:08 +08:00 · 2090 次点击
    这是一个创建于 695 天前的主题,其中的信息可能已经有所发展或是发生改变。

    问题

    无论哪边是 Server ,iperf3 测速 单线程 跑不满 10Gbps ,仅有不到 5Gbps ,需要至少四个线程 -P4 才能跑出接近的数值。单线程测速时,Server/Client 并没有任何一个 CPU Core 吃满 100%。

    想请教一下可能是什么问题?

    有搜到说 Windows 上的 iperf3 因为 cygwin 所以性能有问题,但是手边没有可以连上 10GbE 的 Linux/macOS 设备,所以 没法确认。

    ~
    ❯ iperf3 -c 192.168.2.22
    Connecting to host 192.168.2.22, port 5201
    [  4] local 192.168.2.11 port 52865 connected to 192.168.2.22 port 5201
    [ ID] Interval           Transfer     Bandwidth
    [  4]   0.00-1.00   sec   525 MBytes  4.40 Gbits/sec
    [  4]   1.00-2.00   sec   527 MBytes  4.42 Gbits/sec
    [  4]   2.00-3.00   sec   527 MBytes  4.42 Gbits/sec
    [  4]   3.00-4.00   sec   543 MBytes  4.55 Gbits/sec
    [  4]   4.00-5.00   sec   536 MBytes  4.50 Gbits/sec
    [  4]   5.00-6.00   sec   532 MBytes  4.46 Gbits/sec
    [  4]   6.00-7.00   sec   542 MBytes  4.55 Gbits/sec
    [  4]   7.00-8.00   sec   548 MBytes  4.60 Gbits/sec
    [  4]   8.00-9.00   sec   546 MBytes  4.58 Gbits/sec
    [  4]   9.00-10.00  sec   546 MBytes  4.58 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [ ID] Interval           Transfer     Bandwidth
    [  4]   0.00-10.00  sec  5.25 GBytes  4.51 Gbits/sec                  sender
    [  4]   0.00-10.00  sec  5.25 GBytes  4.51 Gbits/sec                  receiver
    
    ~ took 10s
    ❯ iperf3 -c 192.168.2.22 -P 4
    Connecting to host 192.168.2.22, port 5201
    [  4] local 192.168.2.11 port 53184 connected to 192.168.2.22 port 5201
    [  6] local 192.168.2.11 port 53185 connected to 192.168.2.22 port 5201
    [  8] local 192.168.2.11 port 53186 connected to 192.168.2.22 port 5201
    [ 10] local 192.168.2.11 port 53187 connected to 192.168.2.22 port 5201
    [ ID] Interval           Transfer     Bandwidth
    [  4]   0.00-1.00   sec   196 MBytes  1.65 Gbits/sec
    [  6]   0.00-1.00   sec   189 MBytes  1.58 Gbits/sec
    [  8]   0.00-1.00   sec   255 MBytes  2.14 Gbits/sec
    [ 10]   0.00-1.00   sec   286 MBytes  2.40 Gbits/sec
    [SUM]   0.00-1.00   sec   926 MBytes  7.76 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   1.00-2.00   sec   247 MBytes  2.07 Gbits/sec
    [  6]   1.00-2.00   sec   248 MBytes  2.08 Gbits/sec
    [  8]   1.00-2.00   sec   273 MBytes  2.29 Gbits/sec
    [ 10]   1.00-2.00   sec   298 MBytes  2.50 Gbits/sec
    [SUM]   1.00-2.00   sec  1.04 GBytes  8.94 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   2.00-3.00   sec   278 MBytes  2.33 Gbits/sec
    [  6]   2.00-3.00   sec   264 MBytes  2.22 Gbits/sec
    [  8]   2.00-3.00   sec   278 MBytes  2.33 Gbits/sec
    [ 10]   2.00-3.00   sec   299 MBytes  2.51 Gbits/sec
    [SUM]   2.00-3.00   sec  1.09 GBytes  9.39 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   3.00-4.00   sec   282 MBytes  2.36 Gbits/sec
    [  6]   3.00-4.00   sec   257 MBytes  2.15 Gbits/sec
    [  8]   3.00-4.00   sec   279 MBytes  2.34 Gbits/sec
    [ 10]   3.00-4.00   sec   301 MBytes  2.53 Gbits/sec
    [SUM]   3.00-4.00   sec  1.09 GBytes  9.39 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   4.00-5.00   sec   268 MBytes  2.25 Gbits/sec
    [  6]   4.00-5.00   sec   248 MBytes  2.08 Gbits/sec
    [  8]   4.00-5.00   sec   302 MBytes  2.54 Gbits/sec
    [ 10]   4.00-5.00   sec   301 MBytes  2.52 Gbits/sec
    [SUM]   4.00-5.00   sec  1.09 GBytes  9.39 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   5.00-6.00   sec   282 MBytes  2.36 Gbits/sec
    [  6]   5.00-6.00   sec   284 MBytes  2.38 Gbits/sec
    [  8]   5.00-6.00   sec   271 MBytes  2.27 Gbits/sec
    [ 10]   5.00-6.00   sec   285 MBytes  2.39 Gbits/sec
    [SUM]   5.00-6.00   sec  1.10 GBytes  9.41 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   6.00-7.00   sec   290 MBytes  2.44 Gbits/sec
    [  6]   6.00-7.00   sec   263 MBytes  2.21 Gbits/sec
    [  8]   6.00-7.00   sec   281 MBytes  2.36 Gbits/sec
    [ 10]   6.00-7.00   sec   286 MBytes  2.40 Gbits/sec
    [SUM]   6.00-7.00   sec  1.09 GBytes  9.41 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   7.00-8.00   sec   280 MBytes  2.35 Gbits/sec
    [  6]   7.00-8.00   sec   279 MBytes  2.34 Gbits/sec
    [  8]   7.00-8.00   sec   272 MBytes  2.28 Gbits/sec
    [ 10]   7.00-8.00   sec   288 MBytes  2.42 Gbits/sec
    [SUM]   7.00-8.00   sec  1.09 GBytes  9.39 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   8.00-9.00   sec   288 MBytes  2.42 Gbits/sec
    [  6]   8.00-9.00   sec   268 MBytes  2.24 Gbits/sec
    [  8]   8.00-9.00   sec   280 MBytes  2.35 Gbits/sec
    [ 10]   8.00-9.00   sec   284 MBytes  2.38 Gbits/sec
    [SUM]   8.00-9.00   sec  1.09 GBytes  9.39 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [  4]   9.00-10.00  sec   276 MBytes  2.32 Gbits/sec
    [  6]   9.00-10.00  sec   281 MBytes  2.36 Gbits/sec
    [  8]   9.00-10.00  sec   280 MBytes  2.35 Gbits/sec
    [ 10]   9.00-10.00  sec   284 MBytes  2.38 Gbits/sec
    [SUM]   9.00-10.00  sec  1.09 GBytes  9.40 Gbits/sec
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [ ID] Interval           Transfer     Bandwidth
    [  4]   0.00-10.00  sec  2.63 GBytes  2.26 Gbits/sec                  sender
    [  4]   0.00-10.00  sec  2.63 GBytes  2.26 Gbits/sec                  receiver
    [  6]   0.00-10.00  sec  2.52 GBytes  2.16 Gbits/sec                  sender
    [  6]   0.00-10.00  sec  2.52 GBytes  2.16 Gbits/sec                  receiver
    [  8]   0.00-10.00  sec  2.71 GBytes  2.33 Gbits/sec                  sender
    [  8]   0.00-10.00  sec  2.71 GBytes  2.33 Gbits/sec                  receiver
    [ 10]   0.00-10.00  sec  2.84 GBytes  2.44 Gbits/sec                  sender
    [ 10]   0.00-10.00  sec  2.84 GBytes  2.44 Gbits/sec                  receiver
    [SUM]   0.00-10.00  sec  10.7 GBytes  9.19 Gbits/sec                  sender
    [SUM]   0.00-10.00  sec  10.7 GBytes  9.19 Gbits/sec                  receiver
    

    参与测速的设备

    Windows 11 22H2 22621.963

    CPU: 5900X
    NIC: Intel X520 DA1 on PCIe Gen 2 * 4 (Max * 8)
    NIC Driver: Intel 官网最新的驱动手动安装
    

    Arch Linux 6.0.12-arch1-1

    CPU: 3900X
    NIC: Intel X520 DA1 on PCIe Gen 2 * 4 (Max * 8)
    NIC Driver: ixgbe
    

    Switch

    QNAP QSW-M408S

    第 1 条附言  ·  2022-12-16 10:46:49 +08:00
    更新:在原本的 Windows 机器上用 Live ISO 跑 Linux 测速单线程可以跑满,9.4Gbps 。

    Windows ,iperf3 on Windows 或者 Intel 的 Windows 驱动,必有一个背锅。
    6 条回复    2022-12-16 21:10:14 +08:00
    cnbatch
        1
    cnbatch  
       2022-12-16 00:14:04 +08:00
    今年上半年也有人遇到类似的问题,后来发现是火绒导致的:
    https://www.v2ex.com/t/844789

    或许可以按照这个思路排查下已安装的软件
    vibbow
        2
    vibbow  
       2022-12-16 02:09:17 +08:00
    建议用 smb 复制文件测速,很容易就跑满。
    jim9606
        3
    jim9606  
       2022-12-16 03:16:12 +08:00 via Android
    防病毒类软件试试暂时关闭?
    可以试试微软出的(疑似弃坑的) ethr ,用 go 实现的可能没兼容层问题。
    lentrody
        4
    lentrody  
       2022-12-16 08:54:14 +08:00 via Android
    用 iperf2
    unidentifiedme
        5
    unidentifiedme  
    OP
       2022-12-16 20:06:37 +08:00
    @cnbatch @jim9606 我没有安装任何安全软件,仅有 Windows Defender 。卸载了其他可能和网络相关的 Tailscale 和网易 UU 加速器,并重启。测速结果仍然是一样的,不到 5Gbps 。

    @vibbow 我测试了 SMB ,大概能跑到 700MBps ,也不满。没开 Jumbo Packet 。
    vibbow
        6
    vibbow  
       2022-12-16 21:10:14 +08:00
    @unidentifiedme 我交换机是 Juniper EX4300-48P

    Windows 上用的 AQC107 ,使用万兆光转电模块连交换机
    对端是 QNAP TS-532X ( ARM 架构 NAS),使用 DAC 线连交换机

    用 SMB 协议传文件,也没开巨帧,轻轻松松跑满万兆的。
    关于   ·   帮助文档   ·   博客   ·   API   ·   FAQ   ·   实用小工具   ·   1535 人在线   最高记录 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 24ms · UTC 17:14 · PVG 01:14 · LAX 09:14 · JFK 12:14
    Developed with CodeLauncher
    ♥ Do have faith in what you're doing.