baidu 爬虫抓取的时候 gzip 没有生效

有没有大佬知道是为什么啊…… 谢谢 >_<

贴一下 nginx 的设置……

    gzip               on;
    gzip_vary          on;

    gzip_comp_level    6;
    gzip_buffers       32 8k;

    gzip_min_length    1000;
    gzip_proxied       any;
    gzip_disable       "msie6";

    gzip_http_version  1.1;

    gzip_types         text/plain text/css application/json application/x-javascript text/xml application/xml application/xml+rss text/javascript application/javascript image/svg+xml;

在百度的站长工具-抓取诊断里看

HTTP/1.1 200 OK
Date: Wed, 24 Oct 2018 14:19:13 GMT
Content-Type: text/html
Content-Length: 1501880
Connection: close
Server: nginx/1.10.3 (Ubuntu)
Last-Modified: Wed, 24 Oct 2018 13:20:29 GMT
Vary: Accept-Encoding

这个 Content-Length …… 有点迷

https://varvy.com/tools/gzip/ 测试的结果

Original size: 1501880
Compressed size: 153241
File reduced by: 1349 kb