python3 -m manifest.api.app \
--model_type huggingface \
--model_name_or_path bigscience/T0pp \
--use_hf_parallelize
执行的这个命令,32G 内存,提示内存不足,想问下大概要多大?
1
coolair OP 找到了:Just to load the model, you will need ~90GB of CPU memory.
|