Commit Graph
5 Commits
Author SHA1 Message Date
liferecordsandGitHub 9d8b7e6039 support infer with transformers
add use_hf
2025-08-05 14:38:02 +08:00
liferecordsandGitHub 2a7d5e1f5a support infer with transformers
add `--use_hf true` to use transformers,but the speed is very slower than vllm
2025-08-05 14:18:02 +08:00
liferecordsandGitHub f02e0ffd25 Update README.md 2025-08-01 16:39:02 +08:00
liferecordsandGitHub 1fd404be07 Update requirements.txt 2025-08-01 16:37:06 +08:00
liferecordsandGitHub 948f1c2a06 Update download_model.py
download models with modelscope
2025-08-01 16:36:19 +08:00