Signed-off-by: Roger Wang <hey@rogerw.io>
This commit is contained in:
Roger Wang
2025-10-01 00:46:49 -07:00
parent c445ffb512
commit 37a0b4d5c0
+2 -1
View File
@@ -1031,7 +1031,8 @@ We highly recommend using vLLM for deployment and inference. All of our evaluati
vllm serve rednote-hilab/dots.ocr --trust-remote-code --async-scheduling --gpu-memory-utilization 0.95 vllm serve rednote-hilab/dots.ocr --trust-remote-code --async-scheduling --gpu-memory-utilization 0.95
# vLLM API Demo # vLLM API Demo
# See demo/demo_vllm.py for details on parameter and prompt settings that help achieve the best output quality. # See dots_ocr/model/inference.py for details on parameter and prompt settings
# that help achieve the best output quality.
python3 ./demo/demo_vllm.py --prompt_mode prompt_layout_all_en python3 ./demo/demo_vllm.py --prompt_mode prompt_layout_all_en
``` ```