Update README.md
Browse files
    	
        README.md
    CHANGED
    
    | 
         @@ -482,7 +482,7 @@ Many repositories now support fine-tuning of the InternVL series models, includi 
     | 
|
| 482 | 
         | 
| 483 | 
         
             
            ### LMDeploy
         
     | 
| 484 | 
         | 
| 485 | 
         
            -
            LMDeploy is a toolkit for compressing, deploying, and serving  
     | 
| 486 | 
         | 
| 487 | 
         
             
            ```sh
         
     | 
| 488 | 
         
             
            pip install lmdeploy>=0.5.3
         
     | 
| 
         @@ -574,7 +574,7 @@ print(sess.response.text) 
     | 
|
| 574 | 
         
             
            LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
         
     | 
| 575 | 
         | 
| 576 | 
         
             
            ```shell
         
     | 
| 577 | 
         
            -
            lmdeploy serve api_server OpenGVLab/InternVL2-40B -- 
     | 
| 578 | 
         
             
            ```
         
     | 
| 579 | 
         | 
| 580 | 
         
             
            To use the OpenAI-style interface, you need to install OpenAI:
         
     | 
| 
         | 
|
| 482 | 
         | 
| 483 | 
         
             
            ### LMDeploy
         
     | 
| 484 | 
         | 
| 485 | 
         
            +
            LMDeploy is a toolkit for compressing, deploying, and serving LLMs & VLMs.
         
     | 
| 486 | 
         | 
| 487 | 
         
             
            ```sh
         
     | 
| 488 | 
         
             
            pip install lmdeploy>=0.5.3
         
     | 
| 
         | 
|
| 574 | 
         
             
            LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
         
     | 
| 575 | 
         | 
| 576 | 
         
             
            ```shell
         
     | 
| 577 | 
         
            +
            lmdeploy serve api_server OpenGVLab/InternVL2-40B --server-port 23333 --tp 2
         
     | 
| 578 | 
         
             
            ```
         
     | 
| 579 | 
         | 
| 580 | 
         
             
            To use the OpenAI-style interface, you need to install OpenAI:
         
     |