readme: ---
  language: 
  - zh
  tags:
  - SongNet
  - pytorch
  - zh
  - Text2Text-Generation
  license: "apache-2.0"
  widget:
  - text: "丹枫江冷人初去"
  
  ---
  
  # SongNet pretrain (songnet-base-chinese) Model
  SongNet中文预训练模型
  
  SongNet的网络结构：
  
  ![arch](songnet-network.png)
  
  ## Usage
  
  本项目开源在文本生成项目：[textgen](https://github.com/shibing624/textgen)，可支持SongNet模型。
  
  模型文件组成：
  ```
  songnet-base-chinese
      ├── pytorch_model.bin
      └── vocab.txt
  ```
  
  
  ### 相关内容
    - [SongNet paper](https://aclanthology.org/2020.acl-main.68/)
    - [textgen](https://github.com/shibing624/textgen)
    
  
  如果需要训练SongNet模型，请参考[https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py](https://github.com/shibing624/textgen/blob/main/examples/language_generation/training_zh_songnet_demo.py)
  
  
  ## Citation
  
  ```latex
  @software{textgen,
    author = {Xu Ming},
    title = {textgen: Implementation of Text Generation models},
    year = {2022},
    url = {https://github.com/shibing624/textgen},
  }
  ```
  