pytorch bart seq2seq ko transformers license:mit text2text-generation
.gitattributes README.md config.json pytorch_model.bin summ.png tokenizer.json
---
language: ko
tags:
- bart
license: MIT
---

# Korean News Summarization Model

## How to use

```python
import torch
from transformers import PreTrainedTokenizerFast
from transformers import BartForConditionalGeneration

tokenizer = PreTrainedTokenizerFast.from_pretrained(
    'gogamza/kobart-summarization',
    bos_token='<s>', eos_token='</s>', unk_token='<unk>', pad_token='<pad>', mask_token='<mask>')

model = BartForConditionalGeneration.from_pretrained('gogamza/kobart-summarization')

text = "과거를 떠올려보자. 방송을 보던 우리의 모습을..."

raw_input_ids = tokenizer.encode(text)
input_ids = [tokenizer.bos_token_id] + \\
    raw_input_ids + [tokenizer.eos_token_id]
summary_ids = model.generate(torch.tensor([input_ids]),
                                max_length=150,
                                early_stopping=False,
                                num_beams=5,
                                repetition_penalty=1.0,
                                eos_token_id=tokenizer.eos_token_id)
summ_text = tokenizer.batch_decode(summary_ids.tolist(), skip_special_tokens=True)[0]
```





