Upload folder using huggingface_hub
Browse files
README.md
CHANGED
@@ -72,8 +72,8 @@ Data preprocessing included:
|
|
72 |
```python
|
73 |
from transformers import GPT2LMHeadModel, GPT2Tokenizer
|
74 |
|
75 |
-
model = GPT2LMHeadModel.from_pretrained("
|
76 |
-
tokenizer = GPT2Tokenizer.from_pretrained("
|
77 |
|
78 |
prompt = "অসমৰ ইতিহাস"
|
79 |
inputs = tokenizer(prompt, return_tensors="pt")
|
@@ -81,3 +81,33 @@ outputs = model.generate(**inputs, max_length=50, do_sample=True)
|
|
81 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
82 |
```
|
83 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
72 |
```python
|
73 |
from transformers import GPT2LMHeadModel, GPT2Tokenizer
|
74 |
|
75 |
+
model = GPT2LMHeadModel.from_pretrained("BharatVLM/AssameseGPT2")
|
76 |
+
tokenizer = GPT2Tokenizer.from_pretrained("BharatVLM/AssameseGPT2")
|
77 |
|
78 |
prompt = "অসমৰ ইতিহাস"
|
79 |
inputs = tokenizer(prompt, return_tensors="pt")
|
|
|
81 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
82 |
```
|
83 |
|
84 |
+
## 📄 License
|
85 |
+
|
86 |
+
This model is released under the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.
|
87 |
+
Commercial use is not permitted. Use is allowed for academic and research purposes only.
|
88 |
+
|
89 |
+
## 📬 Citation
|
90 |
+
|
91 |
+
Please cite this model as:
|
92 |
+
|
93 |
+
@misc{assamesegpt2,
|
94 |
+
author = {Your Name},
|
95 |
+
title = {Assamese GPT-2 Model},
|
96 |
+
year = 2025,
|
97 |
+
howpublished = {\url{https://huggingface.co/BharatVLM/AssameseGPT2}},
|
98 |
+
note = {Trained using IndicCorpV2 and OSCAR corpora}
|
99 |
+
}
|
100 |
+
|
101 |
+
## 🧰 Framework Versions
|
102 |
+
|
103 |
+
- Transformers: 4.52.0.dev0
|
104 |
+
|
105 |
+
- PyTorch: 2.5.1+cu121
|
106 |
+
|
107 |
+
- Datasets: 3.6.0
|
108 |
+
|
109 |
+
- Tokenizers: 0.21.1
|
110 |
+
|
111 |
+
|
112 |
+
## Contact Us
|
113 |
+
For questions or academic collaboration, please contact: [email protected].
|