convaiinnovations
/

hindi-foundational-model-base

Text Generation

hindi_causal_lm

Model card Files Files and versions Community

convaiinnovations commited on Apr 18

Commit

de95a78

·

verified ·

1 Parent(s): 94011d2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ pipeline_tag: text-generation
 This repository contains a custom-trained Hindi Causal Language Model designed for Hindi text generation.
 ## Model Description
-- **Model Size:** 97.74M (YAH !!! Its very small)
 - **Architecture:** Custom Transformer (12 layers, hidden=768, 16 heads, ffn=3072, act=swiglu, norm=rmsnorm) based on the `HindiCausalLM` class with Hindi-specific optimizations:
   - Multi-resolution attention to capture both character-level and word-level patterns

 This repository contains a custom-trained Hindi Causal Language Model designed for Hindi text generation.
 ## Model Description
+- **Model Size:** 113M (YAH !!! Its very small)
 - **Architecture:** Custom Transformer (12 layers, hidden=768, 16 heads, ffn=3072, act=swiglu, norm=rmsnorm) based on the `HindiCausalLM` class with Hindi-specific optimizations:
   - Multi-resolution attention to capture both character-level and word-level patterns