Men tokenlashtirish jarayonini tushunmoqchiman. Nima uchun ingliz tilida tokenlash hind tiliga qaraganda qimmatroq? To'liq jumlalarni yoki faqat so'zlarni tokenlaysizmi?
spam lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor creativity violence