Llm, Gpt 4, Artificial Intelligence, Deep Learning, Mathematics.
simply use A, T, C, and G as the vocabulary?” Based on first principles, one might have considered why LLMs weren’t simply trained on 26 characters to begin with? :) Character-level (and even k-mers) adds unbounded complexity and numerical instability to LLMs. You need to be on the AI Research side