Deep Learning, Linear Algebra, ChatGPT, Mathematics, Machine Learning.
Angeles”, “Harry Potter” or similar words that clearly belong together are considered as one token. You can read more about tokenization for example here. I will often use “word” and “token” interchangeably in this text. This text is NOT about neural networks, but to see the bigger picture, this is