Fine-tune your own Llama 2 to replace GPT-3.5/4
For translation jobs, I've experimented with Llama 2 70B (running on Replicate) v/s GPT-3.5;<p>For about 1000 input tokens (and resulting 1000 output tokens), to my surprise, GPT-3.5 turbo was <i>100x cheaper</i> than Llama 2.<p>Llama 7B wasn't up to the task fyi, producing very poor translations.<p>I believe that OpenAI priced GPT-3.5 aggressively cheap in order to make it a non-brainer to rely on them rather than relying on other vendors (even open source models).<p>I'm curious to see if others have gotten different results?