Wow, congrats on tuning the model / building the Space so fast  !
I think you’re right that the model seems to only predict positive sentiments - what I suggest is looking at the distribution of emojis in tweet_eval and perhaps consider filtering the dataset for a select number of emojis that capture various emotions

Screen Shot 2021-11-16 at 11.04.121528×359 27 KB