BioGPTForSequenceClassification
### Feature request

It would be nice to have this available.

### Motivation

I'm studying some biomedical classification datasets and I would like to try BioGPT with them.

### Your contribution

I could send a PR if you want. I guess it shouldn't be too hard, I could look at another model trained with Casual LM and implement `BioGPTForSequenceClassification` like that one, am I right?
Sure, see this PR as an example: https://github.com/huggingface/transformers/pull/18123<|||||>Ty so much, I'll give it a try.<|||||>@GuillemGSubies There has been no activity on your PR #21535 since a while. I would like to fix the issue and complete the PR. Should I proceed? Are you still working on this issue? <|||||>You can take it, I'm not working on it right now<|||||>Hello @awinml , were you able to resolve this issue? If not I'd be interested in working on this problem.<|||||>@jprivera44 Yeah, I am still working on it. Most of the work is done. There's just one test left to be fixed. I will mostly fix it up by the end of this week.<|||||>@awinml are u still working on this issue??
<|||||>@sushmanthreddy As mentioned in https://github.com/huggingface/transformers/issues/21530#issuecomment-1504765529, I am still working on the issue. There is only one failing test left to be fixed. The PR is still under review, hence the inactivity.