Model Card for Model Mistral-7B-v0.1-1-over-2

I'm experimenting with the weight matrices in neural networks. This is a clone of Mistral-7B-v0.1 with some weight matrices replaced.

I'm interested in seeing how the adjustmenets affect performance on existing metrics.

Model Details

Research in progress! Demons could come out of your nose if you use this.

Model Description

A modification of mistralai/Mistral-7B-v0.1. Thanks to their team for sharing their model.

Modified by: Dr. Alex W. Neal Riasanovsky
Model type: pre-trained
Language(s) (NLP): English
License: Apache-2.0

Bias, Risks, and Limitations

Use your own risk. I have no idea what this model's biases and limitations are. I just want to see if the benchmark values are similar to those from Mistral-7B-v0.1. I am setting up a long computational experiment to test some ideas.