description: <p>This is a LoRA for the Llama-2-70b-Guanaco LLM.  This is not a LoRA for Stable Diffusion.  </p><p></p><p>This is a Medical Knowledge LoRA made for use with this model: llama-2-70b-Guanaco-QLoRA-fp16 <a target="_blank" rel="ugc" href="https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-fp16">https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-fp16</a>) (you can use the quantized version of the model too).</p><p></p><p>I'm experimenting with making LLM LoRAs and thought this one tuned out good enough to share.  Use at your own risk however, I am not a medical expert and do not take responsibility for the model producing incorrect information.</p><p></p><p>This LoRA was made using Oobabooga (<a target="_blank" rel="ugc" href="https://github.com/oobabooga/text-generation-webui">https://github.com/oobabooga/text-generation-webui</a>) and these training data: <a target="_blank" rel="ugc" href="https://huggingface.co/datasets/BI55/MedText">https://huggingface.co/datasets/BI55/MedText</a></p><p></p><p>I'll be working on various versions of this LoRA (and other types of LoRAs) as I explore the various ways in which to construct these add-on models. </p><p></p><p>The Hugging Face page for all this is here:<br /><a target="_blank" rel="ugc" href="https://huggingface.co/AARon99/MedText-llama-2-70b-Guanaco-QLoRA-fp16">https://huggingface.co/AARon99/MedText-llama-2-70b-Guanaco-QLoRA-fp16</a></p><p></p><p>If you too are curious on how to construct these LLM based LoRAs, the Hugging Face page has additional information intended to help beginners, like myself. </p>
modelVersions.availability: Public
modelVersions.baseModel: Other
modelVersions.baseModelType: Standard
modelVersions.description: <p>This LoRA was trained using the "Raw text file" option in Oobabooga, I'm currently working on a LoRA that uses "Formatted Data" but this process takes a lot longer.  </p><p>Simply load the LoRA with your model and start asking it medical questions in the "instruct" conversation field of Oobabooga and watch as you get pretty decent responses, best inference parameters are those from "Divine Intellect" </p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/128594
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/128594
modelVersions.AutoV1: AA75325F
modelVersions.AutoV2: BB93A56C27
modelVersions.BLAKE3: 8B5BEB6AF78B2D8F87D9FFE69056E49F95195CF2C1582622E92EE86BFC824FF9
modelVersions.CRC32: 098890F1
modelVersions.SHA256: BB93A56C271A4472686161A9006B327E0ECC8E2FA5142A6794ACE63DA5D8F67B
modelVersions.format: Other
modelVersions.name: MedGuac70BLlamaV1.zip
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2023-07-29T13:12:17.012Z
modelVersions.type: Training Data
modelVersions.virusScanResult: Success
modelVersions.hash: U05OW@014,00E1M{=}xt00V?~qxu^4t7GHW=
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/feb77504-76a3-4c24-a573-6ca57e1569cb/width=450/1775058.jpeg
modelVersions.hash: U05X}v?wROxvLgtQs+Rk8wM{kYkC00RktSxt
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6dce50d5-b458-4554-9dcb-8e39dd97d378/width=450/1775065.jpeg
modelVersions.name: v1.0
modelVersions.publishedAt: 2023-07-29T13:12:01.450Z
name: MedText-llama-2-70b-Guanaco-QLoRA-fp16 (Medical Knowledge LLM LoRA)
tags: tool information