Post
135
Here are my complete project notebooks hosted to my project titled "Multimodal Custom Finetuned LLM for Virtual Healthcare Consultations" at OSF - https://osf.io/ne2zh/
Pranav Upadhyaya
pranavupadhyaya52
AI & ML interests
None yet
Recent Activity
liked
a model
24 days ago
unsloth/Qwen2.5-Omni-7B-GGUF
Organizations
None yet
Posts 2
Post
2187
Hello everyone. I've built a medical AI assistant application.
pranavupadhyaya52/MediWiki_Medical_Assistant
It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).
It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).
Please let me know your thoughts on my project and how I can improve it further. Thank you.
pranavupadhyaya52/MediWiki_Medical_Assistant
It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).
It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).
Please let me know your thoughts on my project and how I can improve it further. Thank you.