New discussion

model is not working

1
#74 opened about 1 month ago by lowpex

Nvidia NIM?

#71 opened about 1 month ago by anujn

Batch inference example

#70 opened about 1 month ago by amezasor

Model Loading since 2hrs

#69 opened about 1 month ago by gagarwal1

Function calling - force tool calling

1
#64 opened about 1 month ago by rtilman

Does vllm support this model yet?

#63 opened about 1 month ago by SongXiaoMao

Please release also a 7B-9B model!

#51 opened about 2 months ago by ZeroWw

My "SILLY" experiment.

#50 opened about 2 months ago by ZeroWw

AssertionError & Shard Cannot Start

#48 opened about 2 months ago by subapon

System Prompt added to last message

18
#47 opened about 2 months ago by turentado

Getting Error: ShardCannotStart

3
#44 opened about 2 months ago by deepaksiloka

Model's Hidden Dim in readme is Wrong

1
#38 opened about 2 months ago by ShiLuohe

Add to inference APIs

1
#33 opened about 2 months ago by mrfakename

小説生成

1
#31 opened 2 months ago by AIzeke

NAN when training

1
#29 opened 2 months ago by nthehai01

My quantizations.

1
#26 opened 2 months ago by ZeroWw

How should vllm start it?

2
#24 opened 2 months ago by SongXiaoMao

el medio ambiente

#23 opened 2 months ago by mayumy

System requirements?

1
#22 opened 2 months ago by IgnacioTechie

Issues with Fine-Tuning

9
#21 opened 2 months ago by ironrock

Update README.md

#19 opened 2 months ago by hotbiz

gguf

11
#17 opened 2 months ago by daisr

Some basic access problem

3
#15 opened 2 months ago by Jomsborg

mistral-chat doesn't work

6
#12 opened 2 months ago by cloudyu