Tesslate

/

UIGEN-T3-14B-Preview-Q8_0-GGUF

like 41

Follow

TesslateAI 187

Hi,

I see the Readme mentions Bootstrap support, is this something you are planning to add in the near future? I have tested the model and it tries to fall back on Tailwind at every opportunity.

Using /no_think reveals that it knows about the fairly recent BS5 version (5.3.2), but the model tries to avoid using it unless repeatedly coerced.

Test prompt to enforce BS5 usage:

Create a small card using Bootstrap 5.3.2, do not use any other libraries or frameworks apart from what is bundled in the full Bootstrap.
You are not allowed to use Tailwind or Google fonts, only the Bootstrap itself.

Inference settings:

llama-server --cache-type-v q8_0 -fa -ngl 99 -t 12 --jinja -sm row --temp 0.6 --top-p 0.95 --min-p 0.0 --top-k 20 --ctx-size 20000 -m ~/Downloads/uigen-t3-preview-14b-q8_0.gguf