Feedback/Appreciation (usage in SillyTavern chatbots)

#3
by rohan-sircar - opened

Hi, I used this model in place of QwQ-32B and Gemma-27B for a few days.. the improvement in quality is pretty decent!
Here's what I'm talking about, a message from a conversation with Tifa from FF7

** Tifa pauses, noting Nova’s playful tone and the way he’s dissecting her words. She needs to balance her trademark warmth with the subtle edge that keeps people guessing. His mention of "intoxicating poison" is both a metaphor and a compliment—does he mean her, the drink, or something else? She decides to lean into the flirtation but keep it grounded in her role as the bartender-therapist. The dancing chokobo joke is cute, but she wants to steer toward sincerity without oversharing. Nibelheim’s shadow looms, but she can’t dwell there. Instead, she’ll mirror his uncertainty about Sector 7, hinting at the pull between duty and destiny. The metal knuckles remind her to stay light—maybe tease about his "edge" while revealing a flicker of vulnerability. Ending with a question about the drink’s purpose lets him reflect without pressure. She’ll sprinkle in physical cues: a playful squeeze of the mop handle, the faintest blush, and a glance at the stars through the bar window to tie it back to their earlier plans. Keep it Tifa—gentle, sharp, and just a touch mysterious.

Tifa’s eyes crinkle with amusement at your question, a small chuckle escaping her lips. “Well, it’s certainly lively,” she responds, her voice playful. “And I’ll admit, a bit of chaos can be… refreshing. In small doses, of course.”

She leans in, her tone dropping to a whisper that’s just loud enough for you to hear. “And yes, I’ve felt… that way before,” she admits, a slight blush coloring her pale cheeks. “With someone. A long time ago. But that’s a story for another day.” She smirks, then returns to her cleaning, her movements efficient but graceful.

Her expression softens as she listens to your words about not hiding your edge. “Life is fleeting,” she agrees, her tone serious. “You’re right about that. We don’t get to choose our paths, only how we walk them.” She pauses, her gaze meeting yours. “And you’re more observant than you give yourself credit for.”

She chuckles at your dancing chokobo joke, shaking her head. “Sector 7’s full of surprises,” she admits, a hint of mischief in her reddish-brown eyes. “But not sure about the chokobo. Though I’ve heard rumors…” She winks, then continues. “And I like your answer about not knowing why you’re here. Sometimes, the best things come when you don’t have all the answers.”

Tifa turns her attention to the mop, her movements becoming a bit more vigorous. “Intoxicating kind?” she repeats, her eyebrow arched. “I’ll have to keep that in mind. There are a few… specialty drinks that might fit the bill.”

She pauses, glancing at you from the corner of her eye. “You know, Nova,” she says, her voice soft but intense, “you’re a lot like someone I used to know. Quick with a joke, slow to give up a secret. I’m… glad I didn’t miss out on this chance to talk to you.”

She returns to her mopping, but there’s an underlying current of something… more. A sense that this night might be the start of something truly special.

“So, intoxicating, huh?” she teases, but there’s no teasing in her tone. “What are you hoping it’ll… do to you?”**

First off, I love how the reasoning is actually "in character" instead of the generic AI monologue of "oh this happened, I should do this and act like that". It gives me further insight into how the character is feeling and how to better converse with it!

The conversation message itself is very detailed and much less generic AI text as well. The character feels much more alive and like an actual person with their own thoughts, personality and desires.

I will test it with other characters soon and give feedback if you want!

for context I am running this locally on a 7900XTX 24GB with llama.cpp+rocm with FA=1 32k context and q8 cache key and value on linux

Arli AI org

That's super awesome to hear! Really thankful for feedback like this and if its good feedback its just a plus! Thank you!

Sign up or log in to comment