SwiftMistralCoreML
text
SwiftMistralCoreML
new_line
Hi Everyone,
text
Hi Everyone,
new_line
new_line
I have created a Swift library to interact with Mistral 7B models in CoreML on macOS.
text
I have created a Swift library to interact with Mistral 7B models in CoreML on macOS.
new_line
new_line
I hope you find it helpful.
text
I hope you find it helpful.
new_line
new_line
https://github.com/cardona/SwiftMistralCoreML
https://github.com/cardona/SwiftMistralCoreML
link
new_line
new_line
An open-source Swift library that enables macOS and iOS projects to utilize the Mistral-Interact7B models (INT4 and upcoming FP16) in chat mode. This library includes a complete Swift implementation of the tokenizer and Byte Pair Encoding (BPE) encoder, providing an out-of-the-box solution for integrating advanced language models into your Swift applications.
text
An open-source Swift library that enables macOS and iOS projects to utilize the Mistral-Interact7B models (INT4 and upcoming FP16) in chat mode. This library includes a complete Swift implementation of the tokenizer and Byte Pair Encoding (BPE) encoder, providing an out-of-the-box solution for integrating advanced language models into your Swift applications.
new_line
new_line
Features
text
Features
new_line
new_line
Full Swift Implementation: Includes tokenizer and BPE encoder written entirely in Swift.
text
Full Swift Implementation: Includes tokenizer and BPE encoder written entirely in Swift.
new_line
CoreML Integration: Leverages Apple's CoreML framework to run Mistral-Interact7B models efficiently.
text
CoreML Integration: Leverages Apple's CoreML framework to run Mistral-Interact7B models efficiently.
new_line
Multiple Decoding Strategies: Supports Greedy and Top-K sampling, with plans to add more strategies.
text
Multiple Decoding Strategies: Supports Greedy and Top-K sampling, with plans to add more strategies.
new_line
Chat Functionality: Designed to work in chat mode for interactive applications.
text
Chat Functionality: Designed to work in chat mode for interactive applications.
new_line
FP16 Support (Coming Soon): Future version will support FP16 models for improved performance.
text
FP16 Support (Coming Soon): Future version will support FP16 models for improved performance.
new_line
new_line
SwiftMistralCoreML
Hi Everyone,

I have created a Swift library to interact with Mistral 7B models in CoreML on macOS.

I hope you find it helpful.

https://github.com/cardona/SwiftMistralCoreML

An open-source Swift library that enables macOS and iOS projects to utilize the Mistral-Interact7B models (INT4 and upcoming FP16) in chat mode. This library includes a complete Swift implementation of the tokenizer and Byte Pair Encoding (BPE) encoder, providing an out-of-the-box solution for integrating advanced language models into your Swift applications.

Features

Full Swift Implementation: Includes tokenizer and BPE encoder written entirely in Swift.
CoreML Integration: Leverages Apple's CoreML framework to run Mistral-Interact7B models efficiently.
Multiple Decoding Strategies: Supports Greedy and Top-K sampling, with plans to add more strategies.
Chat Functionality: Designed to work in chat mode for interactive applications.
FP16 Support (Coming Soon): Future version will support FP16 models for improved performance.


🚀
shtefcs John6666 Joseph717171 victor xi0v younissaqib
🔥
DhamuR fibaek Joseph717171 xi0v stodev
6708d10f793a1fcd6c7633fb
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/TwR65k1JgO_t3l4pM1UjA.png
Stefan Smiljkovic
shtefcs
user
60df8d073009e0a7f77a61c8
https://cdn-avatars.huggingface.co/v1/production/uploads/60df8d073009e0a7f77a61c8/h0hQ5wMxS05XkGiwbrBvw.jpeg
Dennis Zollmann
wottpal
user
64205173e40f66bcd1e2d386
/avatars/8f85a0d335476966fe3da255ad0e55d6.svg
Oscar
Skataka
user
67463ac1af3b9e1b5992407b
/avatars/fba3caeceb43aac602d7b5a9e1c7a0ee.svg
ingoampt
ingoampt
user