metadata

base_model: yentinglin/Llama-3-Taiwan-70B-Instruct
language:
  - zh
  - en
license: llama3
model_creator: yentinglin
model_name: Llama-3-Taiwan-70B-Instruct
model_type: llama
pipeline_tag: text-generation
quantized_by: minyichen
tags:
  - llama-3

Llama-3-Taiwan-70B-Instruct - GPTQ

Model creator: Yen-Ting Lin
Original model: Llama-3-Taiwan-70B-Instruct

Description

This repo contains GPTQ model files for Llama-3-Taiwan-70B-Instruct.

Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.

GPTQ models for GPU inference
Yen-Ting Lin's original unquantized model

Prompt template: Vicuna

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT: