Large Language Model

Llama3.1 Cantonese Fine-Tuned Edition

Llama-3.1-Cantonese-8B-Instruct is a Cantonese language model based on Llama-3.1-8B-Instruct, fine-tuned using LoRA. It aims to enhance Cantonese text generation and comprehension capabilities, supporting various tasks such as dialogue generation, text summarization, and question-answering.

The GGUF format 4-bit quantized version is available for download and can be directly run for inference in LM Studio and Ollama.