Model Releases
SinLlama -- A Large Language Model for Sinhala
arXiv:2508.09115v5 Announce Type: replace Abstract: Low-resource languages such as Sinhala are often overlooked by open-source Large Language Models (LLMs). In this research, we extend an existing mul
arXiv:2508.09115v5 Announce Type: replace Abstract: Low-resource languages such as Sinhala are often overlooked by open-source Large Language Models (LLMs). In this research, we extend an existing multilingual LLM (Llama-3-8B) to better serve Sinhala. We enhance the LLM tokenizer with Sinhala specific vocabulary and perform continual pre-training on a cleaned 10 million Sinhala corpus, resulting in the SinLlama model. This is the very first decoder-based open-source LLM with explicit Sinhala support. When SinLlama was instruction fine-tuned for three text classification tasks, it outperformed base and instruct variants of Llama-3-8B by a significant margin.
Related
- AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages
- BavGround: A Benchmark for Regional Cultural Grounding and Dialect Competence in Bavarian
- Instant Personalized Large Language Model Adaptation via Hypernetwork
- LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models
Source: arXiv cs.CL | 2026-09-01