Joy Olusanya
Linguist and NLP Engineer at Center for Low-Resource Languages and Cultures (CLRLC)
Joy Olusanya is an NLP engineer and researcher with a background in Linguistics from Obafemi Awolowo University. Her work centres on advancing Natural Language Processing (NLP) for low-resource languages, spanning both text-based and speech-based technologies. She serves as the Workshop Chair for the Centering Low-Resource Languages and Cultures in the Age of Large Language Models (CLRLC-LLMs) workshop at NeurIPS 2025. She is also the Founder and CEO of the Center for Low-Resource Languages and Cultures (CLRLC), a global ecosystem dedicated to democratising AI through ethical data curation, inclusive research, and community-driven innovation.
Abstract
Large language models (LLMs) and Neural Machine Translation (NMT) systems have demonstrated strong performance across a wide range of translation tasks. However, translating culturally grounded content such as idiomatic expressions remains a persistent challenge due to their non-compositional nature. This challenge is particularly pronounced in low-resource African languages such as Yoruba, where idioms carry deep cultural meaning yet remain underrepresented in machine translation research. In this study, we evaluate three models: GPT-4o mini, Qwen2.5-7B-Instruct, and NLLB-200 on Yoruba-to-English idiom translation. We examine direct machine translation as well as zero-shot and few-shot prompting strategies using a curated dataset of Yoruba idioms annotated with their literal meanings and corresponding English idiomatic equivalents. Evaluation is conducted using BLEU, chrF+, and BERTScore F1, alongside human evaluation based on adequacy, fluency, and preservation of literal meaning. The results show that GPT-4o mini performs best overall, particularly in the zero-shot and few-shot settings, according to the chrF+ metric. Notably, GPT-4o mini consistently achieves the highest scores for literal meaning across all models in human evaluation. This suggests a tendency for LLMs to default to literal translations when handling culturally grounded expressions. These findings highlight the limitations of current translation models in capturing figurative and pragmatic meaning, and underscore the need for culturally grounded corpora for low-resource African languages, particularly Yoruba, to support the preservation of cultural identity in language technologies.