This repository contains the Pali segments input files for DharmaNexus.
The filenames in this repository follow a specific format to ensure consistency and ease of parsing across all languages. Each filename is structured as follows:
Where:
LLis a two-letter language tokencategoryis the category namefilenameis the specific filename
For example: PA_dn_4.tsv or SA_T06_sthmavt.tsv
This naming convention is designed to:
- Maintain consistency across all languages in the DharmaNexus project.
- Allow for easy parsing of language, category, and filename information without resorting to regular expressions.
- Minimize the risk of exceptions that could break parsing logic.
With this format, you can reliably extract language, category, and filename information by simply splitting the filename on underscores.
Example (in Python):
filename = "pn_dn_4"
lang, category, text = filename.split('_')