Your request cart is empty!
Dataset Description
1,01,25,770 Words | 2,470 Tittles | XML format | 5 domains
Punjabi is the principal and administrative language
of Punjab. Punjabi is not only spoken in Punjab but in India, it is also a language
of Lehnda Punjab in Pakistan. Punjabi is an Indo-Aryan language. This same the Punjabi language is being written in two epigraphs, in Gurmukhi script and
Shahmukhi script. In our Eastern Punjabi, it is being used in Gurmukhi and Lehnda
Punjab (Pakistan) using Shahmukhi script. Punjabi is written in Shahmukhi
scripts as well. ‘Shahmukhi’ is a variant of ‘Perso-Arabic’ script. But LDC-IL
Punjabi text corpus is collected in the Gurmukhi script for contemporary usage.
Punjabi Text Corpus encoded in a machine-readable
form and stored in a standard format. The major encoding being used is Unicode
and stored in XML format. The data is embedded with metadata information. The
corpus has been created from the contemporary text in typed and crawled methods.
LDC-IL Punjabi Text Corpus size is 1, 01, 25,770 words drawn from 2,470 different
titles. The five major domains are Aesthetics, Science & Technology, Social
Science, Commerce and Mass Media.
The available Text Corpus details:
|
Domains |
Words |
Percentage of Total Corpus |
|
Aesthetics |
41,90,199 |
41.38 % |
|
Commerce |
56,205 |
00.56 % |
|
Mass Media |
42,74,922 |
42.22 % |
|
Science and Technology |
3,84,078 |
03.79 % |
|
Social Sciences |
12,20,366 |
12.05 % |
For any research-based citations, please use the following citations:
- Ramamoorthy, L., Narayan Choudhary, Poonam Dhillon, Sarbjeet Kaur & Sandeep Singh. 2019. A Gold Standard Punjabi Raw Text Corpus. Central Institute of Indian Languages, Mysore.
- Choudhary,
Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview" in Linguistic
Resources for AI/NLP in Indian Languages,
Central Institute of Indian Languages, Mysore. pp. 1-10.
Item specifics
- Authors Ramamoorthy L., Narayan Choudhary, Poonam Dhillon, Sarbjeet Kaur, Sandeep Singh
- Corpus Type Raw Corpus
- Catalogue Number 1163
- ISBN 978-81-7343-262-0
- Data Source Typed+Cleaned, Crawled
- Character Count 50824349
- Word Count 10125770
- Release Date 04-Apr-2019
- Terms and Conditions General instructions for use of the resources provided by LDC-IL.