A Gold Standard Odia Raw Text Corpus

SKU: LDCIL-132 | Model: 1159 | ISBN: 978-81-7343-258-3

Description & Overview

15, 88, 287 Words | 206 Titles | XML format | 05 Text Domains


Odia (formerly Oriya) is a major Indo-Aryan language, which is spoken in the states of Odisha, West Bengal, Jharkhand, Chhattisgarh, and Andhra Pradesh. It is the official language of Odisha and Jharkhand. Odia is the sixth Classical Status language as designated by the Govt. of India. LDC-IL Odia Raw Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format, size of corpus, authenticity, etc.. It’s encoded in a machine-readable form and stored in a standard format. All encoding being used is Unicode compatible fonts and stored in XML format. The data is embedded with metadata information. The corpus has been developed from contemporary texts in a typed method. 

The corpus of Odia raw text can be generally classified as literary and non- literary texts. Huge amount of literary texts are available in Odia, but knowledge/scientific texts are less, thus LDC-IL attempted to develop a balanced raw text corpus of Odia. Data has been collected from the books and the newspapers and it is verified to true to the original texts. 


The available of Raw Text Corpus details:


Domains

Words

Percentage of Total

Corpus

Aesthetics 

5,11,887

32.23 %

Commerce

19,616

1.24 %

Mass Media

8,02,100

50.50 %

Science and Technology

31, 589

1.99 %

Social Sciences

2, 23,095

14.05 %


A detailed explanation of the Odia Text Corpus will be available in the Odia Raw Text Corpus Documentation. 

For any research-based citations, please use the following citations: 

  • Ramamoorthy, L., Narayan  Choudhary, Santosh Kumar Mohanty, Raja Kumar Naik,  Pramod Kumar Rout & Kshirod Kumar Das. 2019A Gold Standard Odia Raw Text Corpus.  Central Institute of Indian Languages, Mysore.
  • Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.

Dataset Specifications

Authors Ramamoorthy L., Narayan Choudhary, Santosh Kumar Mohanty, Raja Kumar Naik, Pramod Kumar Rout, Kshirod Kumar Das,
Corpus Type Raw Corpus
Catalogue Number 1159
ISBN 978-81-7343-258-3
Data Source Typed+Cleaned
Character Count 10304173
Word Count 1588287
Release Date 04-Apr-2019
Terms and Conditions General instructions for use of the resources provided by LDC-IL.

Documentation & Sample Files