A Gold Standard Bodo Raw Text Corpus

SKU: LDCIL-180 | Model: 1110 | ISBN: 978-81-7343-209-5

Description & Overview

29,15,544 Words | 80 Tittles | XML format | 5 domains

Bodo is a major tribal language that belongs to the Tibeto-Burman language family. Bodo language is spoken in Assam and other parts of North-East India. The Bodo language is one of the major language of Assam and official language in the Bodoland Territorial Area Districts. Several rivers like Dihing, Dibru, Dihong, Dikrai, etc. in the North-East region were termed after some Bodo words which reveal the three-dimensional distribution arrangement of connected ethnocultural groups with then cultural personae and occurrence. Bodo is written in Devanagari. The Bodo text corpus is extracted from contemporary text sources. LDC-IL Bodo Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format, size of corpus, authenticity, etc. For collecting text corpus LDC-IL adopts a standard category list of various domains and a prior set of criteria. Bodo text corpus is collected from various libraries in Assam mostly from Kokrajhar, Chirang, Baksa, Udalguri, and Guwahati. LDC-IL attempts to develop balanced text corpora of Bodo. Data has been collected from books, magazines, and newspapers and it is verified true to the original text. Bodo Text Corpus encoded in a machine-readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from the contemporary text in typed and crawled methods.


The available Text Corpus Details:


Domains

Words

Percentage of Total

Corpus

Aesthetics 

4,74,960

16.29 %

Commerce

25,064

0.86 %

Mass Media

16,79,511

57.61 %

Science and Technology

1,72,151

5.90 %

Social Sciences

5,63,858

19.34 %


A detailed explanation of the Bodo Text Corpus will be available in the Bodo Raw Text Corpus Documentation. 

For any research-based citations, please use the following citations:

  • Ramamoorthy, L., Narayan Choudhary, Bridul  Basumatary & Farson  Daimary. 2019. A Gold Standard Bodo Raw Text Corpus. Central Institute of Indian Languages, Mysore.
  • Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.

Dataset Specifications

Authors Ramamoorthy L., Narayan Choudhary, Bridul Basumatary, Farson Daimary
Corpus Type Raw Corpus
Catalogue Number 1110
ISBN 978-81-7343-209-5
Data Source Typed+Cleaned
Character Count 21344814
Word Count 2915544
Release Date 04-Apr-2019
Terms and Conditions General instructions for use of the resources provided by LDC-IL.

Documentation & Sample Files