A Gold Standard Gujarati Raw Text Corpus

SKU: LDCIL-181 | Model: 1115 | ISBN: 978-81-7343-214-9

Description & Overview

 28, 62,413 Words | 1,364 Tittles |  XML format | 06 Text Domains


Gujarati is a major Indo-Aryan language and the administrative language of Gujarat, Union territories of Daman and Diu and Dadra and Nagar Haveli. LDC-IL Gujarati Raw Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format, size of corpus, authenticity, etc.. It’s encoded in a machine-readable form and stored in a standard format. All encoding being used is Unicode compatible fonts and stored in XML format. The data is embedded with metadata information. The corpus has been developed from the contemporary texts in a typed method

The corpus of Gujarati raw text can be generally classified as literary and non- literary texts. Huge amount of literary texts are available in Gujarati but knowledge/scientific texts are less, thus LDC-IL attempted to develop a balanced raw text corpus of Gujarati. Data has been collected from the books and the newspapers and it is verified to true to the original texts.  


The available Text Corpus details:


Domains

Words

Percentage of Total

Corpus

Aesthetics 

7,42,260

25.93 %

Commerce

43,733

1.53 %

Mass Media

10,70,099

37.38 %

Official Document

29,599

1.03 %

Science and Technology

6,43,737

22.49 %

Social Sciences

3,32,985

11.63 %


A detailed explanation of the Gujarati Text Corpus will be available in the Gujarati Raw Text Corpus Documentation. 

For any research-based citations, please use the following citations:

  • Ramamoorthy, L., Narayan  Choudhary,  Mona Parakh, Purva S Dholakia., Gadhavi R Hiren & Maheshkumar R Solanki. 2019. A Gold Standard Gujarati Raw Text Corpus.  Central Institute of Indian Languages, Mysore.
  • Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.

Dataset Specifications

Authors Ramamoorthy L., Narayan Choudhary, Mona Parakh, Purva S Dholakia, Hiren Gadhavi R, Solanki Maheshkumar R
Corpus Type Raw Corpus
Catalogue Number 1115
ISBN 978-81-7343-214-9
Data Source Typed+Cleaned
Character Count 17169357
Word Count 2862413
Release Date 04-Apr-2019
Terms and Conditions General instructions for use of the resources provided by LDC-IL.

Documentation & Sample Files