A Gold Standard Hindi Raw Text Corpus

A Gold Standard Hindi Raw Text Corpus

0 reviews requests (20)
Catalogue Number: 1120
Stock In Stock

OverView

1,03,17,177 Words 
Please Login to see the price

Dataset Description

1,03,17,177 Words | 1,223 Tittles | XML format | 4 domains 

Hindi is a Major, Indo-Aryan language, a descendant of Sanskrit, which is spoken in the central and northern India, in the states of Bihar, Chhattisgarh, Delhi, Haryana, Himachal Pradesh, Jharkhand, Madhya Pradesh, Rajasthan, Uttarakhand, and Uttar Pradesh. LDC-IL Hindi Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format,  size of corpus, authenticity, etc. For collecting text corpus LDC-IL adopts a standard category list of various domains and a prior set of criteria. The corpus of Hindi text can be broadly classified as literary and non- literary texts. Data has been collected from books, magazines, and newspapers and it is verified to true to the original texts then warehoused.

Hindi Text Corpus encoded in a machine-readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from the contemporary text in typed and crawled methods. 


The available Text Corpus details:

 

Domains

Words

Percentage of Total

Corpus

Aesthetics 

38,22,697

37.05 %

Mass Media

50,12,327

48.58 %

Science and Technology

5,49,143

5.32 %

Social Sciences

9,33,010

9.04 %


A detailed explanation of the Hindi Text Corpus will be available in the Hindi Raw Text Corpus Documentation. 

For any research-based citations, please use the following citations:

  • Ramamoorthy, L., Narayan  Choudhary, Jitendra Kumar Singh,  Richa, Anjali Sinha, Dheeraj Kumar Mishra,  Arimardan Kumar Tripathi,  Aditi Debsharma,  Satyaendra Kumar Awasthi & Madhupriya Pathak. 2019. A Gold Standard Hindi Raw Text Corpus. Central Institute of Indian Languages, Mysore.
  • Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.

Item specifics

  • Authors Ramamoorthy L., Narayan Choudhary, Satyaendra Awasthi, Madhu Priya Pathak, Jitendra Kumar Singh, Richa, Anjali Sinha, Dheeraj Kumar Mishra,Arimardan Kumar Tripathi, Sumedha Shukla
  • Corpus Type Raw Corpus
  • Catalogue Number 1120
  • ISBN 978-81-7343-219-4
  • Data Source Typed+Cleaned
  • Character Count 52569629
  • Word Count 10317177
  • Release Date 04-Apr-2019
  • Terms and Conditions General instructions for use of the resources provided by LDC-IL.
Commercial User
Non-Commercial User
LDC-IL Raw Text Corpora: An Overview
LDC-IL Raw Speech Corpora: An Overview

Write a review

Please login or register to review