A Gold Standard Hindi Raw Text Corpus
OverView
1,03,17,177 WordsYour request cart is empty!
Dataset Description
1,03,17,177 Words | 1,223 Tittles | XML format | 4 domains
Hindi is a Major,
Indo-Aryan language, a descendant of Sanskrit, which is spoken in the central
and northern India, in the states of Bihar, Chhattisgarh, Delhi, Haryana,
Himachal Pradesh, Jharkhand, Madhya Pradesh, Rajasthan, Uttarakhand, and Uttar
Pradesh. LDC-IL Hindi Text Corpus developed according to various factors
such as quality of the text, representativeness, retrievable
format, size of corpus, authenticity, etc. For collecting text
corpus LDC-IL adopts a standard category list of various domains and a prior
set of criteria. The corpus of Hindi text can be broadly classified as literary
and non- literary texts. Data has been collected from books, magazines, and
newspapers and it is verified to true to the original texts then warehoused.
Hindi Text Corpus encoded in a machine-readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from the contemporary text in typed and crawled methods.
The available Text Corpus details:
|
Domains |
Words |
Percentage of Total Corpus |
|
Aesthetics |
38,22,697 |
37.05 % |
|
Mass Media |
50,12,327 |
48.58 % |
|
Science and Technology |
5,49,143 |
5.32 % |
|
Social Sciences |
9,33,010 |
9.04 % |
A detailed explanation of the Hindi Text Corpus will be available in the Hindi Raw Text Corpus Documentation.
For any research-based citations, please use the following citations:
- Ramamoorthy, L.,
Narayan Choudhary, Jitendra Kumar Singh, Richa,
Anjali Sinha, Dheeraj Kumar Mishra, Arimardan Kumar
Tripathi, Aditi Debsharma, Satyaendra Kumar Awasthi
& Madhupriya Pathak. 2019. A Gold Standard Hindi
Raw Text Corpus. Central Institute of Indian Languages, Mysore.
-
Choudhary, Narayan & L.
Ramamoorthy. 2019. "LDC-IL Raw Text Corpora:
An Overview" in Linguistic Resources for AI/NLP in Indian
Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.
Item specifics
- Authors Ramamoorthy L., Narayan Choudhary, Satyaendra Awasthi, Madhu Priya Pathak, Jitendra Kumar Singh, Richa, Anjali Sinha, Dheeraj Kumar Mishra,Arimardan Kumar Tripathi, Sumedha Shukla
- Corpus Type Raw Corpus
- Catalogue Number 1120
- ISBN 978-81-7343-219-4
- Data Source Typed+Cleaned
- Character Count 52569629
- Word Count 10317177
- Release Date 04-Apr-2019
- Terms and Conditions General instructions for use of the resources provided by LDC-IL.