A Gold Standard Marathi Raw Text Corpus
SKU: LDCIL-164 | Model: 1151 | ISBN: 978-81-7343-250-7
Description & Overview
21,57,109 Words | 678 Tittles | XML format | 5 domains
Marathi is an Indo-Aryan
language. It is the official language of Maharashtra state of India. Marathi is
primarily spoken in Maharashtra (India) and parts of neighboring states of
Gujarat, Madhya Pradesh, Goa, Karnataka (Particularly the bordering districts
of Belgaum, Bidar, Gulbarga, and Uttara Kannada), union-territories of Daman and
Diu and Dadra and Nagar Haveli. LDC-IL Marathi Text Corpus developed
according to various factors such as quality of the text, representativeness,
retrievable format, size of corpus, authenticity, etc. For
collecting text corpus LDC-IL adopts a standard category list of various
domains and a prior set of criteria. The corpus of Marathi text can be broadly
classified as literary and non- literary texts. A huge amount of literary texts
are available in Marathi but scientific texts are less thus LDC-IL attempts to
develop balanced text corpora of Marathi. Data has been collected from books,
magazines, and newspapers and it is verified to true to the original texts than
warehoused.
Marathi Text Corpus encoded in a machine-readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from the contemporary text in typed and crawled methods.
The available Text Corpus details:
|
Domains |
Words |
Percentage of Total Corpus |
|
Aesthetics |
15,15,039 |
70.23 % |
|
Commerce |
20,795 |
0.97 % |
|
Mass Media |
3,63,120 |
16.83 % |
|
Science and Technology |
55,902 |
2.59 % |
|
Social Sciences |
2,02,253 |
9.38 % |
A
detailed explanation of the Marathi Text Corpus will be available in the
Marathi Raw Text Corpus Documentation.
For any research-based
citations, please use the following citations:
- Ramamoorthy, L., Narayan Choudhary, Gajanan R Apine & Apurva P Betkekar. 2019. A Gold Standard Marathi Raw Text Corpus. Central Institute of Indian Languages, Mysore.
- Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview" in Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.
Dataset Specifications
| Authors | Ramamoorthy L., Narayan Choudhary, Saurabh Varik, Bhageshree Khandale, Gajanan R Apine, Apurva P. Betkekar, Godavari Thakur |
|---|---|
| Corpus Type | Raw Corpus |
| Catalogue Number | 1151 |
| ISBN | 978-81-7343-250-7 |
| Data Source | Typed+Cleaned |
| Character Count | 14487556 |
| Word Count | 2157109 |
| Release Date | 04-Apr-2019 |
| Terms and Conditions | General instructions for use of the resources provided by LDC-IL. |