A Gold Standard Tamil Raw Text Corpus

A Gold Standard Tamil Raw Text Corpus

0 reviews requests (10)
Catalogue Number: 1167
Stock In Stock

OverView

1,09,31,902 
Please Login to see the price

Dataset Description

1,09,31,902 Words | 1,963 Titles | XML format |  6 text domains

Tamil is one of the longest-surviving Classical Languages in the world. It is a Dravidian Language Family. Tamil Text Corpus encoded in a machine-readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from the contemporary text in typed and crawled methods. Tamil is one of the longest-surviving classical languages in the world. It is a Dravidian language spoken in Tamil Nadu and Sri Lanka, in East-Asian countries like Burma, Malaysia, Singapore, Indonesia, Indio china, Fiji, in South-Africa and British Guinea and in islands like Mauritius and Madagascar etc. The language is an official language in Tamil Nadu and some of the foreign countries such as Sri Lanka and Singapore. It has official status in the Indian state of Tamil Nadu and the Indian Union Territory of Pondicherry. Linguistic Data Consortium for Indian Languages (LDC-IL) Tamil Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format,  size of corpus, authenticity, etc. For collecting text corpus LDC-IL adopts a standard category list of various domains and a prior set of criteria. The corpus of Tamil text can be broadly classified as literary and non- literary texts. A huge amount of literary texts are available in Tamil but scientific texts are less, thus LDC-IL attempts to develop balanced text corpora of Tamil. Data has been collected from books, Magazines, and Newspapers and it is verified to true to the original texts then warehoused.

The available Text Corpus details are as follows:

Domains

Words

Percentage of Total

Corpus

Aesthetics 

55,95,316

51.18 %

Commerce

83,148

00.76 %

Mass Media

21,00,226

19.21 %

Official Document

12,768

0.12 %

Science and Technology

88,65,532

8.11 %

Social Sciences

22,53,912

20.62 %


A  detailed explanation of the Tamil Raw Text Corpus will be available in the Tamil Text Corpus Documentation.

For any research-based citations, please use the following citations:

  • Ramamoorthy, L., Narayan Choudhary, G. Palanirajan, S. Thennarasu, Prem Kumar L. R, Amudha R., Prabagaran R., Vijayan N. & M. Ramesh Kumar. 2019A Gold Standard Tamil Raw Text Corpus.  Central Institute of Indian Languages, Mysore.
  • Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.

Item specifics

  • Authors Ramamoorthy L., Narayan Choudhary, Amudha R, Palanirajan G, Thennarasu S, Prem Kumar L R, Prabagaran R, Vijayan N, Ramesh Kumar M
  • Corpus Type Raw Corpus
  • Catalogue Number 1167
  • ISBN 978-81-7343-266-8
  • Data Source Typed+Cleaned
  • Character Count 100046419
  • Word Count 10931902
  • Release Date 04-Apr-2019
  • Terms and Conditions General instructions for use of the resources provided by LDC-IL.
Commercial User
Non-Commercial User
LDC-IL Raw Text Corpora: An Overview
LDC-IL Raw Speech Corpora: An Overview

Write a review

Please login or register to review