Search

63, 70,954 Words | 1,119 Titles | XML format | 6 domainsMalayalam is a highly agglutinative and morphologically rich language. The actual pattern of language use in natural texts reveals the evidence of language trait. Government of India set up Linguistic Data Consortium for Indian Languages to help those who endeavor in the language development field. LDC-IL Malayalam Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format,  size of corpus, authenticity, etc. For collecting text corpus LDC-IL adopts a standard category list of various domains and a prior set of criteria. The corpus of Malayalam text can be broadly classified as literary and non-literary texts. A huge amount of literary texts are available in Malayalam but scientific texts are less thus LDC-IL attempts to develop balanced text corpora of Malayalam. Data has been collected from books, magazines, and newspapers and it is verified to true to the original texts then stored.Malayalam Text Corpus encoded in a machine-readable form and stored in a standard format. The major encoding being used is Unicode and stored in XML format. The data is embedded with metadata information. The corpus has been created from contemporary text is typed and crawled methods. LDC-IL Malayalam Text Corpus size is 63, 70,954 words drawn from 1,119 different titles. The six major domains are Aesthetics, Commerce, Official Documents, Social Sciences, Mass Media and Science & Technology. The available Text Corpus details: Domains Words Percentage of Total Corpus Aesthetics  25,77,090 40.45 % Commerce 3,13,135 4.92 % Official Documents 7,733 0.12 % Mass Media 21,35,621 13.74 % Science and Technology 16,79,511 33.52 % Social Sciences 8,75,568 7.25 % A detailed explanation of the Malayalam Text Corpus will be available in the Malayalam Raw Text Corpus Documentation. For any  research-based citations, please use the following citations:Ramamoorthy, L., Narayan Choudhary, Saritha S.L., Rejitha K.S. & Sajila S. 2019. A Gold Standard  Malayalam  Raw Text Corpus.  Central Institute of Indian Languages, Mysore.Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10...

164:01:02 Hours | 105 GB | 458Speakers| 43670 Audio Segments |48 kHz | 16 bit wav.Malayalam is the official language of Kerala and Laccadive Islands. It belongs to the Dravidian language family.  According to the formation of Kerala and the language of Travancore, Cochin, and Malabar regions are influenced by different internal and external factors so LDC-IL considered Malayalam has three specifically different varieties, thus collected speech data from Thiruvananthapuram, Ernakulam, and Kozhikode. LDC-IL has 164 hours Malayalam speech data. The LDC-IL Malayalam Speech data set consists of different types of datasets that are made up of word lists, sentences, running texts and date formats. Approximately 15 minutes of speech (per speaker) has taken from 231 female and 227 Male native speakers of different age groups. Each speaker recorded these datasets which are randomly selected from a master dataset.The available Speech Corpus details: Total Speakers 458(231 Female and 227 Male) Domains Audio Segments Each Domain Duration Contemporary Text (News) 449 71:29:21 Creative Text 449 54:41:20 Sentence 7,452 06:56:46 Date Format 598 00:53:45 Command and Control Words 8,923 07:09:37 Person Name 5,819 05:26:33 Place Name 2,906 02:28:24 Most Frequent Word - Part 8,763 06:51:31 Most Frequent Word - Full Set 1,979 02:08:58 Phonetically Balanced 3,096 02:40:09 Form and Function - Word 3,236  03:14:38 A detailed explanation of the Malayalam Speech Corpus will be available in the Malayalam Speech Data Documentation.For any research-based citations, please use the following citations:Ramamoorthy, L., Narayan Choudhary, Saritha S.L., Rejitha K.S., Sajila S. & Midhun P. G. 2019. Malayalam Raw Speech Corpus. Central Institute of Indian Languages, Mysore.Choudhary, Narayan, Rajesha N., Manasa G. & L. Ramamoorthy. 2019. “LDC-IL Raw Speech Corpora: An Overview”  in Linguistic Resources for AI/NLP in Indian Languages. Central Institute of Indian Languages, Mysore.  pp. 160-174...

Dataset Description: 123:29:55 hours | 79.6 GB | 89,269 Audio Segments | 451 speakersThe annotated speech corpus gives wide range of linguistic information especially useful to analyse phonetics. The LDC-IL Malayalam Sentence Aligned Speech dataset comprises audio files in wav format, accompanied by a corresponding textual layer containing phonetically normalized and orthographically normalized annotations in Malayalam script. This dataset spans a duration of 123:29:55 (hh:mm:ss), consisting of read speech with continuous text, representative sentences, and date formats. The data is derived from 229 female and 222 male native Malayalam speakers, encompassing diverse age groups and regions. A comprehensive explanation of the dataset can be found in the Malayalam Sentence Aligned Speech Documentation.For any research-based citations, please use the following citations:1. Rejitha K. S., Sajila S., Saritha S.L., Rajesha N., Manasa G., Srikanth D., Stephen Fernandes, Nithin S., Narayan Kumar Choudhary, Shailendra Mohan. 2023 Malayalam Sentence Aligned Speech Corpus Central Institute of Indian Languages, Mysore. 978-81-19411-58-0.2. Rejitha K. S. and Narayan Kumar Choudhary. (ed.). 2023. Compendium of LDC-IL Sentence Aligned Speech Corpus. Central Institute of Indian Languages, Mysore. ISBN: 978-81-19411-34-4.3.  Choudhary, N. 2021. LDC-IL: The Indian Repository of Resources for Language Technology. Language Resources & Evaluation. Springer, Vol. 55, Issue 1. doi: https://doi.org/10.1007/s10579-020-09523-3..