A Gold Standard Urdu Raw Text Corpus

A Gold Standard Urdu Raw Text Corpus

1 reviews requests (5)
Catalogue Number: 1175
Stock In Stock

OverView

5161927  Words | 739 Titles | XML format | 5 domains.
Please Login to see the price

Dataset Description

5161927  Words | 739 Titles | XML format | 5 domains.


Urdu is one of the prominent language used in the Indian sub-continent. It belongs to the Indo-Aryan family. Urdu is influenced by Arabic and Persian. Urdu is written in the Perso-Arabic script. On the other hand region-wise Urdu language is co-existed side by side mostly in the northern part of India, north-west and eastern parts of India and Pakistan also, although understood and spoken occasionally in the rest of India. Urdu is arisen in the 10th century A.D. due to occupation relations, ethnic exchanges, relocations, and military expeditions. Urdu in India is basically developed in close contact with Persian, which was the language of administration and education during the period of Muslim rule.  LDC-IL Urdu Text Corpus developed according to various factors such as quality of the text, representativeness, retrievable format, size of corpus, authenticity, etc. For collecting text corpus LDC-IL adopts a standard category list of various domains and a prior set of criteria. The corpus of Urdu text can be broadly classified as literary and non- literary texts. A huge amount of literary texts are available in Urdu but scientific texts are less thus LDC-IL attempts to develop balanced text corpora of Urdu. Data has been collected from books, magazines, and newspapers and it is verified true to the original text.


The available Text Corpus details:


Domains

Words

Percentage of Total

Corpus

Aesthetics 

2616382

50.69 %

Commerce

28601

0.55 %

Mass Media

843477

16.34 %

Science and Technology

348082

6.74 %

Social Sciences

1325385

25.68 %



A detailed explanation of the Urdu Text Corpus will be available in the Urdu Text Corpus documentation.

For any research-based citations, please use the following citations: 

  • Ramamoorthy, L., Narayan Choudhary, Mansoor Khan, Shahnawaz Alam, Bi Bi Mariyam & Rushda Idris Khan. 2019. A Gold Standard Urdu Raw Text CorpusCentral Institute of Indian Languages, Mysore.
  • Choudhary, Narayan & L. Ramamoorthy. 2019. "LDC-IL Raw Text Corpora: An Overview"  in  Linguistic Resources for AI/NLP in Indian Languages, Central Institute of Indian Languages, Mysore. pp. 1-10.

Item specifics

  • Authors Ramamoorthy L., Narayan Choudhary, Mansoor Khan, Shahnawaz Alam, Bi Bi Mariyam, Rushda Idris Khan
  • Corpus Type Raw Corpus
  • Catalogue Number 1175
  • ISBN 978-81-7343-274-3
  • Data Source Typed+Cleaned
  • Character Count 23947905
  • Word Count 5161927
  • Release Date 04/04/2019
  • Terms and Conditions General instructions for use of the resources provided by LDC-IL.
Commercial User
Non-Commercial User

Write a review

Please login or register to review