مدونة تهتم بأبحاث اللغة العربية المختلفة وجمع مصادر لغوية تعين الباحثين وتطور هذا المجال
إظهار الرسائل ذات التسميات نصوص. إظهار كافة الرسائل
إظهار الرسائل ذات التسميات نصوص. إظهار كافة الرسائل
الاثنين، 12 مايو 2014
الخميس، 8 مايو 2014
مكانز عربية وأدوات مجانية
| مكانز مجانية عربية | الحجم | |
1
| King Abdulaziz City for Science and Technology Arabic Corpus |
700MB
|
2
|
317MB
| |
3
|
173MB
| |
4
|
50MB
| |
5
|
18MB
| |
6
|
2.5MB
| |
7
|
1MB
| |
8
|
18MB
| |
9
|
KACST text classification corpus
|
11MB
|
10
|
10MB
| |
11
|
3MB
| |
| أدوات مجانية لمعالجة المصادر النصية والمكانز | ||
1
| ||
2
| ||
الجمعة، 31 مايو 2013
KALIMAT Multipurpose Arabic Corpus
KALIMAT a Multipurpose Arabic Corpus
We are pleased to announce the immediate availability of KALIMAT 1.0,
KALIMAT is an Arabic natural language resource that consists of:
1) 20,291 Arabic articles collected from the Omani newspaper Alwatan by (Abbas et al. 2011).
2) 20,291 Extractive Single-document system summaries.
3) 2,057 Extractive Multi-document system summaries.
4) 20,291 Named Entity Recognised articles.
5) 20,291 Part of Speech Tagged articles.
6) 20,291 Morphologically Analyse articles.
The data collection articles fall into six categories:
culture, economy, local-news, international-news, religion, and sports.
The process of creating KALIMAT was applied to the entire data collection (20,291 articles).
We are pleased to announce the immediate availability of KALIMAT 1.0,
KALIMAT is an Arabic natural language resource that consists of:
1) 20,291 Arabic articles collected from the Omani newspaper Alwatan by (Abbas et al. 2011).
2) 20,291 Extractive Single-document system summaries.
3) 2,057 Extractive Multi-document system summaries.
4) 20,291 Named Entity Recognised articles.
5) 20,291 Part of Speech Tagged articles.
6) 20,291 Morphologically Analyse articles.
The data collection articles fall into six categories:
culture, economy, local-news, international-news, religion, and sports.
The process of creating KALIMAT was applied to the entire data collection (20,291 articles).
Link and download: http://sourceforge.net/projects/kalimat/
ARABIC LEARNER CORPUS v1 المدونة اللغوية لمتعلمي اللغة العربية
ARABIC LEARNER CORPUS v1
Contents
The first version of the Arabic learner corpus (ALC) comprises a collection of texts written by learners of Arabic in Saudi Arabia. The corpus covers two types of students, non-native Arabic speakers (NNAS) learning Arabic as a second language (ASL) for academic purpose (AAP), and native Arabic speaking students (NAS) learning to improve their written Arabic. Both groups are males in pre-university level.
The first version of the Arabic learner corpus (ALC) comprises a collection of texts written by learners of Arabic in Saudi Arabia. The corpus covers two types of students, non-native Arabic speakers (NNAS) learning Arabic as a second language (ASL) for academic purpose (AAP), and native Arabic speaking students (NAS) learning to improve their written Arabic. Both groups are males in pre-university level.
The current version of ALC has been
captured in November and December 2012, and it includes a total of 31272
words, 215 written texts (narrative and discussion) produced by 92
students from 24 nationalities and 26 different L1 backgrounds. 181
texts (84%) were written in class (timed essays), while 34 (16%)
produced at home (untimed essays). Average length of the texts is 145
words. 95% of the texts were hand-written, so they had to be transcribed
into a suitable computerised form. All identity information (e.g,
names, contacts, dates of birth, etc.) have been removed from
transcriptions.
Files format
Three types of non-annotated files have been generated: (1) with no header, (2) with metadata header in Arabic, (3) and in English. They are available in two formats, txt and XML. The metadata information enables researchers to identify characteristics of text and its producer in each transcription. The original hand-written sheets are also available after they have been scanned and saved into PDF-format files.
Three types of non-annotated files have been generated: (1) with no header, (2) with metadata header in Arabic, (3) and in English. They are available in two formats, txt and XML. The metadata information enables researchers to identify characteristics of text and its producer in each transcription. The original hand-written sheets are also available after they have been scanned and saved into PDF-format files.
All corpus files were named in a method
which indicates the basic characteristics of the text and its author
(e.g. S038_T2_M_Pre_NNAS_W_C). They are in order, student identifier
number, text number, author gender, level of study, nativeness, text
mode, and place of text production.
Future work
AS a next stage, the entire corpus will be annotated for errors, and word-tagged with morphological tags to identify part of speech and certain grammatical sub-categories. Additionally, the correct form will be reconstructed by correcting the mistakes all.
AS a next stage, the entire corpus will be annotated for errors, and word-tagged with morphological tags to identify part of speech and certain grammatical sub-categories. Additionally, the correct form will be reconstructed by correcting the mistakes all.
Annotating errors will be performed
using a detailed error-type tagset, which has been developed for Arabic
learner corpora in general and to be used in the present corpus in
particular (Alfaifi and Atwell, 2012). In future, further version will
be issued including more materials (written and spoken), different
genders (male and female), and different levels of study (pre-university
and university).
References
Alfaifi, A. and Atwell, E. (2012). Arabic Learner Corpora (ALC): A Taxonomy of Coding Errors. In: the 8th International Computing Conference in Arabic (ICCA 2012), 26 - 28 December 2012, Cairo, Egypt.
Alfaifi, A. and Atwell, E. (2012). Arabic Learner Corpora (ALC): A Taxonomy of Coding Errors. In: the 8th International Computing Conference in Arabic (ICCA 2012), 26 - 28 December 2012, Cairo, Egypt.
للمزيد و للتحميل
http://www.comp.leeds.ac.uk/scayga/alc/index.html
الاثنين، 17 سبتمبر 2012
السبت، 2 يونيو 2012
WIT3: a new collection of parallel texts!
We are very glad to announce WIT3 (to be read "wit cube"), acronym
standing for Web Inventory of Transcribed and Translated Talks, a
ready-to-use version of TED talks (wit3.fbk.eu).
TED is a non profit organization that invites experts to give the talk of their lives. TED records all talks and post them on its website (www.ted.com). Currently, more than 1100 talks are listed there, all subtitled in English. Translations of transcripts are also available into many languages (up to 90).
To make this collection of parallel texts more effectively usable by the MT research community, we have developed WIT3, a website hosting this multilingual corpus of talks, aligned at sentence level, alongside benchmarks, processing tools and reference MT results.
We hope WIT3 will offer an adequate service to the research community; for getting more info and downloading data, please visit: wit3.fbk.eu
TED is a non profit organization that invites experts to give the talk of their lives. TED records all talks and post them on its website (www.ted.com). Currently, more than 1100 talks are listed there, all subtitled in English. Translations of transcripts are also available into many languages (up to 90).
To make this collection of parallel texts more effectively usable by the MT research community, we have developed WIT3, a website hosting this multilingual corpus of talks, aligned at sentence level, alongside benchmarks, processing tools and reference MT results.
We hope WIT3 will offer an adequate service to the research community; for getting more info and downloading data, please visit: wit3.fbk.eu
الخميس، 24 مايو 2012
MEDAR MT package
The package includes:
- Monolingual and parallel training data
- Source corpora and their reference translations
- Sentence and word alignment
(morphosyntactic disambiguated) - An alignment package
- Two MT baseline systems that uses MOSES
- Evaluation metrics (BLEU/NIST and WER)
- Formatting scripts to convert XML files
When downloading please sign the
end-user agreement
source: http://www.medar.info/
الاشتراك في:
الرسائل (Atom)