Spanish Gigaword 3rd edition LDC2011T12
Ângelo Mendonça and Daniel Jaquette and David Graff and Denise DiPersio

LDC2011T12_spanish_gigaword_3e.tar.zst2.78GB
Type: Dataset
Tags: Dataset, nlp, natural language, corpus, text, Annotated, newswire, LDC, gigaword, espanol, spanish

Bibtex:
@article{,
title= {Spanish Gigaword 3rd edition LDC2011T12},
journal= {},
author= {Ângelo Mendonça and Daniel Jaquette and David Graff and Denise DiPersio},
year= {2011},
doi= {10.35111/v6z1-cb91},
url= {https://doi.org/10.35111/v6z1-cb91},
ldc= {LDC2011T12},
isbn= {1-58563-596-0},
islrn= {595-627-966-073-3},
abstract= {# Spanish Gigaword Third Edition - Linguistic Data Consortium

### Introduction

Spanish Gigaword Third Edition is a comprehensive archive of Spanish newswire text data acquired by the Linguistic Data Consortium. It includes all of the content of the second edition ([LDC2009T21](http://catalog.ldc.upenn.edu/LDC2009T21)) and adds data collected from January 1, 2009 through December 31, 2010.

The three distinct international sources of Spanish newswire in this edition, and the time spans of collection covered for each, are as follows:

-   Agence France-Presse, Spanish (afp\_spa) May 1994 - Dec 2010
-   Associated Press, Spanish (apw\_spa) Nov 1993 - Dec 2010
-   Xinhua News Agency, Spanish (xin\_spa) Sep 2001 - Dec 2010

The seven-letter codes in the parentheses above include the three-character source name abbreviations and the three-character language code (spa) separated by an underscore (\_) character. The three-letter language code conforms to LDCs internal convention based on the [ISO 639-3](http://www.sil.org/iso639-3/default.asp) standard.

### Data

All text data are presented in SGML/XML form, using a very simple, minimal markup structure all text consists of printable ASCII, whitespace, and printable code points in the Latin1 Supplement character table, as defined by both ISO-8859-1 and the Unicode Standard (ISO 10646) for the accented characters used in Spanish. The Supplement/accented characters are rendered using UTF-8 encoding.

For all of the documents in this corpus, a rudimentary (and \_approximate\_) categorization of DOC units into four distinct types has been applied. The classification is indicated by the type=string attribute that is included in each opening DOC tag. The four types are:

-   story : This is by far the most frequent type, and it represents the most typical newswire item: a coherent report on a particular topic or event, consisting of paragraphs and full sentences.
-   multi : This type of DOC contains a series of unrelated blurbs, each of which briefly describes a particular topic or event this is typically applied to DOCs that contain summaries of todays news, news briefs in ... (some general area like finance or sports), and so on.
-   advis : (short for advisory) These are DOCs which the news service addresses to news editors -- they are not intended for publication to the end users (the populations who read the news). This type contains formulaic, repetitive content (contact phone numbers, etc).
-   other : This represents DOCs that clearly do not fall into any of the above types -- in general, items of this type are intended for broad circulation (they are not advisories), they may be topically coherent (unlike multi type DOCS), and they typically do not contain paragraphs or sentences (they arent really stories) these are things like lists of sports scores, stock prices, temperatures around the world, and so on.

### Sample

Please view this [sample](https://catalog.ldc.upenn.edu/desc/addenda/LDC2011T12.jpg).

### Updates

An update to Spanish Gigaword Third Edition was issued to fix an issue with 26 consecutive months of data files from Xinhua Spanish: xin\_spa\_200601 through xin\_spa\_200802 i.e. all files from 2006 and 2007, plus the first two files from 2008. The problem was that all letters with diacritic marks had been omitted in the text data for that portion of the collection. For example, the word _año_ was presented as _ao_ (minus the n-with-tilde character), aspiracion appeared as aspiracin, and similarly for all accented characters (UTF-8 letters outside the ASCII range). All copies of Spanish Gigaword Third Edition ordered after February 2013 will have this update included. More information is included in the [readme](https://catalog.ldc.upenn.edu/docs/LDC2011T12/README.xin_spa_update.txt) associated with this update.

### Metadata

- _Item Name:_ Spanish Gigaword Third Edition
- _Author(s):_ Ângelo Mendonça, Daniel Jaquette, David Graff, Denise DiPersio
- _LDC Catalog No.:_ LDC2011T12
- _ISBN:_ 1-58563-596-0 _ISLRN:_ 595-627-966-073-3
- _DOI:_ [https://doi.org/10.35111/v6z1-cb91](https://doi.org/10.35111/v6z1-cb91)
- _Release Date:_ October 21, 2011
- _Member Year(s):_ 2011
- _DCMI Type(s):_ Text
- _Data Source(s):_ newswire
- _Application(s):_ natural language processing, language modeling, information retrieval
- _Language(s):_ Spanish
- _Language ID(s):_ spa
- _License(s):_ [LDC User Agreement for Non-Members](https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf)
- _Online Documentation:_ [LDC2011T12 Documents](https://catalog.ldc.upenn.edu/docs/LDC2011T12/)
- _Licensing Instructions:_ [Subscription & Standard Members, and Non-Members](http://www.ldc.upenn.edu/language-resources/data/obtaining)
- _Citation:_ Mendonça, Ângelo, et al. Spanish Gigaword Third Edition LDC2011T12. Web Download. Philadelphia: Linguistic Data Consortium, 2011.
},
keywords= {Dataset, nlp, natural language, corpus, text, Annotated, newswire, LDC, gigaword, espanol, spanish},
terms= {},
license= {},
superseded= {}
}

Hosted by users:

Send Feedback