Using large corpora
Author(s)
Bibliographic Information
Using large corpora
MIT Press, 1994
Available at 57 libraries
  Aomori
  Iwate
  Miyagi
  Akita
  Yamagata
  Fukushima
  Ibaraki
  Tochigi
  Gunma
  Saitama
  Chiba
  Tokyo
  Kanagawa
  Niigata
  Toyama
  Ishikawa
  Fukui
  Yamanashi
  Nagano
  Gifu
  Shizuoka
  Aichi
  Mie
  Shiga
  Kyoto
  Osaka
  Hyogo
  Nara
  Wakayama
  Tottori
  Shimane
  Okayama
  Hiroshima
  Yamaguchi
  Tokushima
  Kagawa
  Ehime
  Kochi
  Fukuoka
  Saga
  Nagasaki
  Kumamoto
  Oita
  Miyazaki
  Kagoshima
  Okinawa
  Korea
  China
  Thailand
  United Kingdom
  Germany
  Switzerland
  France
  Belgium
  Netherlands
  Sweden
  Norway
  United States of America
Note
"A Bradford book."
Includes bibliographies and index
Description and Table of Contents
Description
Using Large Corpora identifies new data-oriented methods for organizing and analyzing large corpora and describes the potential results that the use of large corpora offers.
Today, large corpora consisting of hundreds of millions or even billions of words, along with new empirical and statistical methods for organizing and analyzing these data, promise new insights into the use of language. Already, the data extracted from these large corpora reveal that language use is more flexible and complex than most rule-based systems have tried to account for, providing a basis for progress in the performance of Natural Language Processing systems. Using Large Corpora identifies these new data-oriented methods and describes the potential results that the use of large corpora offers. The research described shows that the new methods may offer solutions to key issues of acquisition (automatically identifying and coding information), coverage (accounting for all of the phenomena in a given domain), robustness (accommodating "real data" that may be corrupt or not accounted for in the model), and extensibility (applying the model and data to a new domain, text, or problem). There are chapters on lexical issues, issues in syntax, and translation topics, as well discussions of the "statistics-based" vs. "rule-based" debate. ACL-MIT Series in Natural Language Processing.
Table of Contents
- Introduction to the special issue on computational linguistics using large corpora, Kenneth W. Church and Robert L. Mercer
- generalized probabilistic LR parsing of natural language (corpora) with unification-based grammars, Ted Briscoe and John Carroll
- accurate methods for the statistics of surprise and coincidence, Ted Dunning
- a program for aligning sentences in bilingual corpora, William A. Gale and Kenneth W. Church
- structural ambiguity and lexical relations, Donald Hindle and Mats Rooth
- text-translation alignment, Martin Kay and Martin Roescheisen
- retrieving collocations from text - Xtract, Frank Smadja
- using register-diversified corpora for general language studies, Douglas Biber
- from grammar to lexicon - unsupervised learning of lexical syntax, Michael R. Brent
- the mathematics of statistical machine translation - parameter estimation, Peter F. Brown et al
- building a large annotated corpus of English - the Penn treebank, Mitchell P. Marcus et al
- lexical semantic techniques for corpus analysis, James Pustejovsky et al
- coping with ambiguity and unknown words through probabilistic models, Ralph Weischedel et al.
by "Nielsen BookData"