A Maximum Entropy Approach to Natural Language Processing
by A. L. Berger, S. A. Della Pietra, V. J. Della Pietra
Publisher: Association for Computational Linguistics 1996
Number of pages: 36
Description:
The authors describe a method for statistical modeling based on maximum entropy. They present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.
Download or read it online for free here:
Download link
(1.8MB, PDF)
Similar books

by Steven Bird, Ewan Klein, Edward Loper - O'Reilly Media
This book offers a highly accessible introduction to natural language processing, the field that supports a variety of language technologies. With it, you'll learn how to write Python programs that work with large collections of unstructured text.
(14941 views)

by Daniƫl de Kok, Harm Brouwer
We will go into many of the techniques that so-called computational linguists use to analyze the structure of human language, and transform it into a form that computers work with. We chose Haskell as the main programming language for this book.
(14603 views)

by Rob Malouf, Miles Osborne - ESSLLI
This text provides an introduction to the maximum entropy principle and the construction of maximum entropy models for natural language processing. We investigate the implementation of maximum entropy models for attribute-value grammars.
(7528 views)

by Jon Barwise, John Etchemendy - Center for the Study of Language
The book covers the boolean connectives, formal proof techniques, quantifiers, basic set theory, induction, proofs of soundness and completeness for propositional and predicate logic, and an accessible sketch of Godel's first incompleteness theorem.
(17917 views)