Nonlinear Dimensionality Reduction by Locally Linear Embedding

Sam T. Roweis, Lawrence K. Saul

doi:10.1126/science.290.5500.2323

Nonlinear Dimensionality Reduction by Locally Linear Embedding

DOI Web Site 被引用文献143件

Sam T. Roweis

Gatsby Computational Neuroscience Unit, University College London, 17 Queen Square, London WC1N 3AR, UK.
Lawrence K. Saul

AT&T Lab—Research, 180 Park Avenue, Florham Park, NJ 07932, USA.

抄録

<jats:p>Many areas of science depend on exploratory data analysis and visualization. The need to analyze large amounts of multivariate data raises the fundamental problem of dimensionality reduction: how to discover compact representations of high-dimensional data. Here, we introduce locally linear embedding (LLE), an unsupervised learning algorithm that computes low-dimensional, neighborhood-preserving embeddings of high-dimensional inputs. Unlike clustering methods for local dimensionality reduction, LLE maps its inputs into a single global coordinate system of lower dimensionality, and its optimizations do not involve local minima. By exploiting the local symmetries of linear reconstructions, LLE is able to learn the global structure of nonlinear manifolds, such as those generated by images of faces or documents of text.</jats:p>