A Survey of Linear Predictive Coding: Part I of Linear Predictive Coding and the Internet Protocol

This alert has been successfully added and will be sent to:

You will be notified whenever a record that you have chosen has been cited.

To manage your alert preferences, click on the button below.

New Citation Alert!

Abstract

Linear prediction has long played an important role in speech processing, especially in the development during the late 1960s of the first low bit rate speech compression/coding systems. The approach, which eventually became known as linear predictive coding (LPC), coincidentally came to fruition at the right time to be adopted as the speech compression technique in the first successful realtime packet speech communication through the nascent ARPAnet in December 1974 — the ancestor of voice over the Internet Protocol (IP) and, more generally, of realtime signal processing through the Internet. This first part of a two part monograph on LPC and the IP provides a tutorial overview of linear prediction and its application to speech coding. A variety of viewpoints provides background and context for the second part, which comprises a technical and personal history of LPC, its use in the first packet speech demonstrations, and many related stories of the early applications of LPC and the prehistory of the Internet.

References

J. P. Burg, "Maximum entropy spectral analysis," presented at the 37th Meeting of the Society of Exploration Geophysicsists, Oklahoma City, Oklahoma, October 1967.

T. M. Cover and J. A. Thomas, Elements of Information Theory. Wiley Interscience, Hoboken, New Jersey, Second Edition, 2006.

R. M. Gray, "The 1974 origins of VoIP," IEEE Signal Processing Magazine, vol. 22, pp. 87-90, July 2005.

R. M. Gray, "Toeplitz and circulant matrices: A review," Foundations and Trends in Communications and Information Theory, vol. 2, no. 3, pp. 155- 329, Originally published as Information Systems Laboratory Technical Report, Stanford University, 1971. Revised and reprinted numerous times and currently available at http://ee.stanford.edu/~gray/toeplitz.pdf, 2005.

R. M. Gray, Probability, Random Processes, and Ergodic Properties. Springer, New York, 2009. First Edition published January 1988, corrected version available at http://ee.stanford.edu/~gray/arp.html.

R. M. Gray, A. Buzo, A. H. Gray, Jr., and Y. Matsuyama, "Distortion measures for speech processing," IEEE Transactions on Acoustics Speech and Signal Processing, vol. ASSP-28, pp. 367-376, August 1980.

R. M. Gray and L. D. Davisson, Introduction to Statistical Signal Processing. Cambridge, UK: Cambridge University Press, December 2004. Individual copies available for download at http://ee.stanford.edu/~gray/sp.html.

R. M. Gray, A. H. Gray Jr., G. Rebolledo, and J. E. Shore, "Rate distortion speech coding with a minimum discrimination information distortion measure," IEEE Transactions on Information Theory, vol. IT-27, no. 6, pp. 708-721, Nov 1981.

R. M. Gray and J. C. Kieffer, "Asymptotically mean stationary measures," Annals of Probability, vol. 8, pp. 962-973, October 1980.

A. H. Gray Jr and J. D. Markel, "A spectral-flatness measure for studying the autocorrelation method of linear prediction of speech analysis," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 22, no. 3, pp. 207-217, June 1974.

U. Grenander and G. Szegö, Toeplitz Forms and Their Applications. University of California Press, Berkeley and Los Angeles, 1958.

F. Itakura and S. Saito, "Analysis synthesis telephony based upon the maximum likelihood method," in Reports of 6th International Congress on Acoustics, (Y. Kohasi, ed.), pp. C-5-5, C17-20, Tokyo, 1968.

F. Itakura and S. Saito, "A statistical method for estimation of speech spectral density and formant frequencies," Electronic Communications in Japan, vol. 53- A, pp. 36-43, 1970.

E. T. Jaynes, "Information theory and statistical mechanics," Physical Review, Part 1: vol. 106, no. 4, pp. 620-630, May 1957, Part 2: vol. 108, no. 2 pp. 171-190, October 1957.

L. K. Jones, "Approximation-theoretic derivation of logarithmic entropy priciples for inverse problems and unique extension of the maximum entropy method to incorporate prior knowledge," SIAM Journal of Applied Mathematics, vol. 49, no. 2, pp. 650-661, April 1989.

S. Kullback, Information Theory and Statistics. Dover New York, 1968. Reprint of 1959 edition published by Wiley.

B. M. Leiner, V. S. Cerf, D. D. Clark, R. E. Kahn, L. Kleinrock, D. C. Lynch, J. Postel, L. C. Roberts, and S. S. Wolff, "The past and future history of the Internet," Communications of the ACM, vol. 40, no. 2, pp. 102-108, See also http://www.isoc.org/internet/history/brief.shtml, February 1997.

H. Lev-Ari, S. R. Parker, and T. Kailath, "Multidimensional maximum-entropy covariance extension," IEEE Transactions on Information Theory, vol. 35, no. 3, pp. 497-508, May 1989.

J. Makhoul, "Linear prediction: A tutorial review," Proceedings of the IEEE, vol. 63, no. 4, April 1975.