2020-2022 Undergraduate and Graduate Bulletin (without addenda) 
    
    Mar 28, 2024  
2020-2022 Undergraduate and Graduate Bulletin (without addenda) [ARCHIVED CATALOG]

ECE-GY 6063 Information Theory

3 Credits
Mathematical information measures: entropy, relative entropy and mutual information. Assymptotic equipartition property, entropy rates of stochastic processes. Lossless source encoding theorems and source coding techniques. Channel capacity, differential entropy and the Gaussian channel. Lossy source coding rate distortion theory. Brief overview of network information theory.

Prerequisite(s): Graduate status and ECE-GY 6303 .
Weekly Lecture Hours: 3 | Weekly Lab Hours: 0 | Weekly Recitation Hours: 0