Electrical - Information Theory and Coding (English)

   Wednesday, February 19, 2025   

Starting a new Lecture Notes Series on Electrical - Information Theory and Coding

Youtube Lecture Playlist Credits 

Channel Name: nptelhrd

So Let Us Start to This Journey of Learning 

Electrical - Information Theory and Coding By Lecture Notes together!

Lecture 1: Mod-01 Lec-01 Introduction to Information Theory and Coding

Lecture 2: L2-Definition of Information Measure and Entropy

Lecture 3: Mod-01 Lec-03 Extension of An Information Source and Markov Source

Lecture 4: Mod-01 Lec-04 Adjoint of An Information Source, Joint and Conditional Information Measures

Lecture 5: Mod-01 Lec-05 Properties of Joint and Conditional Information Measures and a Markov Source

Lecture 6: Mod-01 Lec-06 Asymptotic Properties of Entropy and Problem Solving in Entropy

Lecture 7: Mod-01 Lec-07 Block Code and Its Properties

Lecture 8: Mod-01 Lec-08 Instantaneous Code and Its Properties

Lecture 9: Mod-01 Lec-09 Kraft-Mcmillan Equality and Compact Codes

Lecture 10: Mod-01 Lec-10 Shannon`s First Theorem

Lecture 11: Mod-01 Lec-11 Coding Strategies and Introduction to Huffman Coding

Lecture 12: Mod-01 Lec-12 Huffman Coding and Proof of Its Optimality

Lecture 13: Mod-01 Lec-13 Competitive Optimality of The Shannon Code

Lecture 14: Mod-01 Lec-14 Non-Binary Huffman Code and Other Codes

Lecture 15: Mod-01 Lec-15 Adaptive Huffman Coding part-1

Lecture 16: Mod-01 lec-16 Adaptive Huffman Coding Part-2

Lecture 17: Mod-01 Lec-17 Shannon-Fano-Elias Coding and Introduction to Arithmetic Coding

Lecture 18: Mod-01 Lec-18 Arithmetic Coding Part-1

Lecture 19: Mod-01 Lec-19 Arithmetic Coding Part-2

Lecture 20: Mod-01 Lec-20 Introduction to Information Channel

Lecture 21: Mod-01 Lec-21 Equivocation and Mutual Information

Lecture 22: Mod-01 Lec22 Properties of Different Information Channels

Lecture 23: Mod-01 Lec-23 Reduction of Information Channels

Lecture 24: Mod-01 Lec-24 Properties of Mutual Information and Introduction to Channel Capacity

Lecture 25: Mod-01 Lec-25 Calculation of Channel Capacity for Different Information Channel

Lecture 26: Mod-01 Lec-26 Shannon`s Second Theorem

Lecture 27: Mod-01 Lec-27 Discussion on Error Free Communication Over Noisy Channel

Lecture 28: Mod-01 Lec-28 Error Free Communication Over a Binary Symmetric Channel

Lecture 29: Mod-01 Lec-29 Differential Entropy and Evaluation of Mutual Information

Lecture 30: Mod-01 Lec-30 Channel Capacity of a Bandlimited Continuous Channel

Lecture 31: Mod-01 Lec-31 Introduction to Rate-Distortion Theory

Lecture 32: Mod-01 Lec-32 Definition and Properties of Rate-Distortion Functions

Lecture 33: Mod-01 Lec-33 Calculation of Rate-Distortion Functions

Lecture 34: Mod-01 Lec-34 Computational Approach For Calculation of Rate-Distortion Functions

Lecture 35: Mod-01 Lec-35 Introduction to Quantization

Lecture 36: Mod-01 Lec-36 Lloyd-Max Quantizer

Lecture 37: Mod-01 Lec-37 Companded Quantization

Lecture 38: Mod-01 Lec-38 Variable Length Coding and Problem Solving In Quantizer Design

Lecture 39: Mod-01 Lec-39 Vector Quantization

Lecture 40: L40-Transform Coding Part-I