信息论与编码理论TheoriesofInformationandCoding第一章介绍Chapter1Introduction信息论informationtheory编码理论codingtheory发出emit字节bit二进制binary二进制对称源binarysymmetricsource二进制对称信道binarysymmetricchannel原始字节错误率rawbiterrorprobability编码encode字节错误率biterrorprobability噪音noise冗余redundant相互校验crosscheck编码算法coddingalgorithm错误模式errorpattern综合synthesis汉明码Hammingcode单独错误校正码single-error-correctingcode速率rate二进制熵函数binaryentropyfunction能量capacity信道编码理论channelcodingtheory第二章信息理论Chapter2InformationTheory比特bits(binarydigits)自然码naturaldigits熵函数entropyfunction可能向量probabilityvector条件熵conditionalentropy离散记忆信道discretememorychannel过渡可能性transitionprobability产出output边际分布marginaldistritution互信息mutualinformation启发式heuristic联合熵jointentropy维恩图Venndiagram马尔可夫链Markovchain限定函数definitefunction串联tandem数据过程配置data-processingconfiguration凸组合convexcombinat