信息论与编码理论TheoriesofInformationandCoding第一章介绍Chapter1Introduction信息论informationtheory编码理论codingtheory发出emit字节bit二进制binary二进制对称源binarysymmetricsource二进制对称信道binarysymmetricchannel原始字节错误率rawbiterrorprobability编码encode字节错误率biterrorprobability噪音noise冗余redundant相互校验crosscheck编码算法coddingalgorithm错误模式errorpattern综合synthesis汉明码Hammingcode单独错误校正码single-error-correctingcode速率rate二进制熵函数binaryentropyfunction能量capacity信道编码理论channelcodingtheory第二章信息理论Chapter2InformationTheory比特bits(binarydigits)自然码naturaldigits熵函数entropyfunction可能向量probabilityvector条件熵conditionalentropy离散记忆信道discretememorychannel过渡可能性transitionprobability产出output边际分布marginaldistritution互信息mutualinformation启发式heuristic联合熵jointentropy维恩图Venndiagram马尔可夫链Markovchain限定函数definitefunction串联tandem数据过程配置data-processingconfiguration凸组合convexcombination操作manipulation速记法shorthand通信系统communicationsystem连续信息输出continuoussourceoutputs编码员coder映射map目标destination数据过程定理data-processingtheorem离散量化discretequantization改进/精炼refinement密度density中值定理meanvaluetheorem表面相似superficialresemblance网格mesh微分熵differentialentropy琴生不等式Jenseninequality确定信道determinatechannel信息论与编码理论中的英文单词和短语第三章离散无记忆信道和容量成本方程Chapter3DiscreteMemorylessChannelsandtheirCapacity-CostEquations输入符号系统inputsignsystem输出符号系统outputsignsystem想象imagine无记忆假设memorylessassumption平均成本averagecost容量成本方程capacity-costequation验证源头test-sourcen维容许验证源头n-dimensionaladmissibletestsources容许成本admissiblecostr对称r-symmetry系统比率rateofsystem超过信道容量率ratesabovechannelcapacity长length每个符号的比特bitspersymbol编码规则decodingrule区别代码distinctcode指示函数indicatorfunction随机编码randomcoding期望值expectedvalue弱大数定律weaklawoflargenumbers编码范围decodingsphere第四章离散无记忆信源和扭曲率方程Chapter4DiscreteMemorylessSourcesandtheirRate-DistortionEquations源字母表sourcealphabet离散无记忆信源discretememorylesssources统计源sourcestatistics目标符号objectsign扭曲distortion扭曲度distortionmeasure平均扭曲averagedistortion测试通道testchannel扭曲率distortionrate源编码定理sourcecodingtheorem向后测试通道backwardstestchannel哈莫名扭曲度Hammingdistortionmeasure错误扭曲率errorprobabilitydistortionrate数据压缩定理data-compressiontheorem目的符号destinationsymbols数据压缩系统datacompressionscheme罚函数penaltyfunction无限制和unrestrictedsum内部和innersum第五章高斯信道和信源Chapter5GaussianChannelandSource伏特voltage传送transmit信号signal瓦watts耗散dissipate焦耳joule白高斯噪声过程whiteGaussiannoiseprocess噪声错误密度noisespectraldensity带宽bandwidth波段限制band-limited功率限制power-limited第n项容量成本函数n-thcapacity-costfunction平方错误squared-error总的容量成本函数噪声密度overallcapacity-costfunctionoinkdensity算术-几何均值arithmetic-geometricaveragevalue离散时间无记忆高斯信源discrete-timememorylessGaussiansource均值平方错误标准mean-squarederrorcriterion高斯分布gaussiondistribution高斯信源每个符号均值平方扭曲Gaussiansourceper-symbolper-symbolmean-squareddistortion第六章信源-信道编码理论Chapter6Source-ChannelCodingTheory信息源informationsource噪声源noisysource数据处理dataprocessing量子化quantization调节modulation连...
