电脑桌面
添加小米粒文库到电脑桌面
安装后可以在桌面快捷访问

ExtractingandComposingRobustFeatureswithDenoisingAutoencoders

ExtractingandComposingRobustFeatureswithDenoisingAutoencoders_第1页
1/8
ExtractingandComposingRobustFeatureswithDenoisingAutoencoders_第2页
2/8
ExtractingandComposingRobustFeatureswithDenoisingAutoencoders_第3页
3/8
Extracting and Composing Robust Features with DenoisingAutoencodersPascal Vincentvincentp@iro.umontreal.caHugo Larochellelarocheh@iro.umontreal.caYoshua Bengiobengioy@iro.umontreal.caPierre-Antoine Manzagolmanzagop@iro.umontreal.caUniversit´e de Montr´eal, Dept. IRO, CP 6128, Succ. Centre-Ville, Montral, Qubec, H3C 3J7, CanadaAbstractPrevious work has shown that the difficul-ties in learning deep generative or discrim-inative models can be overcome by an ini-tial unsupervised learning step that maps in-puts to useful intermediate representations.We introduceand motivate a new trainingprinciple for unsupervised learning of a rep-resentation based on the idea of making thelearned representations robust to partial cor-ruption of the input pattern. This approachcan be used to train autoencoders, and thesedenoising autoencoders can be stacked to ini-tialize deep architectures. The algorithm canbe motivated from a manifold learning andinformation theoretic perspective or from agenerative model perspective. Comparativeexperiments clearly show the surprising ad-vantage of corrupting the input of autoen-coders on a pattern classification benchmarksuite.1. IntroductionRecent theoretical studies indicate that deep architec-tures (Bengio & Le Cun, 2007; Bengio, 2007) may beneeded to effi cientlymodel complex distributions andachieve better generalization performance on challeng-ing recognition tasks. The belief that additional levelsof functional composition will yield increased repre-sentational and modeling power is not new (McClel-land et al., 1986; Hinton, 1989; Utgoff & Stracuzzi,2002). However, in practice, learning in deep archi-tectures has proven to be difficult. One needs onlyAppearing in Proceedings of the 25 th International Confer-ence on Machine Learnin...

1、当您付费下载文档后,您只拥有了使用权限,并不意味着购买了版权,文档只能用于自身使用,不得用于其他商业用途(如 [转卖]进行直接盈利或[编辑后售卖]进行间接盈利)。
2、本站所有内容均由合作方或网友上传,本站不对文档的完整性、权威性及其观点立场正确性做任何保证或承诺!文档内容仅供研究参考,付费前请自行鉴别。
3、如文档内容存在违规,或者侵犯商业秘密、侵犯著作权等,请点击“违规举报”。

碎片内容

ExtractingandComposingRobustFeatureswithDenoisingAutoencoders

确认删除?
VIP
微信客服
  • 扫码咨询
会员Q群
  • 会员专属群点击这里加入QQ群
客服邮箱
回到顶部