置信度传播
外观
置信度传播(英语:belief propagation),又称为乘积和信息传递(sum-product message passing),是在贝叶斯网络、马尔可夫随机场等概率图模型中用于推断的一种信息传递算法。在给定已观测节点时,可以用该算法高效地计算未观测节点的边缘分布。置信度传播在人工智能、信息论中十分常见,已成功应用于低密度奇偶检查码、Turbo码、自由能估计、可满足性等不同领域。[1]
置信度传播由美国计算机科学家朱迪亚·珀尔于1982年提出。[2]最初该算法的运用范围仅限于树,不久则扩展到多树。[3]此后,研究者发现在一般的图中该算法是一种十分有用的近似算法。[4]
参考文献
[编辑]- ^ Braunstein, A.; Mézard, M.; Zecchina, R. Survey propagation: An algorithm for satisfiability. Random Structures & Algorithms. 2005, 27 (2): 201–226. doi:10.1002/rsa.20057.
- ^ Pearl, Judea. Reverend Bayes on inference engines: A distributed hierarchical approach (PDF). Proceedings of the Second National Conference on Artificial Intelligence. AAAI-82: Pittsburgh, PA. Menlo Park, California: AAAI Press: 133–136. 1982 [2009-03-28]. (原始内容存档 (PDF)于2011-06-04).
- ^ Kim, Jin H.; Pearl, Judea. A computational model for combined causal and diagnostic reasoning in inference systems (PDF). Proceedings of the Eighth International Joint Conference on Artificial Intelligence. IJCAI-83: Karlsruhe, Germany 1: 190–193. 1983 [2016-03-20]. (原始内容存档 (PDF)于2016-04-02).
- ^ Pearl, Judea. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 2nd. San Francisco, CA: Morgan Kaufmann. 1988. ISBN 1-55860-479-0.
延伸阅读
[编辑]- Bickson, Danny. (2009). Gaussian Belief Propagation Resource Page (页面存档备份,存于互联网档案馆) —Webpage containing recent publications as well as Matlab source code.
- Bishop, Christopher M. Chapter 8: Graphical models (PDF). Pattern Recognition and Machine Learning. Springer. 2006: 359–418 [2014-03-20]. ISBN 0-387-31073-8. (原始内容存档 (PDF)于2016-03-20).
- Coughlan, James. (2009). A Tutorial Introduction to Belief Propagation.
- Koch, Volker M. (2007). A Factor Graph Approach to Model-Based Signal Separation —A tutorial-style dissertation
- Löliger, Hans-Andrea. An Introduction to Factor Graphs. IEEE Signal Proc. Mag. 2004, 21: 28–41 [2017-10-19]. (原始内容存档于2017-05-17).
- Mackenzie, Dana (2005). "Communication Speed Nears Terminal Velocity (页面存档备份,存于互联网档案馆)", New Scientist. 9 July 2005. Issue 2507 (Registration required)
- Wymeersch, Henk. Iterative Receiver Design. Cambridge University Press. 2007 [2017-10-19]. ISBN 0-521-87315-0. (原始内容存档于2016-03-03).
- Yedidia, J.S.; Freeman, W.T.; Weiss, Y. Understanding Belief Propagation and Its Generalizations. Lakemeyer, Gerhard; Nebel, Bernhard (编). Exploring Artificial Intelligence in the New Millennium. Morgan Kaufmann. January 2003: 239–236 [2009-03-30]. ISBN 1-55860-811-7. (原始内容存档于2020-12-05).
- Yedidia, J.S.; Freeman, W.T.; Weiss, Y. Constructing free-energy approximations and generalized belief propagation algorithms. IEEE Transactions on Information Theory. July 2005, 51 (7): 2282–2312 [2009-03-28]. doi:10.1109/TIT.2005.850085. (原始内容存档于2009-04-18).