Bayesian-directed acyclic discrete-variable graphs are reduced to a simplified normal form made up of only replicator units (or equal constraint units), source, and single-input/single-output blocks. In this framework, the same adaptation algorithm can be applied to all the parametric blocks. We obtain and compare adaptation rules derived from a constrained maximum likelihood formulation and a minimum Kullback-Leibler divergence criterion using Karush-Kuhn-Tucker conditions. The learning algorithms are compared with two other updating equations based on localized decisions and on a variational approximation, respectively. The performance of the various algorithms is verified on synthetic data sets for various architectures. Factor graphs in reduced normal form provide an appealing framework for rapid deployment of Bayesian-directed graphs in the applications.

A Comparison of Algorithms for Learning Hidden Variables in Bayesian Factor Graphs in Reduced Normal Form

Palmieri, Francesco A. N.
2016

Abstract

Bayesian-directed acyclic discrete-variable graphs are reduced to a simplified normal form made up of only replicator units (or equal constraint units), source, and single-input/single-output blocks. In this framework, the same adaptation algorithm can be applied to all the parametric blocks. We obtain and compare adaptation rules derived from a constrained maximum likelihood formulation and a minimum Kullback-Leibler divergence criterion using Karush-Kuhn-Tucker conditions. The learning algorithms are compared with two other updating equations based on localized decisions and on a variational approximation, respectively. The performance of the various algorithms is verified on synthetic data sets for various architectures. Factor graphs in reduced normal form provide an appealing framework for rapid deployment of Bayesian-directed graphs in the applications.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11591/389922
Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 10
  • ???jsp.display-item.citation.isi??? ND
social impact