# Do bipartite spin glasses have simple relaxation dynamics?

+ 3 like - 0 dislike
33 views

From what I gather, a Boltzmann machine (BM) is essentially a spin glass with no applied field evolving under Glauber dynamics (if this is at all mistaken, I don't think it will be off enough to materially affect the following, but I would welcome elaboration anyway). For background, see, e.g. Amit et al., PRA 32, 1007 (1985): their suggestion that the "detailed dynamic properties of the...Hopfield models, e.g. the rate of relaxation" be studied is at the root of my question below.

Now, a restricted BM (RBM) is a bipartite BM, and the maximal independent sets correspond to visible and hidden units/nodes. RBMs can be "stacked" to form a deep BM (DBM), and these DBMs have attracted a lot of interest over the past 5-6 years due to the practicality of a training algorithm for them.

It is well known that spin glasses have very complicated dynamics: in particular, a multitude of separated timescales contribute to their evolution. That said, I have seen recent work that (upon a cursory look) seems to suggest that bipartite spin glasses/RBMs have reasonably well-defined equilibrium (or steady state?) behavior, in which convex combinations of the "visible" and "hidden" glasses characterize the overall situation (Barra et al., J. Phys A 44, 245002 (2011)--NB. I have only skimmed this).

This in turn seems to suggest to me that the relaxation dynamics of these bipartite spin glasses/RBMs is comparatively tractable. So my question is:

Is the preceding sentence justified? And if so, what do the relaxation dynamics of bipartite spin glasses/RBMs look like? Is there a single independent characteristic timescale (e.g., relaxation and mixing times are different in general, but closely related and certainly not independent)?

I would welcome any references within the last 5 years--not, e.g. MacKay, etc.

(NB. A less detailed version of this question was posted at stats.stackexchange a few days ago.)

This post has been migrated from (A51.SE)
 Please use answers only to (at least partly) answer questions. To comment, discuss, or ask for clarification, leave a comment instead. To mask links under text, please type your text, highlight it, and click the "link" button. You can then enter your link URL. Please consult the FAQ for as to how to format your post. This is the answer box; if you want to write a comment instead, please use the 'add comment' button. Live preview (may slow down editor)   Preview Your name to display (optional): Email me at this address if my answer is selected or commented on: Privacy: Your email address will only be used for sending these notifications. Anti-spam verification: If you are a human please identify the position of the character covered by the symbol $\varnothing$ in the following word:p$\hbar$ysicsOv$\varnothing$rflowThen drag the red bullet below over the corresponding character of our banner. When you drop it there, the bullet changes to green (on slow internet connections after a few seconds). To avoid this verification in future, please log in or register.