objectiveIntroduced by Deep InfoMax · 2018
Mutual-information maximisation
Learn features by maximising information shared between an input and its encoding, or between views.
Drafted by AI · not yet reviewed
How this idea evolved
Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Deep InfoMax cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.
Predict future latents and score them against negatives with a contrastive loss.