<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Denoising on Aayush Bajaj's Augmenting Infrastructure</title><link>https://abaj.ai/tags/denoising/</link><description>Recent content in Denoising on Aayush Bajaj's Augmenting Infrastructure</description><generator>Hugo</generator><language>en</language><copyright>© 2026 Aayush Bajaj</copyright><lastBuildDate>Fri, 10 Jul 2026 08:15:43 +1000</lastBuildDate><atom:link href="https://abaj.ai/tags/denoising/index.xml" rel="self" type="application/rss+xml"/><item><title>Stable Diffusion Models</title><link>https://abaj.ai/wiki/ml/dl/stable-diffusion/</link><pubDate>Fri, 10 Jul 2026 01:42:07 +1000</pubDate><guid>https://abaj.ai/wiki/ml/dl/stable-diffusion/</guid><description>&lt;p>diffusion models generate by learning to undo noise: destroy an image with a fixed gaussian corruption process, train a network to reverse one small step of the destruction, then chain the reversals from pure noise back to data (ho et al. 2020, &lt;a
 href="https://arxiv.org/abs/2006.11239"
 
 
 class="link--external" target="_blank" rel="noreferrer"
 
>&lt;em>denoising diffusion probabilistic models&lt;/em>&lt;/a>).&lt;span class="margin-note" data-note="the generative modelling trick of the decade: replace an adversarial game with a supervised regression problem">
 &lt;span class="margin-note-indicator">𐃏&lt;/span>
&lt;/span>

&lt;strong>stable diffusion&lt;/strong> (rombach et al. 2022, &lt;a
 href="https://arxiv.org/abs/2112.10752"
 
 
 class="link--external" target="_blank" rel="noreferrer"
 
>&lt;em>high-resolution image synthesis with latent diffusion models&lt;/em>&lt;/a>) runs this machinery not on pixels but in the latent space of an autoencoder, with a text-conditioned u-net doing the denoising. first the maths, then the architecture.&lt;/p></description></item><item><title>Autoencoders</title><link>https://abaj.ai/wiki/ml/dl/autoencoders/</link><pubDate>Thu, 09 Jul 2026 21:02:56 +1000</pubDate><guid>https://abaj.ai/wiki/ml/dl/autoencoders/</guid><description>&lt;p>an autoencoder is a network trained to do the one thing that sounds useless: output its own input. the trick is the obstacle course in the middle — a bottleneck, a corruption, a penalty — that makes verbatim copying impossible, so the network is forced to learn &lt;em>what about the input is worth keeping&lt;/em>.&lt;span class="margin-note" data-note="supervision without labels: the data is its own target, and the architecture is the teacher">
 &lt;span class="margin-note-indicator">𐃏&lt;/span>
&lt;/span>

the family tree below runs from the linear special case (which is &lt;a
 href="https://abaj.ai/wiki/ml/unsupervised/pca/"
 
 
>pca&lt;/a> wearing a trenchcoat) to the variational autoencoder, which turns the whole construction into a generative model (Goodfellow, Ian, 2016).&lt;/p></description></item></channel></rss>