<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Boosting on Aayush Bajaj's Augmenting Infrastructure</title><link>https://abaj.ai/tags/boosting/</link><description>Recent content in Boosting on Aayush Bajaj's Augmenting Infrastructure</description><generator>Hugo</generator><language>en</language><copyright>© 2026 Aayush Bajaj</copyright><lastBuildDate>Thu, 09 Jul 2026 21:02:19 +1000</lastBuildDate><atom:link href="https://abaj.ai/tags/boosting/index.xml" rel="self" type="application/rss+xml"/><item><title>Ensemble Learning</title><link>https://abaj.ai/wiki/ml/supervised/classification/ensembles/</link><pubDate>Thu, 09 Jul 2026 21:02:56 +1000</pubDate><guid>https://abaj.ai/wiki/ml/supervised/classification/ensembles/</guid><description>&lt;p>one model is an opinion; a committee is an estimator.&lt;span class="margin-note" data-note="the committee must actually disagree sometimes — a parliament of clones has the variance of one member.">
 &lt;span class="margin-note-indicator">𐃏&lt;/span>
&lt;/span>

ensemble methods build many imperfect predictors and combine them, and the two great families attack opposite ends of the &lt;a
 href="https://abaj.ai/wiki/ml/theory/bias-var/"
 
 
>bias-variance decomposition&lt;/a>: &lt;strong>bagging&lt;/strong> averages low-bias, high-variance models to cancel their wobble; &lt;strong>boosting&lt;/strong> stacks up high-bias, low-variance weak learners to build accuracy that none of them has alone.&lt;/p></description></item></channel></rss>