<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Concentration on Aayush Bajaj's Augmenting Infrastructure</title><link>https://abaj.ai/tags/concentration/</link><description>Recent content in Concentration on Aayush Bajaj's Augmenting Infrastructure</description><generator>Hugo</generator><language>en</language><copyright>© 2026 Aayush Bajaj</copyright><lastBuildDate>Fri, 10 Jul 2026 08:20:15 +1000</lastBuildDate><atom:link href="https://abaj.ai/tags/concentration/index.xml" rel="self" type="application/rss+xml"/><item><title>Curse of Dimensionality</title><link>https://abaj.ai/wiki/ml/theory/curse-dim/</link><pubDate>Thu, 09 Jul 2026 21:02:56 +1000</pubDate><guid>https://abaj.ai/wiki/ml/theory/curse-dim/</guid><description>&lt;p>geometric intuition is trained in \(p \le 3\) and it does not survive the trip upstairs.&lt;span class="margin-note" data-note="the phrase is bellman&amp;#39;s, coined in the preface of his 1957 /dynamic programming/, where filling a grid over a high-dimensional state space first went bankrupt">
 &lt;span class="margin-note-indicator">𐃏&lt;/span>
&lt;/span>

in high dimensions the volume of a cube hides in its corners, every point is near the boundary, all pairwise distances look alike, and &amp;ldquo;local&amp;rdquo; neighbourhoods must stretch almost the full width of the space before they contain any data. every method that reasons from &lt;em>closeness&lt;/em> — knn, kernel smoothers, rbf kernels — inherits these pathologies at once.&lt;/p></description></item></channel></rss>