The Most Underrated Algorithm

I saw this one a while ago. ▶ this video - The Remarkable Story Behind The Most Important Algorithm Of All Time In summary, FFT is just a "dynamic programming" version of Fourier Transforms, in that it's the same idea, just with avoiding repeating a lot of duplicated calculations.

in “The Fourier Transform: What's Wrong with It?” · View on HN

Consider ordinary 3 dimensional space: Go to a corner of the room, where the floor and two walls meet, and see three lines, each line the intersection of the two walls or a wall and the floor. In usual building architecture, these three lines are mutually perpendicular, i.e., orthogonal . Regard each of these three lines as an axis of a coordinate system. In particular, pick a point on each of the three axes to give us points with coordinates: (1,0,0) -- the X axis (0,1,0) -- the Y axis (0,0,1) -- the Z axis Soooo, now we have a standard coordinate system for ordinary 3 dimensional space. Now consider a point P in the room (in my case, the end of the pony tail of that sweet, gorgeous blond I keep looking at!) with coordinates (x,y,z) for some numbers x, y, z. For the X coordinate of point P we make use of the X axis and our point P: We take the dot ( inner ) product of (1,0,0) and (x,y,z) and get, presto, bingo, wonder of wonders, no doubt, x. Similarly for y and z. Or, for each axis, our inner product projects point P on that axis. And from those projections we can reconstruct the coordinates of point P. Beginning to sound like Fourier theory???? This stuff of projections onto orthogonal and then reconstructions from that generalizes. In Fourier theory, those sine waves are mutually perpendicular -- project one on another and get 0. That summation is the inner product for that projection. And if not a summation, then an integration -- same stuff, use an inner product to do p

in “Not so fast, Mr. Fourier” · View on HN

I recommend learning about the Fourier Transform, and then peeking at how frequency transformations are used to represent everyday images, like the Cosine Transform used in JPEG. 3 blue 1 brown FFT: [link] JPEG components [link] I worked at the Very Large Array radio telescope for a while, and even so the language didn't click for me until I thought about the signal transforms that have become ubiquitous in everyday life. And a co worker described the telescope as a double-slit experiment, with multiple 2-D holes instead of slits; imagine the interference pattern that you get when you have multiple slits. The elements of an interferometer are the "slits", but they are receiving the light rather than emitting it. The VLA has 27 radio dishes for its elements, so poke 27 holes in a board and shoot a laser through the holes, you get this blurry pattern on the wall. That's the distortion from the shape of your telescope, you're trying to cancel that out... Then there's the time domain, because the Earth is rotating, so your telescope is sweeping a pattern across the sky. It can seem like a hopeless mess, but it's actually the case that for most observations, that sweep gives you even more coverage of the image. It can be a good thing. But you have to keep track of one wavefront across all of those moving elements. The correlator is a computer doing those FFTs to find where the signal matches enough between the elements to start extracting finer detail. I think some insight into ho

in “What is interferometry?” · View on HN