Category: Uncategorized
-
Two different first-principle theories on what produces pink noise DOI: 10.13140/RG.2.2.26687.78246 . What is Pink Noise My interest in pink noise comes from a background in cognitive neuroscience: Pink noise shows up in the human brain — whether using electroencephalography (EEG), magnetoencephalograpy (MEG), or even in channel noise at the neuron cellular level. I haven’t…
-
How do Large Language Models integrate concepts/words/patterns? Existing theory assumes they store a large dictionary and do simple computation (linear addition) with concepts from that dictionary. I show multiple kinds of evidence that LLMs store (& use) complex integrations (non-linear relationships) between concepts/words/patterns, revealing this ability with a relatively simple mechanistic interpretability method — and…
-
This is a post intended to cover some of the more advanced analyses techniques from a project ~5 years ago (2020-2021) which enabled greater-than-state-of-the-art accuracy with single-trial, non-invasive, non-visual-paradigm signal capture. Motivation: I was attempting to build a non-invasive learning-assistant peripheral that could capture real-time brain signals (non-laboratory paradigm). There were a large number of…
-
[Posted: https://arxiv.org/abs/2507.00269] This post updates my previous work with a final post on my feature integration in neural networks project (previous posts) with a novel interpretability architecture that substantially improves both reconstruction fidelity and behavioral preservation. layman’s tl;dr: Scientists attempt to read the “thinking” of AI use a technique called Autoencoders to convert raw neural signals…
