brain-encoding

Official repository for "A Dual-Stream Neural Network Explains the Functional Segregation of Dorsal and Ventral Visual Pathways in Human Brains", NeurIPS-23.

Load and model the brain data of the Algonauts Project 2023 Challenge.

Code for my Master's Thesis "Deep Neural Encoding Models of the Human Visual Cortex to Predict fMRI Responses to Natural Visual Scenes" and my submission for the "Algonauts Project 2023 Challenge".

MIND: Mixture-of-Experts Integrated Decoder for Multimodal Brain Encoding (ICASSP 2026)

A lightweight multimodal brain-encoding research prototype distilled from TRIBE v2 for predicting fMRI responses to naturalistic video.

🧠 Find songs that feel alike by how a brain would respond to them, not by tempo or genre.

Subcortical response analysis for video stimuli using TRIBE v2.

Neural attention analytics — predict brain responses to any video using TRIBE v2 (Meta FAIR)

Validates whether META's TRIBE v2 predicted brain activations help LLMs understand emotion. 3-condition A/B/C experiment, 100 samples, ElevenLabs audio + local LLM inference.

Compare two videos by the brain response Meta's TRIBE v2 predicts. Serverless GPU backend on Modal, 3D cortex viewer in React + three.js.

Predicting a new person's EEG/fMRI responses to images from a few hundred labels: borrow other people's encoders, then fit a small personal map. Prespecified tests on THINGS-EEG1/2, Alljoined, NSD and NOD.

Don't follow the herd. Predict it. Brain-encoded swarm social simulation engine. First project built on Meta TRIBE v2.

Neuroimaging preprocessing, brain decoding, and visual brain encoding using fMRI, EEG/MEG, CNNs, VLMs, and transformer representations

Exploring AI brain encoding models and neural activation mapping

Simulate a persona reading your copy, predict the cortical response with Meta's TRIBEv2, and get evidence-grounded rewrites.

Modular brain encoding pipeline aligning transformer-based NLP embeddings with fMRI data for brain-language analysis.

Functional ultrasound vs. a brain foundation model on the same speech experiment. Measures fUSI response timing from data (later and broader than the fMRI convention), and replays the paradigm through Meta's TRIBE v2 with acoustic controls: its audio pathway is fooled by reversed speech. Tested, reproducible pipeline.

fMRI encoding models comparing biological visual hierarchy (NSD 7T) against CNNs, Vision Transformers, and Multimodal CLIP with interactive visualization.

Fork of Meta FAIR's TRIBE v2 multimodal brain-response model, carrying a fix for WhisperX on non-CUDA devices (int8 rather than float16) that was sent upstream as PR #20. Used in production by CineNeuro.

A room that sees, thinks and remembers: an eight-day gallery installation with dual-Kinect point clouds, a brain-encoding model and a local vision-language model giving the room its own voice.