📋 Tender Overview
Reading Minds And Machines
Can We Decode The Training Data Of A Deep Neural Network (Dnn) Directly From Its Parameters?
Training Data Of Dnns Are Assumed Safe. Recent Findings By Us And By Others Indicate That This Is Not The Case, With Severe Implications On Data-Privacy. Yet, Such Findings Shed Light On Why Dnns Perform So Well.
On A Different Front: Can We Decode What A Person Saw/Heard/Thinks Directly From Their Brain Activity?
This May Have Huge Benefits: Communicate With Locked-In Patients, Explore Dreams, Man-Machine Interfaces, Enhance Our Understanding Of The Human Brain. No Risk Of Violating Human Privacy Here, As Thoughts Do Not Float In The Air And Person’S Collaboration Is Required.
Each Of Those 2 Questions Is Intriguing On Its Own, With Far-Reaching Implications. Despite The Inherent Differences Between Human Brains & Dnns, They Also Have Much In Common. Exploring The Two In-Tandem Can Lead To Significant Breakthroughs In Both Fields. Recent Advancements In Both Areas, With Recent Incorporation Of Deep-Learning (Dl) Tools To Analyze Brain Activity, Opens The Door To Explore The Two Jointly. Our Expertise In Both Domains Will Enable Explicit Encoding/Decoding Between Brain Activity & Dnn Activations, Allowing To Directly Learn/Infer From One About The Other. Initial Explorations Indicate That Our Proposed Goals, Although Ambitious, Are Within Reach. Our Intermediate Goals In Each Domain Are Worthwhile On Their Own, Forming A Strong Safety Net.
Expected Outcomes Include:
•Deep Data-Privacy
•Insights On Dnns, Their Generalization & Vulnerabilities
•Insights On Of What Is Encoded Where In The Brain
•New Scientific Tools For Brain-Scientists To Explore The Brain
•Allow Locked-In (Als) Patients To Communicate Their Thoughts/Needs
•Use Brain Scanning To Improve Dnns & Dnns To Improve Brain Scanning
Our Project Requires No Human Subjects Nor Brainscience Expertise; Only Publicly Available Datasets. All Methods Lie In Computer-Vision & Dl, With Impact On Both Dl & Brainscience.
Funded Under
European Research Council (Erc)
Total Cost
€ 2 499 333,00
Eu Contribution
€ 2 499 333,00
Coordinated By
Weizmann Institute Of Science
Israel
Start Date
1 July 2024
End Date
30 June 2029
Objective
Can we decode the training data of a Deep Neural Network (DNN) directly from its parameters?
Training data of DNNs are assumed safe. Recent findings by us and by others indicate that this is not the case, with severe implications on Data-Privacy. Yet, such findings shed light on why DNNs perform so well.
On a different front: Can we decode what a person saw/heard/thinks directly from their brain activity?
This may have huge benefits: communicate with locked-in patients, explore dreams, man-machine interfaces, enhance our understanding of the human brain. No risk of violating human privacy here, as thoughts do not float in the air and person’s collaboration is required.
Each of those 2 questions is intriguing on its
