Reconstructing Think from Human Auditory Cortex

Presentation on theme: "Reconstructing Think from Human Auditory Cortex"— Presentation transcript:

1 Reconstructing Think from Human Auditory Cortex
청각 영역의 ECoG를 이용한 생각 예측 Reconstructing Think from Human Auditory Cortex 나영민 울산대학교 의공학과 연구 배경 Figure 1. Experiment paradigm Language processing analysis - Non-invasive method : fMRI, PET, EEG  단점 : 뇌의 신호변화를 즉시 추적할 수 없음. - Invasive method : ECoG 장점 : 시공간적인 해상도가 좋음. Using ECoG in English word - only record the hearing, visual, thinking and speaking word [1] - record and reconstruct the speaking, hearing word[2] In this study - Using ECoG in Korean word - record and reconstruct the speaking, hearing and thinking word

2 연구 방법 ECoG 데이터 수집 ECoG 데이터 분석 유사성 판단
데이터 단어 분리 Spectrogram 그리기 Reconstruction model 구하기 Input signal 과 reconstructed의 Spectrogram 유사성 판단 Speaking, Thinking, Hearing 유사성 판단 Word : 눈, 코, 귀 목, 삼, 오, 구, 십 Play sound Speak Think 400Trial or 2s 0s 1Trial Recording 124 channel recording + 1 channel trigger Sampling rate : 1000 Hz Sound stimuli –Speaking : 400 trials ( 50 trials/sound, 8 sounds) Sound stimuli – Thinking : 400 trials Table 1. Experiment protocol ECoG 데이터 분석 유사성 판단 뇌파분석프로그램 Matlab기반 UC San Diego 대학 SCCN lab. 제공 Figure 3. Expected result Figure 2. EEGLAB toolbox in MATLAB(R2013a) Correlation coefficient, 𝑟= ( 𝑥 𝑖 − 𝑥 )( 𝑦 𝑖 − 𝑦 ) ( 𝑥 𝑖 − 𝑥 ) ( 𝑦 𝑖 − 𝑦 ) 2

3 Reconstruction model 구하기 Overt, Covert , Hearing 비교
연구 계획 최종 평가 계획발표 Completed To be completed 3-Feb 30-Oct 9-Apr 5-May 5-Jun 11-Feb 10-Jul 15-Aug 25-Feb 중간발표 Jan Feb Mar Apr May Jun Jul Aug Sept Oct Nov Dec Sequence 데이터 수집 EEGLAB 공부 Spectrogram 그리기 Reconstruction model 구하기 Input signal과 유사성 판단 Overt, Covert , Hearing 비교 논문 투고 결 과 물 참고 문헌 대한의용생체공학회 추계 학술대회 발표 및 학회지 투고. [1] Xiaomei Pei et al., “Spatiotemporal dynamics of electrocorticographic high gamma activity during overt and covert word repetition”, NeuroImage, vol. 54, pp , 2011 [2] Pasley, B. N. et al., “Reconstructing Speech from Human Auditory Cortex”, PLoS Biol., vol. 10, e , 2012 [3] Eric C. Leuthardt et al., “Temporal evolution of gamma activity in human cortex during an overt and covert word repetition task”, Front. Hum. Neurosci., vol. 6, pp. 99, 2012 Future work BCI (Brain Computer Interface)의 정확도 향상에 활용 가능.