Martin Maier
Photo: SCIoI
Martin Maier worked as a postdoctoral researcher in SCIoI project 08, “Knowledge-augmented face perception,” bridging the gap between human and synthetic face processing. Martin’s aim at SCIoI was to create novel paradigms to explore how humans and machines can draw on prior knowledge and context to improve visual perception. Martin’s previous work revealed influences of language on fundamental aspects of perception and was awarded by the Cognitive Science Society with the prestigious Glushko Dissertation Prize, as well as the ‘Dissertationspreis Adlershof’.
Projects
Martin Maier is member of:
Publications +
6984777
Maier
1
apa
50
date
desc
year
19945
https://www.scienceofintelligence.de/wp-content/plugins/zotpress/
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3Afalse%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%22EXWDR2GP%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Maier%20et%20al.%22%2C%22parsedDate%22%3A%222025-04-02%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMaier%2C%20M.%2C%20Leonhardt%2C%20A.%2C%20Blume%2C%20F.%2C%20Bideau%2C%20P.%2C%20Hellwich%2C%20O.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282025%29.%20Neural%20dynamics%20of%20mental%20state%20attribution%20to%20social%20robot%20faces.%20%26lt%3Bi%26gt%3BSocial%20Cognitive%20and%20Affective%20Neuroscience%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B20%26lt%3B%5C%2Fi%26gt%3B%281%29%2C%20nsaf027.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1093%5C%2Fscan%5C%2Fnsaf027%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1093%5C%2Fscan%5C%2Fnsaf027%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Neural%20dynamics%20of%20mental%20state%20attribution%20to%20social%20robot%20faces%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alexander%22%2C%22lastName%22%3A%22Leonhardt%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Florian%22%2C%22lastName%22%3A%22Blume%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Pia%22%2C%22lastName%22%3A%22Bideau%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Olaf%22%2C%22lastName%22%3A%22Hellwich%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22Abstract%5Cn%20%20%20%20%20%20%20%20%20%20%20%20The%20interplay%20of%20mind%20attribution%20and%20emotional%20responses%20is%20considered%20crucial%20in%20shaping%20human%20trust%20and%20acceptance%20of%20social%20robots.%20Understanding%20this%20interplay%20can%20help%20us%20create%20the%20right%20conditions%20for%20successful%20human%5Cu2013robot%20social%20interaction%20in%20alignment%20with%20societal%20goals.%20Our%20study%20shows%20that%20affective%20information%20about%20robots%20describing%20positive%2C%20negative%2C%20or%20neutral%20behaviour%20leads%20participants%20%28N%5Cu2009%3D%5Cu200990%29%20to%20attribute%20mental%20states%20to%20robot%20faces%2C%20modulating%20impressions%20of%20trustworthiness%2C%20facial%20expression%2C%20and%20intentionality.%20Electroencephalography%20recordings%20from%2030%20participants%20revealed%20that%20affective%20information%20influenced%20specific%20processing%20stages%20in%20the%20brain%20associated%20with%20early%20face%20perception%20%28N170%20component%29%20and%20more%20elaborate%20stimulus%20evaluation%20%28late%20positive%20potential%29.%20However%2C%20a%20modulation%20of%20fast%20emotional%20brain%20responses%2C%20typically%20found%20for%20human%20faces%20%28early%20posterior%20negativity%29%2C%20was%20not%20observed.%20These%20findings%20suggest%20that%20neural%20processing%20of%20robot%20faces%20alternates%20between%20being%20perceived%20as%20mindless%20machines%20and%20intentional%20agents%3A%20people%20rapidly%20attribute%20mental%20states%20during%20perception%2C%20literally%20seeing%20good%20or%20bad%20intentions%20in%20robot%20faces%2C%20but%20are%20emotionally%20less%20affected%20than%20when%20facing%20humans.%20These%20nuanced%20insights%20into%20the%20fundamental%20psychological%20and%20neural%20processes%20underlying%20mind%20attribution%20can%20enhance%20our%20understanding%20of%20human%5Cu2013robot%20social%20interactions%20and%20inform%20policies%20surrounding%20the%20moral%20responsibility%20of%20artificial%20agents.%22%2C%22date%22%3A%222025-04-02%22%2C%22section%22%3A%22%22%2C%22partNumber%22%3A%22%22%2C%22partTitle%22%3A%22%22%2C%22DOI%22%3A%2210.1093%5C%2Fscan%5C%2Fnsaf027%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Facademic.oup.com%5C%2Fscan%5C%2Farticle%5C%2Fdoi%5C%2F10.1093%5C%2Fscan%5C%2Fnsaf027%5C%2F8069429%22%2C%22PMID%22%3A%22%22%2C%22PMCID%22%3A%22%22%2C%22ISSN%22%3A%221749-5016%2C%201749-5024%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-22T11%3A58%3A33Z%22%7D%7D%2C%7B%22key%22%3A%22I47S7QBP%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Blume%20et%20al.%22%2C%22parsedDate%22%3A%222025%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BBlume%2C%20F.%2C%20Qu%2C%20R.%2C%20Bideau%2C%20P.%2C%20Maier%2C%20M.%2C%20Rahman%2C%20R.%20A.%2C%20%26amp%3B%20Hellwich%2C%20O.%20%282025%29.%20How%20Do%20You%20Perceive%20My%20Face%3F%20Recognizing%20Facial%20Expressions%20in%26%23xA0%3BMulti-modal%20Context%20by%26%23xA0%3BModeling%20Mental%20Representations.%20In%20D.%20Cremers%2C%20Z.%20L%26%23xE4%3Bhner%2C%20M.%20Moeller%2C%20M.%20Nie%26%23xDF%3Bner%2C%20B.%20Ommer%2C%20%26amp%3B%20R.%20Triebel%20%28Eds.%29%2C%20%26lt%3Bi%26gt%3BPattern%20Recognition%26lt%3B%5C%2Fi%26gt%3B%20%28pp.%2020%26%23x2013%3B36%29.%20Springer%20Nature%20Switzerland.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-031-85187-2_2%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1007%5C%2F978-3-031-85187-2_2%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22How%20Do%20You%20Perceive%20My%20Face%3F%20Recognizing%20Facial%20Expressions%20in%5Cu00a0Multi-modal%20Context%20by%5Cu00a0Modeling%20Mental%20Representations%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Florian%22%2C%22lastName%22%3A%22Blume%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Runfeng%22%2C%22lastName%22%3A%22Qu%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Pia%22%2C%22lastName%22%3A%22Bideau%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%20Abdel%22%2C%22lastName%22%3A%22Rahman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Olaf%22%2C%22lastName%22%3A%22Hellwich%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Daniel%22%2C%22lastName%22%3A%22Cremers%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Zorah%22%2C%22lastName%22%3A%22L%5Cu00e4hner%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Michael%22%2C%22lastName%22%3A%22Moeller%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Matthias%22%2C%22lastName%22%3A%22Nie%5Cu00dfner%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Bj%5Cu00f6rn%22%2C%22lastName%22%3A%22Ommer%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Rudolph%22%2C%22lastName%22%3A%22Triebel%22%7D%5D%2C%22abstractNote%22%3A%22Facial%20expression%20perception%20in%20humans%20inherently%20relies%20on%20prior%20knowledge%20and%20contextual%20cues%2C%20contributing%20to%20efficient%20and%20flexible%20processing.%20For%20instance%2C%20multi-modal%20emotional%20context%20%28such%20as%20voice%20color%2C%20affective%20text%2C%20body%20pose%2C%20etc.%29%20can%20prompt%20people%20to%20perceive%20emotional%20expressions%20in%20objectively%20neutral%20faces.%20Drawing%20inspiration%20from%20this%2C%20we%20introduce%20a%20novel%20approach%20for%20facial%20expression%20classification%20that%20goes%20beyond%20simple%20classification%20tasks.%20Our%20model%20accurately%20classifies%20a%20perceived%20face%20and%20synthesizes%20the%20corresponding%20mental%20representation%20perceived%20by%20a%20human%20when%20observing%20a%20face%20in%20context.%20With%20this%2C%20our%20model%20offers%20visual%20insights%20into%20its%20internal%20decision-making%20process.%20We%20achieve%20this%20by%20learning%20two%20independent%20representations%20of%20content%20and%20context%20using%20a%20VAE-GAN%20architecture.%20Subsequently%2C%20we%20propose%20a%20novel%20attention%20mechanism%20for%20context-dependent%20feature%20adaptation.%20The%20adapted%20representation%20is%20used%20for%20classification%20and%20to%20generate%20a%20context-augmented%20expression.%20We%20evaluate%20synthesized%20expressions%20in%20a%20human%20study%2C%20showing%20that%20our%20model%20effectively%20produces%20approximations%20of%20human%20mental%20representations.%20We%20achieve%20State-of-the-Art%20classification%20accuracies%20of%2081.01%25%20on%20the%20RAVDESS%20dataset%20and%2079.34%25%20on%20the%20MEAD%20dataset.%20We%20make%20our%20code%20publicly%20available.%22%2C%22proceedingsTitle%22%3A%22Pattern%20Recognition%22%2C%22conferenceName%22%3A%22%22%2C%22date%22%3A%222025%22%2C%22eventPlace%22%3A%22%22%2C%22DOI%22%3A%2210.1007%5C%2F978-3-031-85187-2_2%22%2C%22ISBN%22%3A%22978-3-031-85187-2%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-29T10%3A40%3A16Z%22%7D%7D%2C%7B%22key%22%3A%22V35EXYW6%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Leonhardt%20et%20al.%22%2C%22parsedDate%22%3A%222024-07-02%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BLeonhardt%2C%20A.%2C%20Maier%2C%20M.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282024%29.%20%26lt%3Bi%26gt%3BEffects%20of%20Moral-Emotional%20Behavior%20and%20Intentionality%20on%20Mind%20Attribution%20and%20Evaluation%20of%20Social%20Robots%26lt%3B%5C%2Fi%26gt%3B.%20Open%20Science%20Framework.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.31219%5C%2Fosf.io%5C%2F6k487%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.31219%5C%2Fosf.io%5C%2F6k487%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22preprint%22%2C%22title%22%3A%22Effects%20of%20Moral-Emotional%20Behavior%20and%20Intentionality%20on%20Mind%20Attribution%20and%20Evaluation%20of%20Social%20Robots%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alexander%22%2C%22lastName%22%3A%22Leonhardt%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22Robots%20are%20generally%20not%20considered%20full%20moral%20agents%20and%20therefore%20not%20appropriate%20loci%20of%20moral%20responsibility%3B%20however%2C%20research%20suggests%20that%20people%20may%20attribute%20mental%20capacities%20associated%20with%20moral%20agency%20as%20well%20as%20moral%20responsibility%20to%20robots.%20We%20investigate%20the%20extent%20to%20which%20descriptions%20of%20social%20robots%20as%20minded%20agents%20or%20mechanical%20machines%20differentially%20impact%20moral%20judgments%20of%20robots%5Cu2019%20morally%20and%20emotionally%20relevant%20actions.%20In%20two%20experiments%20we%20considered%20cognitive%20and%20emotional%20aspects%20of%20moral%20judgments%3A%20mind%20attribution%20and%20moral%20evaluations%20as%20well%20as%20people%5Cu2019s%20emotional%20response%2C%20a%20key%20component%20in%20accounts%20of%20moral%20responsibility.%20Participants%20%28N%20%3D%2082%29%20read%20and%20subsequently%20rated%2042%20stories%20about%20robots%5Cu2019%20actions%2C%20which%20differed%20in%20level%20of%20intentionality%20and%20moral-emotional%20quality%20of%20information.%20Although%20minded%20as%20opposed%20to%20mechanical%20descriptions%20positively%20influenced%20mind%20attribution%20and%20attributed%20moral%20responsibility%2C%20participants%5Cu2019%20emotional%20response%20and%20moral%20evaluations%20were%20largely%20dominated%20by%20the%20moral-emotional%20content%20of%20information.%20In%20addition%2C%20the%20presentation%20of%20an%20image%20alongside%20information%20negatively%20affected%20the%20influence%20of%20minded%20descriptions%20of%20robots%20on%20mind%20attribution.%20Our%20findings%20demonstrate%20that%20robots%20are%20ascribed%20moral%20responsibility%20even%20though%20by%20current%20theoretical%20accounts%20they%20are%20not%20suitable%20moral%20agents.%20Robots%20that%20are%20described%20as%20minded%20are%20furthermore%20attributed%20greater%20agency%20and%20moral%20responsibility.%20We%20discuss%20the%20impact%20of%20our%20findings%20for%20theoretical%20discussions%20about%20the%20ethics%20of%20AI%20and%20robots.%22%2C%22genre%22%3A%22%22%2C%22repository%22%3A%22Open%20Science%20Framework%22%2C%22archiveID%22%3A%22%22%2C%22date%22%3A%222024-07-02%22%2C%22DOI%22%3A%2210.31219%5C%2Fosf.io%5C%2F6k487%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fosf.io%5C%2F6k487%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-22T11%3A58%3A36Z%22%7D%7D%2C%7B%22key%22%3A%22QKAHMER8%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Halawa%20et%20al.%22%2C%22parsedDate%22%3A%222024-06%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BHalawa%2C%20M.%2C%20Blume%2C%20F.%2C%20Bideau%2C%20P.%2C%20Maier%2C%20M.%2C%20Rahman%2C%20R.%20A.%2C%20%26amp%3B%20Hellwich%2C%20O.%20%282024%29.%20Multi-Task%20Multi-Modal%20Self-Supervised%20Learning%20for%20Facial%20Expression%20Recognition.%20%26lt%3Bi%26gt%3B2024%20IEEE%5C%2FCVF%20Conference%20on%20Computer%20Vision%20and%20Pattern%20Recognition%20Workshops%20%28CVPRW%29%26lt%3B%5C%2Fi%26gt%3B%2C%204604%26%23x2013%3B4614.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1109%5C%2FCVPRW63382.2024.00463%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1109%5C%2FCVPRW63382.2024.00463%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Multi-Task%20Multi-Modal%20Self-Supervised%20Learning%20for%20Facial%20Expression%20Recognition%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Marah%22%2C%22lastName%22%3A%22Halawa%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Florian%22%2C%22lastName%22%3A%22Blume%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Pia%22%2C%22lastName%22%3A%22Bideau%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%20Abdel%22%2C%22lastName%22%3A%22Rahman%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Olaf%22%2C%22lastName%22%3A%22Hellwich%22%7D%5D%2C%22abstractNote%22%3A%22Human%20communication%20is%20multi-modal%3B%20e.g.%2C%20face-to-face%20interaction%20involves%20auditory%20signals%20%28speech%29%20and%20visual%20signals%20%28face%20movements%20and%20hand%20gestures%29.%20Hence%2C%20it%20is%20essential%20to%20exploit%20multiple%20modalities%20when%20designing%20machine%20learning-based%20facial%20expression%20recognition%20systems.%20In%20addition%2C%20given%20the%20ever-growing%20quantities%20of%20video%20data%20that%20capture%20human%20facial%20expressions%2C%20such%20systems%20should%20utilize%20raw%20unlabeled%20videos%20without%20requiring%20expensive%20annotations.%20Therefore%2C%20in%20this%20work%2C%20we%20employ%20a%20multitask%20multi-modal%20self-supervised%20learning%20method%20for%20facial%20expression%20recognition%20from%20in-the-wild%20video%20data.%20Our%20model%20combines%20three%20self-supervised%20objective%20functions%3A%20First%2C%20a%20multi-modal%20contrastive%20loss%2C%20that%20pulls%20diverse%20data%20modalities%20of%20the%20same%20video%20together%20in%20the%20representation%20space.%20Second%2C%20a%20multi-modal%20clustering%20loss%20that%20preserves%20the%20semantic%20structure%20of%20input%20data%20in%20the%20representation%20space.%20Finally%2C%20a%20multi-modal%20data%20reconstruction%20loss.%20We%20conduct%20a%20comprehensive%20study%20on%20this%20multimodal%20multi-task%20self-supervised%20learning%20method%20on%20three%20facial%20expression%20recognition%20benchmarks.%20To%20that%20end%2C%20we%20examine%20the%20performance%20of%20learning%20through%20different%20combinations%20of%20self-supervised%20tasks%20on%20the%20facial%20expression%20recognition%20downstream%20task.%20Our%20model%20ConCluGen%20outperforms%20several%20multi-modal%20self-supervised%20and%20fully%20supervised%20baselines%20on%20the%20CMU-MOSEI%20dataset.%20Our%20results%20generally%20show%20that%20multi-modal%20self-supervision%20tasks%20offer%20large%20performance%20gains%20for%20challenging%20tasks%20such%20as%20facial%20expression%20recognition%2C%20while%20also%20reducing%20the%20amount%20of%20manual%20annotations%20required.%20We%20release%20our%20pre-trained%20models%20as%20well%20as%20source%20code%20publicly1.%22%2C%22proceedingsTitle%22%3A%222024%20IEEE%5C%2FCVF%20Conference%20on%20Computer%20Vision%20and%20Pattern%20Recognition%20Workshops%20%28CVPRW%29%22%2C%22conferenceName%22%3A%222024%20IEEE%5C%2FCVF%20Conference%20on%20Computer%20Vision%20and%20Pattern%20Recognition%20Workshops%20%28CVPRW%29%22%2C%22date%22%3A%222024-06%22%2C%22eventPlace%22%3A%22%22%2C%22DOI%22%3A%2210.1109%5C%2FCVPRW63382.2024.00463%22%2C%22ISBN%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fieeexplore.ieee.org%5C%2Fdocument%5C%2F10678641%22%2C%22ISSN%22%3A%222160-7516%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-22T12%3A01%3A10Z%22%7D%7D%2C%7B%22key%22%3A%22VPRB6ZME%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Maier%20and%20Abdel%20Rahman%22%2C%22parsedDate%22%3A%222024%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMaier%2C%20M.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282024%29.%20Transient%20and%20Long%26%23x2010%3BTerm%20Linguistic%20Influences%20on%20Visual%20Perception%3A%20Shifting%20Brain%20Dynamics%20With%20Memory%20Consolidation.%20%26lt%3Bi%26gt%3BLanguage%20Learning%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B74%26lt%3B%5C%2Fi%26gt%3B%28S1%29%2C%20157%26%23x2013%3B184.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1111%5C%2Flang.12631%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1111%5C%2Flang.12631%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Transient%20and%20Long%5Cu2010Term%20Linguistic%20Influences%20on%20Visual%20Perception%3A%20Shifting%20Brain%20Dynamics%20With%20Memory%20Consolidation%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22Abstract%5Cn%20%20%20%20%20%20%20%20%20%20%20%20Linguistic%20categories%20can%20impact%20visual%20perception.%20For%20instance%2C%20learning%20that%20two%20objects%20have%20different%20names%20can%20enhance%20their%20discriminability.%20Previous%20studies%20have%20identified%20a%20typical%20pattern%20of%20categorical%20perception%2C%20characterized%20by%20faster%20discrimination%20of%20stimuli%20from%20different%20categories%2C%20a%20neural%20mismatch%20response%20during%20early%20visual%20processing%20%28100%5Cu2013200%20ms%29%2C%20and%20effects%20restricted%20to%20the%20right%20visual%20field.%20However%2C%20it%20remains%20unclear%20whether%20language%20affects%20perception%20online%20or%20through%20long%5Cu2010term%20changes%20to%20mental%20representations%20in%20memory.%20To%20address%20this%2C%20we%20tested%20the%20impact%20of%20newly%20learned%20object%20categories%20with%20and%20without%20memory%20consolidation%20during%20sleep.%20We%20replicated%20the%20canonical%20pattern%20of%20categorical%20perception%20for%20categories%20that%20underwent%20consolidation.%20Without%20consolidation%2C%20linguistic%20categories%20still%20influenced%20early%20visual%20processing%20but%20with%20distinct%20neural%20dynamics.%20Therefore%2C%20we%20found%20evidence%20of%20both%20transient%20and%20long%5Cu2010term%20effects%20of%20language%20on%20perception%20and%20conclude%20that%20memory%20consolidation%20plays%20a%20crucial%20role%20in%20shaping%20how%20linguistic%20categories%20modulate%20perception.%5Cn%20%20%20%20%20%20%20%20%20%20%2C%20%5Cn%20%20%20%20%20%20%20%20%20%20%20%20%5Cn%20%20%20%20%20%20%20%20%20%20%20%20%20%20A%20one%5Cu2010page%5Cn%20%20%20%20%20%20%20%20%20%20%20%20%20%20Accessible%20Summary%5Cn%20%20%20%20%20%20%20%20%20%20%20%20%20%20of%20this%20article%20in%20nontechnical%20language%20is%20freely%20available%20in%20the%20%20online%20and%20at%5Cn%20%20%20%20%20%20%20%20%20%20%20%20%20%20https%3A%5C%2F%5C%2Foasis%5Cu2010database.org%5Cn%20%20%20%20%20%20%20%20%20%20%20%20%20%20.%22%2C%22date%22%3A%2206%5C%2F2024%22%2C%22section%22%3A%22%22%2C%22partNumber%22%3A%22%22%2C%22partTitle%22%3A%22%22%2C%22DOI%22%3A%2210.1111%5C%2Flang.12631%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fonlinelibrary.wiley.com%5C%2Fdoi%5C%2F10.1111%5C%2Flang.12631%22%2C%22PMID%22%3A%22%22%2C%22PMCID%22%3A%22%22%2C%22ISSN%22%3A%220023-8333%2C%201467-9922%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-22T11%3A58%3A30Z%22%7D%7D%2C%7B%22key%22%3A%22WJ6XRBKG%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Maier%20and%20Abdel%20Rahman%22%2C%22parsedDate%22%3A%222024%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMaier%2C%20M.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282024%29.%20%26lt%3Bi%26gt%3BThe%20neural%20dynamics%20of%20sudden%20insight%20in%20social%20perception%26lt%3B%5C%2Fi%26gt%3B%20%5BPoster%5D.%20Annual%20Meeting%20of%20the%20Cognitive%20Science%20Society.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fescholarship.org%5C%2Fuc%5C%2Fitem%5C%2F4tq27214%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fescholarship.org%5C%2Fuc%5C%2Fitem%5C%2F4tq27214%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22presentation%22%2C%22title%22%3A%22The%20neural%20dynamics%20of%20sudden%20insight%20in%20social%20perception%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22Inferring%20mental%20states%20from%20faces%20during%20social%20perception%20is%20sensitive%20to%20context%20and%20higher-level%20semantic%20information.%20This%20is%20vividly%20observed%20in%20captioned%20humor%2C%20like%20memes%2C%20where%20a%20single%20line%20can%20dramatically%20reshape%20scene%20perception%20and%20understanding.%20This%20EEG-study%20explores%20the%20real-time%20neural%20dynamics%20of%20these%20sudden%20insights%20in%20social%20perception.%20Across%20three%20experimental%20phases%20%28pre-insight%2C%20insight%2C%20post-insight%29%2C%2040%20participants%20viewed%20images%20of%20120%20scenes%20showing%20public%20figures.%20During%20the%20insight%20phase%2C%20humorous%20captions%20%28e.g.%2C%20%26quot%3Btrying%20to%20set%20somebody%20on%20fire%20with%20his%20mind%26quot%3B%29%20either%20matched%20or%20mismatched%20the%20following%20image%20%28e.g.%2C%20a%20politician%2C%20mid-speech%2C%20rubbing%20his%20temples%29.%20Comparing%20event-related%20potentials%20between%20trials%20with%20vs.%20without%20sudden%20insight%20revealed%20distinct%20changes%20in%20the%20N170%2C%20early%20posterior%20negativity%20%28EPN%29%2C%20and%20N400%20components%20from%20pre-insight%20to%20insight%20phase.%20These%20results%20link%20sudden%2C%20humorous%20insight%20in%20social%20perception%20to%20instant%20alterations%20in%20visual%20processing%2C%20fast%20affective%20responses%2C%20and%20higher-level%20semantic%20processing.%22%2C%22date%22%3A%222024%22%2C%22sessionTitle%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fescholarship.org%5C%2Fuc%5C%2Fitem%5C%2F4tq27214%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-17T07%3A45%3A48Z%22%7D%7D%2C%7B%22key%22%3A%22XGP66Q7E%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Baum%20et%20al.%22%2C%22parsedDate%22%3A%222024%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BBaum%2C%20J.%2C%20Eiserbeck%2C%20A.%2C%20Maier%2C%20M.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282024%29.%20%26lt%3Bi%26gt%3BThe%20evaluation%20of%20presumed%20deepfakes%20with%20different%20basic%20emotional%20expressions%20depends%20on%20valence%26lt%3B%5C%2Fi%26gt%3B%20%5BPoster%5D.%20Psychologie%20und%20Gehirn.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22presentation%22%2C%22title%22%3A%22The%20evaluation%20of%20presumed%20deepfakes%20with%20different%20basic%20emotional%20expressions%20depends%20on%20valence%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Julia%22%2C%22lastName%22%3A%22Baum%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Anna%22%2C%22lastName%22%3A%22Eiserbeck%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222024%22%2C%22sessionTitle%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-16T15%3A35%3A10Z%22%7D%7D%2C%7B%22key%22%3A%22IKUM44AZ%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Eiserbeck%20et%20al.%22%2C%22parsedDate%22%3A%222023-09-26%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BEiserbeck%2C%20A.%2C%20Maier%2C%20M.%2C%20Baum%2C%20J.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282023%29.%20Deepfake%20smiles%20matter%20less%26%23x2014%3Bthe%20psychological%20and%20neural%20impact%20of%20presumed%20AI-generated%20faces.%20%26lt%3Bi%26gt%3BScientific%20Reports%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B13%26lt%3B%5C%2Fi%26gt%3B%281%29%2C%2016111.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1038%5C%2Fs41598-023-42802-x%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1038%5C%2Fs41598-023-42802-x%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Deepfake%20smiles%20matter%20less%5Cu2014the%20psychological%20and%20neural%20impact%20of%20presumed%20AI-generated%20faces%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Anna%22%2C%22lastName%22%3A%22Eiserbeck%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Julia%22%2C%22lastName%22%3A%22Baum%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22Abstract%5Cn%20%20%20%20%20%20%20%20%20%20%20%20High-quality%20AI-generated%20portraits%20%28%5Cu201cdeepfakes%5Cu201d%29%20are%20becoming%20increasingly%20prevalent.%20Understanding%20the%20responses%20they%20evoke%20in%20perceivers%20is%20crucial%20in%20assessing%20their%20societal%20implications.%20Here%20we%20investigate%20the%20impact%20of%20the%20belief%20that%20depicted%20persons%20are%20real%20or%20deepfakes%20on%20psychological%20and%20neural%20measures%20of%20human%20face%20perception.%20Using%20EEG%2C%20we%20tracked%20participants%5Cu2019%20%28N%5Cu2009%3D%5Cu200930%29%20brain%20responses%20to%20real%20faces%20showing%20positive%2C%20neutral%2C%20and%20negative%20expressions%2C%20after%20being%20informed%20that%20they%20are%20either%20real%20or%20fake.%20Smiling%20faces%20marked%20as%20fake%20appeared%20less%20positive%2C%20as%20reflected%20in%20expression%20ratings%2C%20and%20induced%20slower%20evaluations.%20Whereas%20presumed%20real%20smiles%20elicited%20canonical%20emotion%20effects%20with%20differences%20relative%20to%20neutral%20faces%20in%20the%20P1%20and%20N170%20components%20%28markers%20of%20early%20visual%20perception%29%20and%20in%20the%20EPN%20component%20%28indicative%20of%20reflexive%20emotional%20processing%29%2C%20presumed%20deepfake%20smiles%20showed%20none%20of%20these%20effects.%20Additionally%2C%20only%20smiles%20presumed%20as%20fake%20showed%20enhanced%20LPP%20activity%20compared%20to%20neutral%20faces%2C%20suggesting%20more%20effortful%20evaluation.%20Negative%20expressions%20induced%20typical%20emotion%20effects%2C%20whether%20considered%20real%20or%20fake.%20Our%20findings%20demonstrate%20a%20dampening%20effect%20on%20perceptual%2C%20emotional%2C%20and%20evaluative%20processing%20of%20presumed%20deepfake%20smiles%2C%20but%20not%20angry%20expressions%2C%20adding%20new%20specificity%20to%20the%20debate%20on%20the%20societal%20impact%20of%20AI-generated%20content.%22%2C%22date%22%3A%222023-09-26%22%2C%22section%22%3A%22%22%2C%22partNumber%22%3A%22%22%2C%22partTitle%22%3A%22%22%2C%22DOI%22%3A%2210.1038%5C%2Fs41598-023-42802-x%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fwww.nature.com%5C%2Farticles%5C%2Fs41598-023-42802-x%22%2C%22PMID%22%3A%22%22%2C%22PMCID%22%3A%22%22%2C%22ISSN%22%3A%222045-2322%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-22T11%3A58%3A03Z%22%7D%7D%2C%7B%22key%22%3A%22ZYR93ZF5%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Eiserbeck%20et%20al.%22%2C%22parsedDate%22%3A%222023%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BEiserbeck%2C%20A.%2C%20Maier%2C%20M.%2C%20Baum%2C%20J.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282023%29.%20%26lt%3Bi%26gt%3BWhen%20the%20philosophical%20zombie%20smiles%20at%20you%20%26%23x2013%3B%20believing%20a%20face%20to%20be%20computer-generated%20affects%20perception%20and%20emotional%20processing%26lt%3B%5C%2Fi%26gt%3B%20%5BPoster%5D.%2026th%20meeting%20of%20the%20Association%20for%20the%20Scientific%20Study%20of%20Consciousness%20%28ASSC26%29.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22presentation%22%2C%22title%22%3A%22When%20the%20philosophical%20zombie%20smiles%20at%20you%20%5Cu2013%20believing%20a%20face%20to%20be%20computer-generated%20affects%20perception%20and%20emotional%20processing%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Anna%22%2C%22lastName%22%3A%22Eiserbeck%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Julia%22%2C%22lastName%22%3A%22Baum%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222023%22%2C%22sessionTitle%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-22T10%3A44%3A39Z%22%7D%7D%2C%7B%22key%22%3A%22H4N5F4ZS%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Maier%20et%20al.%22%2C%22parsedDate%22%3A%222022-09%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMaier%2C%20M.%2C%20Leonhardt%2C%20A.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282022%2C%20September%29.%20Bad%20robots%3F%20Humans%20rapidly%20attribute%20mental%20states%20during%20the%20perception%20of%20robot%20faces.%20%26lt%3Bi%26gt%3BProceedings%20of%20KogWis2022%26lt%3B%5C%2Fi%26gt%3B.%205th%20Biannual%20Conference%20of%20the%20German%20Society%20for%20Cognitive%20Science%2C%20Albert-Ludwigs-Universit%26%23xE4%3Bt%20Freiburg%2C%20Freiburg%2C%20Germany.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Bad%20robots%3F%20Humans%20rapidly%20attribute%20mental%20states%20during%20the%20perception%20of%20robot%20faces%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Alexander%22%2C%22lastName%22%3A%22Leonhardt%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22proceedingsTitle%22%3A%22Proceedings%20of%20KogWis2022%22%2C%22conferenceName%22%3A%225th%20Biannual%20Conference%20of%20the%20German%20Society%20for%20Cognitive%20Science%22%2C%22date%22%3A%222022-09%22%2C%22eventPlace%22%3A%22Albert-Ludwigs-Universit%5Cu00e4t%20Freiburg%2C%20Freiburg%2C%20Germany.%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-09T10%3A18%3A47Z%22%7D%7D%2C%7B%22key%22%3A%22MQW2YAL9%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Maier%20et%20al.%22%2C%22parsedDate%22%3A%222022%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMaier%2C%20M.%2C%20Blume%2C%20F.%2C%20Bideau%2C%20P.%2C%20Hellwich%2C%20O.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282022%29.%20Knowledge-augmented%20face%20perception%3A%20Prospects%20for%20the%20Bayesian%20brain-framework%20to%20align%20AI%20and%20human%20vision.%20%26lt%3Bi%26gt%3BConsciousness%20and%20Cognition%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B101%26lt%3B%5C%2Fi%26gt%3B%2C%20103301.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.concog.2022.103301%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1016%5C%2Fj.concog.2022.103301%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Knowledge-augmented%20face%20perception%3A%20Prospects%20for%20the%20Bayesian%20brain-framework%20to%20align%20AI%20and%20human%20vision%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Florian%22%2C%22lastName%22%3A%22Blume%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Pia%22%2C%22lastName%22%3A%22Bideau%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Olaf%22%2C%22lastName%22%3A%22Hellwich%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%2205%5C%2F2022%22%2C%22section%22%3A%22%22%2C%22partNumber%22%3A%22%22%2C%22partTitle%22%3A%22%22%2C%22DOI%22%3A%2210.1016%5C%2Fj.concog.2022.103301%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Flinkinghub.elsevier.com%5C%2Fretrieve%5C%2Fpii%5C%2FS1053810022000332%22%2C%22PMID%22%3A%22%22%2C%22PMCID%22%3A%22%22%2C%22ISSN%22%3A%2210538100%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-29T10%3A40%3A27Z%22%7D%7D%2C%7B%22key%22%3A%22K4EIHCEF%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Maier%20et%20al.%22%2C%22parsedDate%22%3A%222022%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMaier%2C%20M.%2C%20Fr%26%23xF6%3Bmer%2C%20R.%2C%20Rost%2C%20J.%2C%20Sommer%2C%20W.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282022%29.%20%26lt%3Bi%26gt%3BLinguistic%20and%20semantic%20influences%20on%20early%20vision%3A%20evidence%20from%20object%20perception%20and%20mental%20imagery%26lt%3B%5C%2Fi%26gt%3B.%20Cognitive%20Neuroscience%20of%20Language%20Embodiment%20and%20Relativity.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22conferencePaper%22%2C%22title%22%3A%22Linguistic%20and%20semantic%20influences%20on%20early%20vision%3A%20evidence%20from%20object%20perception%20and%20mental%20imagery%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Romy%22%2C%22lastName%22%3A%22Fr%5Cu00f6mer%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Johannes%22%2C%22lastName%22%3A%22Rost%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Werner%22%2C%22lastName%22%3A%22Sommer%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22proceedingsTitle%22%3A%22%22%2C%22conferenceName%22%3A%22Cognitive%20Neuroscience%20of%20Language%20Embodiment%20and%20Relativity%22%2C%22date%22%3A%222022%22%2C%22eventPlace%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22ISBN%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-09T10%3A37%3A48Z%22%7D%7D%2C%7B%22key%22%3A%22PU7YN9TT%22%2C%22library%22%3A%7B%22id%22%3A6984777%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Leonhardt%20et%20al.%22%2C%22parsedDate%22%3A%222021%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BLeonhardt%2C%20A.%2C%20Maier%2C%20M.%2C%20%26amp%3B%20Abdel%20Rahman%2C%20R.%20%282021%29.%20%26lt%3Bi%26gt%3BThe%20impact%20of%20affective%20knowledge%20on%20the%20perception%20and%20evaluation%20of%20robot%20faces%26lt%3B%5C%2Fi%26gt%3B%20%5BPoster%5D.%205th%20Virtual%20Social%20Interactions%20%28VSI%29%20Conference.%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22presentation%22%2C%22title%22%3A%22The%20impact%20of%20affective%20knowledge%20on%20the%20perception%20and%20evaluation%20of%20robot%20faces%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Alexander%22%2C%22lastName%22%3A%22Leonhardt%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Martin%22%2C%22lastName%22%3A%22Maier%22%7D%2C%7B%22creatorType%22%3A%22presenter%22%2C%22firstName%22%3A%22Rasha%22%2C%22lastName%22%3A%22Abdel%20Rahman%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222021%22%2C%22sessionTitle%22%3A%22%22%2C%22DOI%22%3A%22%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22%22%2C%22language%22%3A%22%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222026-06-04T15%3A27%3A56Z%22%7D%7D%5D%7D
Maier, M., Leonhardt, A., Blume, F., Bideau, P., Hellwich, O., & Abdel Rahman, R. (2025). Neural dynamics of mental state attribution to social robot faces. Social Cognitive and Affective Neuroscience, 20(1), nsaf027. https://doi.org/10.1093/scan/nsaf027
Blume, F., Qu, R., Bideau, P., Maier, M., Rahman, R. A., & Hellwich, O. (2025). How Do You Perceive My Face? Recognizing Facial Expressions in Multi-modal Context by Modeling Mental Representations. In D. Cremers, Z. Lähner, M. Moeller, M. Nießner, B. Ommer, & R. Triebel (Eds.), Pattern Recognition (pp. 20–36). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-85187-2_2
Leonhardt, A., Maier, M., & Abdel Rahman, R. (2024). Effects of Moral-Emotional Behavior and Intentionality on Mind Attribution and Evaluation of Social Robots. Open Science Framework. https://doi.org/10.31219/osf.io/6k487
Halawa, M., Blume, F., Bideau, P., Maier, M., Rahman, R. A., & Hellwich, O. (2024). Multi-Task Multi-Modal Self-Supervised Learning for Facial Expression Recognition. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 4604–4614. https://doi.org/10.1109/CVPRW63382.2024.00463
Maier, M., & Abdel Rahman, R. (2024). Transient and Long‐Term Linguistic Influences on Visual Perception: Shifting Brain Dynamics With Memory Consolidation. Language Learning, 74(S1), 157–184. https://doi.org/10.1111/lang.12631
Maier, M., & Abdel Rahman, R. (2024). The neural dynamics of sudden insight in social perception [Poster]. Annual Meeting of the Cognitive Science Society. https://escholarship.org/uc/item/4tq27214
Baum, J., Eiserbeck, A., Maier, M., & Abdel Rahman, R. (2024). The evaluation of presumed deepfakes with different basic emotional expressions depends on valence [Poster]. Psychologie und Gehirn.
Eiserbeck, A., Maier, M., Baum, J., & Abdel Rahman, R. (2023). Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces. Scientific Reports, 13(1), 16111. https://doi.org/10.1038/s41598-023-42802-x
Eiserbeck, A., Maier, M., Baum, J., & Abdel Rahman, R. (2023). When the philosophical zombie smiles at you – believing a face to be computer-generated affects perception and emotional processing [Poster]. 26th meeting of the Association for the Scientific Study of Consciousness (ASSC26).
Maier, M., Leonhardt, A., & Abdel Rahman, R. (2022, September). Bad robots? Humans rapidly attribute mental states during the perception of robot faces. Proceedings of KogWis2022. 5th Biannual Conference of the German Society for Cognitive Science, Albert-Ludwigs-Universität Freiburg, Freiburg, Germany.
Maier, M., Blume, F., Bideau, P., Hellwich, O., & Abdel Rahman, R. (2022). Knowledge-augmented face perception: Prospects for the Bayesian brain-framework to align AI and human vision. Consciousness and Cognition, 101, 103301. https://doi.org/10.1016/j.concog.2022.103301
Maier, M., Frömer, R., Rost, J., Sommer, W., & Abdel Rahman, R. (2022). Linguistic and semantic influences on early vision: evidence from object perception and mental imagery. Cognitive Neuroscience of Language Embodiment and Relativity.
Leonhardt, A., Maier, M., & Abdel Rahman, R. (2021). The impact of affective knowledge on the perception and evaluation of robot faces [Poster]. 5th Virtual Social Interactions (VSI) Conference.
For the Public -
Science of Intelligence Fair 2023
Der Tagesspiegel – December 2023 - Deep Fakes, deep feelings? Was KI-generierte Bilder in Menschen auslösen
