Show summary
Individual differences tint our perception of reality. Our previous work showed certain personality traits influence how the brain responds to human voices. Recently, we found the brain responds differently to voices generated by artificial intelligence (AI) compared to human voices, despite challenges in perceptual discrimination. This study investigates whether social traits further influence differential neural processing of AI and human voices. 61 participants (40 females, mean age = 31.93, SD = 7.75) listened to vocal emotional pseudo-speech expressions (neutral, angry, fear, happy, pleasure) from both AI-generated and human sources. The protocol included an fMRI study with a classification task, followed by a perceptual task, as well as personality trait assessments. Traits related to social and emotional cognition (Callous-Unemotional [CU], Alexithymia [ALX], Affective Empathy [AE], and Social Information Processing [SIP]) were selected. Correlations between the traits and outcome measures were performed (p <0.05, FDR corrected). ALX correlated with a tendency to classify voices as AI (r = -0.26) while SIP correlated with a tendency to classify voices as human (r = 0.3). AE and SIP were positively correlated with perceived naturalness of human voices (r = 0.32 and r = 0.27). Conversely, ALX and CU were negatively associated with perceived naturalness of human voices (r = -0.28 and r = -0.28). CU negatively correlated with perceived naturalness of AI voices (r = -0.28), whereas AE positively correlated with it (r = 0.29). Our fMRI multiple regression analysis included the traits with age, sex, and handedness as covariates of no interest (p < 0.005, k > 21). Our findings reveal distinct neural patterns: in response to AI voices (versus human), AE was associated with increased activity in the left angular gyrus, left inferior frontal gyrus-triangular part, left hippocampus, right nucleus accumbens and bilateral amygdalae. SIP was associated with increased activity in the right dorsolateral superior frontal gyrus. In response to human voices (versus AI), AE was associated with increased activity in the left precentral gyrus, while CU was associated with increased activity in the bilateral precentral gyri. SIP was associated with increased activity in the right cuneus, right superior temporal gyrus, right fusiform gyrus, left middle cingulate and paracingulate gyri, left insula, and bilateral middle occipital gyri. When processing AI voices, AE may relate to emotional engagement and SIP to more cognitive effort. In the context of human voices, AE and CU may differentially engage the mirror neuron system, while SIP may engage multimodal processing.