Early neuroimaging studies using Cyberball suggested that social rejection activated the pain matrix, as identified in studies of physical pain. However, these early studies were characterized by small sample sizes. Our statistical multi-level kernel density analysis (MKDA) of Cyberball neuroimaging studies with 244 participants fails to support the claim that social rejection operates on the same pain matrix as nociceptive stimuli, questioning whether social pain is more figurative or literal. We also performed an MKDA of the neuroimaging studies of reliving a romantic rejection to test whether the pain matrix was activated if the rejection were more meaningful. Results again failed to support the notion that rejection activates the neural matrix identified in studies of physical pain. Reliving an unwanted rejection by a romantic partner was significantly characterized by activation within and beyond the “Cyberball” brain network, suggesting that the neural correlates of social pain are more complex than previously thought.