Introduction: Cognition is a term referring to the mental processes involved in gaining knowledge and comprehension. Sexual dimorphism in human brain anatomy refers to the differences between men's and women's brains in terms of size, structure, and function, in response to gonadal hormones secreted early in development. In this mini-review, we summarize and interpret the current status of sex differences in terms of cognitive function. Search Method: The articles and text books about brain development and neurophysiology of cognition are reviewed. The sex hormones organizational and activational effects on the human brain and their interactions with the neurotransmitter systems are discussed which have a far-reaching impact, with both behavioral consequences and structural as well as functional brain modulation. Results: There are no significant sex differences in general intelligence, although ability in particular types of intelligence do appear to vary slightly on average. However, biological and genetic differences in combination with environment and culture have resulted in cognitive differences among males and females. Women’s reading comprehension and writing ability consistently exceed that of men, on average. Women outperform men in tests of fine-motor coordination and perceptual speed. Women are more adept at retrieving information from long-term memory. Men, on average, can more easily juggle items in working memory. Conclusions: There are some relatively strong but also many moderate or even weak sex differences in terms of brain anatomy and brain function. These differences are not large enough to support a clear sexual dimorphism. Thus, there is no strong evidence available supporting the existence of a typical “female” or “male” brain. Most interestingly, there is currently a lack of a direct and strong correlation between these neuroscientific findings and real-life behavior as well as cognition.