We have developed object shape and texture models to segment human brain structures from MR images. Our approach can separate the left and right hemispheres, and cerebellum without the brainstem, working for normal and abnormal brains. We are currently extending the method to detect brain abnormalities and define abnormal brain asymmetry in association with the study of brain diseases.