Background: Impaired dermatological health-related quality of life (HRQoL) has been observed in hospital-based studies, but little is known on a population-based level. Objective: To investigate self-reported dermatological HRQoL in the general population. Methods: Hidradenitis suppurativa, psoriasis, pimples, hand rash or atopic eczema were identified using questionnaires in a 15,177 person population sample. A nested case-control study of 180 cases and 259 controls was made using the Dermatology Life Quality Index (DLQI), Skindex-29 and EQ-5D. Results: Cases had higher scores in DLQI and Skindex-29 and a lower score in EQ-5D, suggesting lower HRQoL. Adjusting for age and sex, the differences in Skindex-29 and DLQI were significant (p < 0.001). Conclusions: Persons with self-reported skin morbidity had lower HRQoL than the general population. The impairment is not as significant as in studies of hospital-based cases, but considering the high prevalence of skin diseases it may still represent a significant burden of disease on society in aggregate.