If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
The purpose of this study was to examine the validity of self-report diabetes according to sociodemographic characteristics in participants of Ravansar Non-Communicable Diseases (RaNCD) cohort study.
Methods
The study population included 10182 adults (35–65 years old) participating in RaNCD. The ‘gold standard’ for diagnosis of diabetes mellitus was taken as a history of relevant medicine use and/or measurement of fasting blood glucose indicating diabetes. Self-report data collected before the clinical examinations through interviews by well-trained staff. Sensitivity, specificity, and positive and negative predictive values were used to estimate the accuracy of self-report in diabetes.
Results
Of the 10182 individuals invited to participate in the RaNCD, 96 people were not willing to participate in the study (participation rate = 99.06%). The prevalence of diabetes by self-report and gold standard was 10.04% and 8.19% respectively. Among those who said they had diabetes, 389 (38.78%) did not have diabetes. Self-reported diabetes had sensitivity, specificity, positive and negative predictive values of 75.0%, 95.8%, 61.2% and 97.7%, respectively. Being female, aging, smoking, and having a family history of diabetes increased the chance of false positive; and being male, having a family history of diabetes, aging, and increasing BMI increased the chance of false negative.
Conclusions
Although the overall validity of self-report in diabetes seems to be acceptable in the study population with a correction factor of 25.3%, it should be noted that the is influenced by age, gender, and family history of diabetes.
According to previous studies, diabetes accounts for 1.3 million deaths in the world and about 56 million total Disability-Adjusted Life Years (DALY). Among WHO's six regional offices around the world, Eastern Mediterranean is known to be the one with the highest prevalence of diabetes. The prevalence of diabetes in Iran is estimated to be 6.1 to 9.8%.
Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990–2013: quantifying the epidemiological transition.
Urban-rural differences in the prevalence of self-reported diabetes and its risk factors: the WHO STEPS Iranian noncommunicable disease risk factor surveillance in 2011.
Considering the growing trend of this disease in the world and its high economic burden on societies, its detection is very important as one of the most important health issues in many societies.
Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990–2013: quantifying the epidemiological transition.
There are different methods for assessment of prevalence and incidence of diabetes in populations. While medication measurement plus checking blood sugar is a standard method, use of self-report as an easy method, is used frequently to diagnose diabetes and determine its prevalence.
Previous studies have shown that gold standards for the detection of a disease are sometimes difficult, and due to their cost and lack of easy access to all required documents are often not used in large population-based studies. Therefore, self-reporting is sometimes used in population-based epidemiological studies because of its low cost and simplicity to collect information along with gold standards such as medication records and clinical measurements.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
However, detecting the prevalence of diabetes may not be accurate through self-reporting and the validity of self-reporting may vary in different groups and it might be influenced by the recall bias and wish bias of the participants. Therefore, the accuracy and validity of self-reporting are usually assessed in studies around the world.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
A review of studies conducted on the agreement between self-report on diabetes incidence and medication records shows different results. Comparing the results of various studies, we should notice the difference in methodology and demographics of the subjects in different studies.
Although population-based studies have confirmed the validity of self-report diabetes, they still emphasize that the self-report method is influenced by factors such as social rejection and the underlying diseases in different ethnic groups. Therefore, self-report studies should be cautiously analyzed, and the validity of self-report need to be measured.
The objective of validation studies is to measure the level of agreement and the accuracy of self-reporting data with gold standards including diagnosis obtained through history of relevant medicine use (insulin and/or oral hypoglycemic agents) and measurements of blood markers (fasting blood glucose).
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
Considering the contradictions in the results of previous studies and the lack of similar studies, this study aimed to investigate factors associated with the validity of self-report in prevalent cases of diabetes in Ravansar Non-Communicable Diseases (RaNCD) cohort study.
2. Method
2.1 Study population
The RaNCD cohort study is part of the PERSIAN (Prospective Epidemiological Research Studies in IrAN) Cohort, focused on permanent residents of Ravansar aged 35-65 years. In the PERSIAN cohort, all 18 cohort sites used the same questionnaire containing different sections: general information (demographic, socioeconomic status, life style factors, occupational history, mobile use and physical activity), medical section (past medical history, past and present medicine use, family medical history, obstetric and gynecology history, oral health and personal habit) and nutrition questionnaire (food frequency questionnaire, dietary habit, water use and supplement). The details of the study design and rationale for conducting the PERSIAN cohort have been presented elsewhere.
In order to collect information, participants were invited to the study site. After registration of participants, the anthropometric measures assessed by bioelectric impedance. To measure weight, we used a Bio Impedance Analyzer BIA (InBody 770 BIOSPACE, KOREA). Height was measured with 0.1 cm accuracy with stadiometer. Body mass index (BMI) was calculated as weight in kilograms divided by height in meters squared. Age was determined based on the age of the person's birth certificate and the actual age was not standard. The criteria for determining the level of education were the last degree. Blood pressure was measured using Aneroid Blood Pressure Monitor after 15 min of rest with two measurements of right arm and two measurement of left arm. Average of four measurements considered as mean of systolic and diastolic blood pressure. This study considered people with a systolic blood pressure of 139 or higher and/or a diastolic blood pressure of 89 or higher and/or those with a history of using antihypertensive drugs as hypertensive. Smoking status evaluated by asking about smoking of at least 100 cigarettes throughout the life.
Family history was studied in first and second degree relatives A second-degree relative (SDR) is someone who shares 25% of a person's genes. It includes uncles, aunts, nephews, nieces, grandparents, grandchildren, half-siblings, and double cousins.
For the purpose of this study gold standard for diagnosis of diabetes mellitus defined as positive history of relevant medicine use (insulin and/or oral hypoglycemic agents) and/or a fasting blood glucose indicating diabetes. Fasting blood sugar (FBS) >=126 mg per dL [7 mmol per L] defined as diabetes mellitus. we used wealth index as proxy for economic status.
Wealth index was generated using principal component analysis (PCA) on data of durable goods, housing characteristics and other amenities.
2.3 Statistical analysis and calculations
Validity was assessed using sensitivity, (true positives/[true positives plus false negatives]), specificity (true negatives/[true negatives plus false positives]), positive predictive value (true positives/[true positives plus false positives]), negative predictive value (true negatives/[true negatives plus false negatives]). Positive likelihood ratio (LR+) (sensitivity/[1-specificity]), and negative likelihood ratio (LR-) ([1-sensitivity]/specificity) was calculated. For all these values, 95% confidence intervals calculated using standard methods for proportions.
Univariable and multivariable logistic regression were used to examine the discordance between self-report and gold standard. A two-sided alpha level of 0.05 was considered statistically significant. All analyses were carried out using Stata software (version 14.1) (Stata Corp, College Station, TX, USA).
2.4 Ethical statement
The present study was conducted according to the Helsinki Declaration. The study was approved by the ethics committee of the vice chancellery of research and technology, Kermanshah University of Medical Sciences (KUMS.REC.1394.315) and the written informed consent was obtained from each participant after explaining the purpose of research.
3. Results
Of the 10182 individuals invited to participate in the RaNCD, 96 people were not willing to participate in the study (participation rate = 99.06%) and there were no self-reporting and measuring FBS for 85 individuals. Of the 10001 remaining participants, 4742 (47.42%) were male and 5259 (52.58%) were female. The mean age of the male participants was 46.99 ± 8.2 and the mean age of the female participants was 47.49 ± 8.4 years. As Table 1 shows, 4607 (46.07%) of the participants in the RaNCD were illiterate and 9090 (90.19%) were married (Table 1). The prevalence of self-report diabetes and diabetes measured by gold standard method was 1003(10.04%) and 819(8.19%) respectively.
Table 1Demographic characteristic of participant in RaNCD by sex.
From total of those with high FBS and/or those who received treatment, 205 (25.03%) did not know about their diabetes, respectively. From total of 819 participants with confirmed diabetes 465(56.77%) cases were under treatment. Among people taking medicine, 310 (37.85%) did not adequately control their diabetes (they had FBS>=126 mg/dl). Among those who said they had diabetes (1003 people), 389 (38.78%) did not have confirmed diabetes(Fig. 1).
Fig. 1Frequency of self-report diabetes and diabetes measured by gold standard(treatment –high FBS).
The accuracy of self-reported diabetes was 94.05%. Overall, self-reported diabetes had sensitivity, specificity, positive and negative predictive values of 75.0%, 95.8%, 61.2%, and 97.7%, respectively. The agreement rate based on the Kappa test was 64.0% (Table 2).
Table 2Sensitivity and specificity of self-reported of DM in RaNCD.
Investigation of the factors affecting discordance at the multivariable level suggested that increasing age, higher BMI and having family history of diabetes plus smoking increased the overall discordance. However higher education decrease the likelihood of total discordance. Smokers, females, older people and those who had family history of diabetes were more likely to report diabetes without confirmation by gold standard (false positives). While for false-negative report of diabetes, family history of diabetes, older age and higher BMI increased the likelihood, women were both less likely wrongly report they did not have diabetes and high likely to wrongly report they did have diabetes (Table 3).
Table 3Univariable and multivariable analyses of factors affecting discordance between self-reported diabetes with gold standard in RaNCD.
Variables
Discordance/N (%)
Discordance self-reported DM
False positive self-reported DM
False negative self-reported DM
Crude OR(95%CI)
Adjusted OR(95%CI)
Crude OR(95%CI)
Adjusted OR(95%CI)
Crude OR(95%CI)
Adjusted OR(95%CI)
Gender (N = 10001)
Male
241/4742(5.08)
1
1
1
1
1
Female
353/5259(6.71)
1.34(1.35_1.59)
2.00(1.61_2.48)
1.97(1.58_2.44)
0.75(0.57_1.01)
0.53(0.40_0.72)
Age group (year) (N = 10001)
35–40
78/2639(2.96)
1
1
1
1
1
1
41–45
107/2098(5.10)
1.76(1.31_2.47)
1.70(1.26_2.30)
1.49(1.04_2.14)
1.49(1.04_2.14)
2.52(1.52_4.18)
2.49(1.49_4.17)
46–50
130/1763(7.37)
2.61(1.96_3.48)
2.34(1.74_3.16)
2.54(1.81_3.57)
2.57(1.83_3.61)
2.86(1.71_4.77)
2.81(1.66_4.73)
51–55
102/1432(7.12)
2.52(1.86_3.40)
2.18(1.58_2.99)
2.27(1.58_3.26)
2.27(1.58_3.27)
3.18(1.89_5.37)
3.19(1.87_5.45)
56–60
104/1311(7.93)
2.82(2.09_3.82)
2.29(1.64_3.18)
2.49(1.73_3.59)
2.47(1.72_3.56)
3.22(1.90_5.48)
3.60(2.09_6.18)
61–65
73/758(9.63)
3.46(2.51_4.86)
3.02(2.11_4.32)
3.61(2.46_3.29)
3.38(2.30_4.97)
3.25(1.77_5.96)
4.00(2.16_7.41)
Marital status (N = 10001)
Single
58/981(5.91)
1
1
1
Married
536/9020(5.94)
1.00(0.76_1.32)
0.89(0.64_1.22)
1.28(0.76_2.14)
Education (N = 10001)
Illiterate
360/4607(7.81)
1
1
1
1
Primary
118/2610(4.52)
0.55(0.45_0.69)
0.68(0.45_0.85)
0.50(0.39_0.65)
0.66(0.46_0.93)
Lower secondary
53/1059(5.00)
0.62(0.46_0.83)
0.85(0.62_1.17)
0.59(0.41_0.84)
0.65(0.39_1.08)
Higher secondary
37/966(3.83)
0.46(0.33_0.66)
0.67(0.47_0.97)
0.41(0.26_0.63)
0.59(0.34_1.02)
Academic
26/759(3.43)
0.41(0.27_0.62)
0.52(0.34_0.81)
0.31(0.18_0.54)
0.54(0.29_1.02)
BMI (N = 9927)
<24.9
123/2910(4.23)
1
1
1
1
1
25.0–29.9
252/4311(5.85)
1.40(1.12_1.75)
1.35(1.08_1.68)
1.15(0.90_1.48)
2.07(1.31_3.26)
2.20(1.39_3.48)
30.0–34.9
174/2124(8.19)
2.02(1.59_2.56)
1.90(1.49_2.41)
1.37(1.03_1.81)
4.44(2.82_7.00)
5.16(3.24_8.21)
>35
39/582(6.70)
1.62(1.22_2.36)
1.63(1.13_2.35)
1.04(1.65_1.69)
4.52(2.53_8.01)
5.87(3.22_10.67)
Smoke Cigarette (N = 9970)
No
456/7976(5.72)
1
1
1
1
1
Yes
136/1994(6.82)
1.20(0.99_1.47)
1.22(0.99_1.50)
1.01(0.79_1.30)
1.38(1.02_1.80)
1.50(1.09_2.05)
Place (N = 10001)
Urban
349/5910(5.91)
1
1
1
Rural
245/4091(5.99)
1.00(0.85_1.18)
1.14(0.93_1.40)
0.75(0.56_1.01)
Economic status (N = 9946)
Poor
173/2740(6.31)
1
1
1
Moderate
144/2240(6.43)
1.02(0.81_1.28)
1.02(0.78_1.34)
1.02(0.68_1.52)
Rich
272/4966(5.48)
0.85(0.71_1.04)
0.78(0.62_0.99)
1.00(0.71_1.39)
Family history of DM (N = 9976)
No
355/6900(5.15)
1
1
1
1
1
FDR
193/2342(8.24)
1.68(1.39_2.03)
1.68(1.39_2.03)
1.74(1.40_2.16)
1.79(1.43_2.25)
1.43(1.05_1.94)
1.42(1.03_1.95)
SDR
46/734(6.27)
1.27(0.93_1.72)
1.27(0.93_1.72)
1.48(1.04_2.10)
1.43(1.00_2.05)
0.96(0.56_1.69)
0.96(0.54_1.69)
HTN (N = 9988)
No
440/8212(5.36)
1
1
1
Yes
154/1776(8.67)
1.67(1.38_2.03)
1.59(1.26_2.06)
1.65(1.20_2.26)
*the reference category is “those whose self-report data matched clinical data that they are diabetes.
In population-based epidemiological studies, either self-report or clinical gold standards, is a common tool for assessing the prevalence and incidence of chronic diseases.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
The main objective of this study was to assess the effect of sociodemographic factors on validity of self-report diabetes using data from a large population based data in Iran. In the present study, although, the participants’ self-report on diabetes had a sensitivity of 75.0%, specificity of 95.8%, positive predictive value of 60% and negative predictive value of 97.7%, such values were largely dependent to sociodemographic variables. In our study, near 43% of all participants with diabetes received no treatment (354 from total of 819). Such findings are in line with previous reports and provide an update figure from validation of self-report of diabetes in Iran.
The results revealed that although the overall agreement between the participants' self-report responses and gold standards was acceptable, it largely depends on sociodemographic variables. Our results are consistent with the results of similar studies reporting that self-report in diabetes is more accurate than self-report in other chronic diseases.
This finding can be justified in that the accuracy of self-report is more likely to be confirmed in diseases with clearer and more specific diagnostic criteria (such as diabetes) and those with acute onset.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
However, all such studies reported that self-report is highly influnenced by sociodemographic factors (7, 16, 17)
For example, the results of a population-based study by Goldman et al. to validate self-report in diabetes and hypertension in 2003 also showed that self-report provide an acceptable estimate of the prevalence of diabetes, but varies with sociodemographic factors such as age and education.
Moderate sensitivity (75.0%) versus high specificity (95.8%) of self-report in this study was in line with the results of similar studies of validation of self-report in diabetes.
While older results from Iran reported a lower sensitivity (61.5%) in 2003 and 2004 (2), someone predict to have a higher sensitivity for those recent roports. Higher awareness and better care provided by health care system are two important factors affecting such increase in accuracy of self-report diabetes. This moderate sensitivity versus high specificity and underestimation of diabetes prevalence can be attributed to the characteristics of study population (age structure, sex, education and SES), as well as the criteria for the definition of gold standard for diabetes, which might be different in each study.
The agreement rate between self-report in diabetes and the gold standards was moderate (Kappa coefficient = 0.64), which is in line with the results of similar studies. Diabetes is one of the chronic diseases with a moderate Kappa coefficient of agreement for self-report in similar studies ranging from 0.6 to 0.9.
For example, a population-based study in Canada and Spain on self-report in diabetes reported a Kappa coefficient of agreement 0.81 and 0.78, respectively (9 and 20). Overall, in similar population-based studies, self-report in diabetes has a moderate sensitivity, high specificity and a moderate Kappa.
In the multivariable analysis, demographic variables including age, sex, smoking, BMI, and family history of diabetes were related to discordance after adjusting other factors related to self-report. Similar to the results from elsewhere, our results revealed false positive and false negative rates increased by age (9). This may reflect a recall bias (due to depression and other age-related disabilities) or actual unawareness about diabetes due to the failure to undergo blood glucose testing.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
In our study, self-report of diabetes among women were more likely to have a discordance with gold standard. They had also more false positives and less false negatives compared with men, which can be attributed to better self-care and more and timely use of health services among women.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
In line with these findings, studies from elsewhere reported women had better dietary self-care behaviours about diabetes, for example they were more likely than men to count carbohydrates and reduce their consumption of dietary fat.
Thus women may pay more scrupulous attention to diabetes. At the level of multivariable analysis and by adjusting other factors affecting discordance, the increase in BMI increased the likelihood of false negative rate, but no relationship was observed between BMI and false positive rate of self-reported diabetes. Huerta et al. (2009) reported that likelihood of positive self-reports of diabetes increased with obesity.
In fact, obesity is probably the most important factor in the development of insulin resistance. People who are overweight or obese have added pressure on their body's ability to use insulin to properly control blood sugar levels therefore they are more likely to develop diabetes. In addition, overweight and obesity are associated with poor health and such people may also be careless about obesity related risks.
The relationship between the positive family history of diabetes and the level of discordance was significant, which was correct for both false positive and negative self-reported diabetes. our findings is similar to study in Spain in which subjects with a family history of diabetes reported more frequently that they had diabetes.
People with a positive family history of diabetes are assumed to be more aware of the diabetes and therefore they can report false positive report of diabetes. However, increase in likelihood of false negative report of diabetes is really difficult to be justified.
Our findings revealed that smokers are more likely to falsely report diabetes without any effect on false negative report. Smoking is now proven to be an independent risk factor for diabetes, and amongst diabetics it increases the risk of complications.
Different reports demonstrated that most smokers know that smoking is a risk factor for their general health and in fact individuals with good to excellent self-rated health are those who have never smoked. We can explain that smokers worry about their health and harm of smoking that have a false positive report about their blood glucose status.
In present study, although, level of education was associated with lower likelihood of total discordance between self-reported diabetes and diabetes diagnosed by gold standard, there is no association between false positive andnegative (separately) with gold standard in multivariable analysis.
In line with the results of this study, there was a significant relationship between self-report accuracy and demographic variables such as age, educational level, positive family history, gender and BMI in studies conducted in other countries.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.
The association between demographic characteristics and validity of self-reported diabetes indicates that such specific characteristics affect the patient's awareness, and should be considered in interpreting the results.
4.1 Weaknesses and strengths
Certain specific limitations should be taken into account when interpreting the results. Validity results may depend on the specific nature of the study; it can be a function of the demographic characteristics as well as socio-cultural background in each population. We have reported the validity of self-reported prevalent cases of diabetes. We assume that our finding might be different from those who have studied the incident cases. In fact, the design and methodology of the studies are different. Therefore, these issues should be considered when generalizing the results. However, diabetes is well-known chronic disease with clear criteria for diagnosis and therefore there is no variability for definition of such condition over different studies.
The present study is the largest and the first study in Kurdish region of Iran. RaNCD is part of PERSIAN cohort designed by a central team with cooperation of 18 other centers all from Iranian universities. In Iran, there is a very well-known health system providing primary health care for the whole population from large cities to remote areas. Therefore, our finding from a Kurdish region of Iran, although the first of its type in western part of Iran, can be generalized to the whole Iranian population.
Although the prevalence of self-report diabetes is frequently used by different studies, in Iran (similar to other studies) it provide an underestimate of real prevalence and is higly dependent to sociodemographic factors such as age, gender, education and family history of diabetes.
Acknowledgements
RaNCD is part of the PERSIAN national cohort, and we would like to thank Prof. Reza Malekzadeh, the Deputy of Research and Technology at the Ministry of Health and Medical Education of Iran and Director of the PERSIAN cohort, as well as Dr. Hossein Poustchi, the Executive Director of the PERSIAN cohort, for all their support during the design and implementation of the RaNCD cohort. This study was supported by the Ministry of Health and Medical Education of Iran and Kermanshah University of Medical Sciences (grant No. 92472).
Appendix A. Supplementary data
The following is the Supplementary data to this article:
Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990–2013: quantifying the epidemiological transition.
Urban-rural differences in the prevalence of self-reported diabetes and its risk factors: the WHO STEPS Iranian noncommunicable disease risk factor surveillance in 2011.
Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure.