A Predictive Performance Analysis of Vitamin D Deficiency Using a Decision Tree model

Full Text

Introduction

HBV infection is a major health problem which may be life-threatening due to its frequent severe complications. In the other hand, VD is an essential vitamin that has powerful influence on several parts of the human body. Nearly one billion people highly suffered from VDD across the globe [4].

Most chronic conditions such as autoimmune diseases and infectious diseases can be affected by VD levels. VDD is a public health problem and is highly prevalent worldwide, so that, it’s prevalence is reported 79% in Iranian adults [5].

There is strong evidence about the association between VD and various chronic liver diseases in different stages [29]. Previous studies have reported that there is an association between vitamin D and hematological factors [3]. Machine learning models will be useful in discovering new patterns of the etiology and thus preventive public health measures can be applied effectively. The traditional severity prediction of VDD have used questionnaires with statistical models such as Linear Regression (LR) [9].

In previous studies, the results were compared between the statistical models and they have not used the machine learning algorithms for the severity prediction. The traditional statistical model like LR is used to predict the severity of VDD but its performance is deprived due to its predictive performance limit and many parameters [7, 10]. Currently, the analysis of VD status is highly expensive, and it is identified using the biochemical methods. The research gap identified urges to condense the cumbersome analytical procedures in identifying VDD among the patients [28].

So, the main objective of this study is to evaluate the DT classifier in the prediction of severity in VDD. And also determine the associated risk factors related with VDD by using DT algorithm, in an Iranian CHB patients.

Method

Two hundred and ninety-two HBV-infected patients were enrolled for this cross-sectional study. Patients were selected randomly according to consent to participate. In this study, we used input parameters such as age, sex (male/female), weight (kgs), height (m), BMI (kg/m), grade and the activity of fibrosis, Sunlight Exposure/Day (hrs.).

Written consent was obtained from the all of patients. Patients with any auto-immune diseases, other viral hepatitis (HCV, HDV, and HIV) and other causes of liver disease, VD, calcium supplement use or injection in the last six months were excluded.

The inclusion criteria were: patients who were admitted to the infectious disease’s outpatient clinic with the diagnosis of CHB with the approval of the infectious specialist and willingness to participate in the study.

The laboratory tests were performed with 10 cc of venous blood was taken from patients (14 h overnight fast). The serum levels of VD were measured using a COBAS e411 analyzer, manufactured by Mannheim Roch diagnostic Gmbh in Germany, with the Elecsys kit (REF 0589413). CBC was measured in whole blood samples.

Total VD levels were measured in the serum samples, then, VD status was classified as normal (≥ 30 ng/ml), insufficient (20–29.9 ng/ml), and deficient (< 20 ng/ml) [27, 31].

Decision Tree (DT). DT Classifier is a well-known supervised ML tool that is used for solving classification problems and it has a tree-like model or graphs. The DT can capture the decision-making knowledge from the given data [12]. In DT that every branch indicates the output of the test set and every leaf node represents the particular label. The classification rules are represented by the path from the root node to the leaf node.

For our VDD severity modeling, each node in the tree predicts the deficiency severity and each branch indicates the states of the variable [19].

ROC curve. ROC curves are used to evaluate the performance of multiclass classifier problems. The ROC curve has false positive rate on X-axis and true positive rate on Y-axis. In the ROC curve topmost left edge of the plot considered to be the ideal point and the steepness of the curve also very important since the TPR value should maximize and the FPR should be minimized [20].

Statistical analysis. All statistical analyses were carried out using R version 3.4.2. The significance in all of these tests was two-tailed with a 5% significant level. The ROC curve sensitivity, specificity were measured for comparison. Several types of DT learning techniques (CART) [15], C4.5 [26], were implemented on the datasets.

Results

Generally, 48.6% were male; with mean age 29±5.3; and 52.2% female with mean age (31.5±7.8). The data were divided into a training and testing dataset (60% vs 40%) respectively. A decision tree was built on the training dataset. The testing dataset were used to assess the model. Gini index was used for selecting the variables in the algorithm to achieve final tree. The training and test datasets were similar to each other roughly. The results showed that, age, BMI as potential predictors of VDD (P value < 0.001) (Table). Hence, these variables were used in DT model.

Table. Characteristics of variables

DT was learned for the training dataset by using variables with significant correlation with VDD (P value < 0.001).

The final DT, with size 17, 9 leaves and 6 layers is shown in Fig. 1

Figure 1. Decision tree with training dataset in CHB group (model 2)

Fig. 2 showed the accuracy, ROC curve, sensitivity, specificity values for predicting VDD in training set. The areas under the ROC curves is (0.78), When we applied DT algorithm with the significant variables by cross validation, the values of 0.78 ROC and 85.3% accuracy were obtained, which is similar to the obtained results of applying training and test sets one by one.

Figure 2. ROC curve of both decision tree models

Discussion

The main objective of this study is to evaluate the performance of machine learning model in the prediction of VDD. The prediction accuracy was calculated and compared with the training and testing set. We have used various parameters in the severity prediction.

A main strength of the current study was that it has explored a new application of the DT model for examining and evaluating the predicators related to VDD among CHB Iranian population. Result of this study showed that the serum zinc as a potential factor of VDD which is similar with previous studies [21, 23].

This study shows that insufficiency of VD occurs more frequently among CHB patients.

A high prevalence of VDD (> 80 %) in chronic liver disease has been reported to be associated with liver disease progression [25]. VDD occurs rather often among the elderly population[22].

In the current study, deficiency and severe VDD were observed more frequently in patients with HBV-related liver disease and were found significantly associated with the end-stage of liver cirrhosis; so, our study is in line with previous studies which have indicated an association of VD levels with CHB [5]. The results of this research work proved that the machine learning models especially the random forest classifier accurately predict the severity of VDD [14]. This machine learning classifier will have a greater opportunity in the real-world medical domain which would assist experts to efficiently identify the severity of VDD.

The future direction of our research is to validate the model with a different type of VD datasets of all age groups.

In a period (1990–2010), the prevalence of VDD was studied in Iranian society and according to the results, in all regions; both sexes had moderate and significant VDD [2, 32]. A study showed that VDD existed in many CHB patients. Decreased liver function due to HBV-induced injuries to liver cells can be one of the causes of VDD in CHB [24, 30].

One of the interesting finding of this study was the pretense of serum zinc as a substantial factor for VDD which is in line with other researches [15].

A previous study has shown a significant correlation between serum level of VD and low serum levels of zinc among Iranian population aged 10–18 years old [6]. In addition, another study had reported a statistically association between serum level of VD and serum levels of zinc among Iranian pregnant women. Their findings showed 37% VDD and 23% of them had zinc deficiency [8].

Data mining analysis has the potential ability to select patients with VDD based on the possibility of response to treatment against a various factors. Moreover, it may provide a rationale to improve the efficacy of therapy. Similarly, CART analysis recognized several variables which were not associated with response by standard statistical model significantly [18]. The fitted DT model could identify few demographic characteristics such as age and sex as significant factors associated with VDD.

In this study, significant association was found between serum levels of vitamin D3 and BMI. In the different studies on the prevalence of VDD showed that VDD prevalence was various based on regions and Iranian population [1, 16]. In this study, however, VDD was not related with liver function parameters, probably due to that VD serum levels are affected by different factors [11, 13, 17].

One of the limitations of this study was influencing factors such as seasonal variation, diet and geographical habitation on Serum VD levels. We recommend more sensitivity and specificity prediction models, which be able to specify having VDD exactly.

Conclusion

This study provides an easy to use classification rules for classifying risk factors related with VDD that can be useful to improve programs for its management.

Acknowledgement

We would like to thank all the study subjects for their participation, Dentistry Clinical Research Development Center, Birjand University of Medical Sciences, Birjand, Iran for consulting.

Conflict of interest

The author declares that there is no conflict of interest.

Ethics approval

This study was approved by the ethics board committee of Birjand University of Medical Sciences, reference number: IR.BUMS.REC.1398.324.

About the authors

Freshteh Osmani

Author for correspondence.
Email: dr.osmani68@gmail.com

PhD, Department of Biostatistics and Epidemiology

References

Supplementary files

Supplementary Files

Action

1. JATS XML

Download

2. Figure 1. Decision tree with training dataset in CHB group (model 2)

Download (147KB)

Indexing metadata

3. Figure 2. ROC curve of both decision tree models

Download (57KB)

Indexing metadata