In several applications in reliability analysis, medical research and biological situation there may be more than one cause of failure competing for the event. The event can be either death or recover from a certain disease (risk), see     . In the literatures, the model that can be applied to deal with such situations is called competing risks model.
As examples of situations that require a competing risks model: 1) a patient may die from one of several causes such as cancer, heart disease, complications of diabetes, etc., and 2) in AIDS study, if the endpoint is time to opportunistic infection (relapse), the death and infection may be viewed as competing risks during the treatment of death and loss to follow-up as censoring, see   .
The available data, in the competing risks models, consist of the times to event and an indicator of either the cause of failure or censored. One of the interesting points in competing risks models is to report on the distribution of the time to failure from one risk in the presence of all other risks, which is called as the relative risk.
Competing risks models are studied by several authors based on both parametric and non-parametric setup,   . It is assumed, in the parametric setup, that the risks follow a variety of lifetime distributions. Examples of such distributions include gamma, Weibull, exponential and generalized exponential,       . The non-parametric setup does not consider a specific life time distribution. The analysis of the non-parametric version of competing risks models is investigated by several authors, such as    .
The Weibull distribution has been frequently used in reliability analysis, see  and  . Weibull distribution is flexible (its hazard function can be constant, decreasing or increasing) and therefore can be used quite effectively to analyze a variety of real data sets. Various properties of Weibull distribution are discussed by   .  discussed statistical inferences of a competing risks model assuming exponential causes and Weibull causes of failure with the same shape parameter. They used the maximum likelihood method when the cause of failure is either known or unknown.
In this paper, we discuss statistical inferences of a competing risks model when risks follow Weibull distributions with both unknown scale and shape parameters when the data can be censored. We will use maximum likelihood and Bayes methods. In Bayesian approach, we will consider that the unknown parameters are independent and follow gamma prior distributions. The reset of the paper is organized as follows. Section 2 describes the competing risks model assumptions. In Section 3, we derive the likelihood function and obtain the maximum likelihood estimates and discuss the two-sided confidence intervals for the model parameters. The Bayesian procedure is discussed in Section 4. The risk dues a specific cause in the presence of all other causes, for the underlying model, is discussed in Section 5. A complete analysis of a real data set is provided in Section 6. Finally, Section 7 concludes the paper.
2. Model Assumptions
Assume that there is a set of N identical and independent objects (or systems) on life test. Each object is assigned to one of , independent causes of failure. Every object is tested until it fails or reaches a censored time. In the failure case, the object fails due to only one cause. The whole test will be terminated after either all objects fail or it reach the censored times or a combination of the two. When an object fails, there will be two observable quantities, the object’s lifetime, say T, and the cause of failure, say , where . While in the censored case, we observe only the censoring time. To simplify the notations, we set for the censoring case. Furthermore, we need the following assumptions throughout the paper:
1) is the lifetime of object which has a cumulative distribution function , survival function , and probability density function , .
2) is the random time at which cause may hit object , . Since the N objects on the life test are identical, therefore , for , are identically distributed random variables. Furthermore, we assume that , for , has cumulative distribution function (which is called also as sub-distribution function of cause j), survival function (or sub-survival function) , probability density function , and hazard rate function , for .
Obviously, . That is, when , where , , therefore, . While when ,
3) More specifically, we assume that follow Weibull distributions with unknown parameters and , say , for and . That is, has the cumulative distribution function
the probability density function is
and the survival rate function is
and the hazard rate function is
where is the shape parameter and is the scale parameter.
3. The Likelihood Function and Maximum Likelihood Estimates
In this section we will derive the likelihood function of the model parameters using the available data described above. The available data can be expressed as , where
3.1. The Likelihood Function
Using data described above, the likelihood function is
where is the vector of 2k unknown parameters, . Based on the model assumptions and using the well-known relations between the reliability measures “the survival, hazard rate and the probability density functions”, we can write the likelihood function as
by taking the natural logarithm for both sides of Equation (6), we get the log-li- kelihood function in the general case as
where I(A) is an indicator function that is defined as I(A) = 1 if A is true and 0, otherwise.
Substituting from (3) and (4) into (6) and (7), we get the likelihood function and the log-likelihood function for the competing risks model, when the causes follow Weibull distribution with unknown parameters, as
As well known, the maximum likelihood point estimate of is the set of values of its elements that maximize the likelihood (or log-likelihood) function.
The first partial derivatives of with respect to and are
where is Kronecker delta. To get the maximum likelihood
point estimates for the parameters, we set and , ,
then solve the system of 2 k equations obtained with respect to and , . The obtained system has no analytical solution, therefore we should use a numerical technique to get the maximum likelihood estimates of the parameters.
In order to obtain the information matrix, we need the second partial de- rivatives of with respect to and , , which are given below
3.2. Confidence Intervals
The maximum likelihood estimators for the parameters cannot be obtained in analytic forms. Therefore, their actual distributions cannot be derived. However, we can use the asymptotic distribution of the maximum likelihood estimator to derive confidence intervals for . It is well known that
where denotes 2 k-multidimension normal distribution and is the variance-covariance matrix that can be obtained as the inverse of the information matrix of . The elements of the information matrix are the second partial derivatives of evaluated at the maximum likelihood point estimate of the unknown parameters. That is , where
4. Bayesian Procedure
In this section, we use Bayes approach to estimate the unknown model parameters and . We assume that all parameters are independent and follow gamma distributions with different but known prior hyperparameters. That is, we assume that follows Gamma prior distribution with shape parameter and scale parameter , and follows Gamma prior distribution with shape parameter and scale parameter , for . Therefore, the joint prior density of , up to a constant, is
Combine the likelihood function (8) and the joint prior density (17), and using the Bayes’ theorem, we get the joint posterior density function of , up to a constant, as
Under quadratic loss function, the Bayesian estimate of any function of the vector of unknown parameters , say is the posterior mean of that function. That is,
The integral in Equation (19) as well as the normalized constant included in (18) have no analytical solutions. Therefore, numerical approaches should be used to do Bayesian analysis of the underlying model. Among several approaches, we will use Markov Chain Monte Carlo (MCMC) simulation technique to do the analysis. MCMC algorithm can be used to get random draws from the posterior distribution with density given in (18) without calculating the normalized constant. Then we can use the random draws to do any analysis we wish about the model parameters and model characteristics.
Markov Chain Monte Carlo Method
One of the most successful methods in modern Bayesian statistics is the Markov Chain Monte Carlo (MCMC) technique. MCMC method is an algorithm to summarize the posterior distribution without calculating the normalized constant. MCMC techniques have been extensively used to become among the main computational tools in the Bayesian statistical inference  . The Metropolis-Hasting sampler is a modified version of the MCMC method. One of the main ideas in MCMC is to find a suitable distribution function, called as “proposal” that satisfies two conditions: 1) easy to simulate from, and 2) it mimics the posterior distribution function of interest. Once we determine such proposal, we get random draws from it, we apply the acceptance-rejection rule to get random draws from our target posterior distribution.
The following describes the steps of Metropolis-Hasting algorithm to simulate random draws from the posterior distribution :
1) Set starting point of the chain, say .
2) Set a size of trails we get for the random draws, say M.
3) For repeat the following steps:
a) Set .
b) Generate a candidate from a proposal distribution .
c) Calculate the acceptance probability as , where
d) Set with probability or otherwise set .
Under some regularity conditions on the proposal density , the sequence of the simulated draws will converge to random draws that follow the posterior density .
5. The Risks
One of the important characteristics in competing risks models is the relative risk of one of the competing risks in the presence of all other risks. In this section, we discuss how to estimate the failure probability distribution for each cause of failure in the existence of all others and the risk due to a specific cause of failure. The probability of failure due to cause j at time t in the presence of all other causes is, see   ,
The risk due to cause , say , is
For the Weibull competing risks model discussed here, can be obtained by solving the following integral
The above integral has no analytic solution. As special case, when all shape parameters for causes are equal, , we get
Using the invariant property, the maximum likelihood estimate of can obtained by numerical integration when the integrand function in (22) evaluated at the maximum likelihood estimates of the parameters. For Bayesian analysis, we will us the random draws that obtained from the joint distribution along with the integral above to get random draws from the posterior distribution of , then use it do all Bayes analysis we wish on .
We study in this section an application of a real-life data set. This data set gives the times (in years) from HIV infection to AIDS, SI switch and death in 329 men who have sex with men (MSM). Data are from the period until combination anti-retroviral therapy became available (1996). For more background information on this data, see   . It was used as example for the competing risks analyses in   . These data can be considered as competing risks data with two risks. There are some individuals in the study left with no infection switch or death. Those are considered as censored observations.
Here, we use the model discussed in this paper to analyze this data set. Table 1 shows the maximum likelihood and Bayes point estimates of the fours model parameters. We used R language to do all calculations.
As shown in Table 1, the results from both methods are completely different. Since we do not know the actual values of the unknown parameters, then using those point estimates will not be sufficient to judge which method provides better estimates. One of the comparison tools is the interval estimation or the corresponding variance to each point estimate. This why we calculated them as
Table 1. Estimates the parameters and by maximum likelihood and bayesian methods.
Below is the inverse of the Fisher information matrix that approximates the variance-covariance matrix for the maximum likelihood estimates of the vector of unknown parameters :
As we can see, the variances of and are very large comparing to their values. This would lead to negative lower bound of the asymptotic confidence intervals of and . Since and cannot be negative, we truncate the lower limits at zero. This is one of the disadvantages of the maximum likelihood method.
Table 2 shows asymptotic 95% confidence intervals of the four unknown parameters. Table 3 shows the estimated risks using both two methods. The 95% credible intervals of the four unknown parameters are shown in Table 4, while Table 5 gives the measures of central tendency of the four parameters using their marginal posterior distributions. As Table 4 and Table 5 show, not only the lower limits of the credible intervals of and are larger than zero, but the minimum values of and are larger than zero. This is one of the advantages of the Bayes method.
In Bayes case, we set all hyperparameters equal and equal to 0.001 that reflects non-informative prior. To apply MCMC, we used the proposal as a multivariate t distribution with mode equal to the vector of the maximum likelihood estimates, variance-covariance matrix equals to the inverse Fisher matrix and four degrees of freedom. Also, the number of draws, M, was 10000. As a diagnostic test for the MCMC, we plotted the autocorrelations and the traces for each parameter as shown in Figure 1 and Figure 2. The trace plots show good mix of the sampled draws and the autocorrelation plots show that the Lag decreases rapidly, which indicates that the draws become approximately independent over time and the draws come from the actual posterior distribution. We used the random draws from the joint posterior distribution of to get random draws for the risks from their marginal posterior distributions without obtaining those actual marginal distributions. We used those draws to calculate Bayes estimates of and sketch their posterior density functions. Figure 3
Table 2. The asymptotic confidence intervals using Maximum likelihood method.
Table 3. Estimates the two risks.
Table 4. 95% credible intervals for the four parameters.
Table 5. The measures of central tendency of the parameters and .
shows the trace plots of the draws of and the corresponding marginal posterior density functions. Furthermore, we used the random draws of to get random draws for the sub-survivors and the overall survivor and used them to calculate the Bayes estimators along with 95% credible intervals for those functions at different time as shown in Figure 4.
In this paper, we attempted to examine competing risks models with ,
Figure 1. The autocorrelation plot of the simulated draws using MCMC after discarding the first 50% of the draws.
Figure 2. The trace plots of the simulated draws after discarding the early 50% of the draws.
independent causes of failure in the presence of censoring data. We derived the likelihood equation of the model in general and used it to derive the likelihood function when the risks follow Weibull distributions with unknown shape and scale parameters.
We discussed how to get the maximum likelihood estimates and Bayes estimates of the model parameters as well as for some important reliability measures such as the individual risks, sub-survivors and overall survivor. In Bayes analysis, we used gamma prior distribution for all unknown parameters with known
Figure 3. Trace plots and posterior density functions of .
Figure 4. Bayes point and interval estimates of the sub-survivor functions and the overall survivor function.
hyperparameters and used MCMC to get random draws from the joint posterior distribution function. Also, we discussed the asymptotic confidence intervals and credible intervals of all unknown parameters. The model is applied to a real data set and detailed discussion was provided.
The authors are grateful to the anonymous referees for a careful checking of the details and for helpful comments that improved this paper.
 De Wreede, L.C., Fiocco, M. and Putter, H. (2010) The Mstate Package for Estimation and Prediction in Non- and Semiparametric Multi-State and Competing Risks Models. Computer Methods and Programs in Biomedicine, 99, 261-274.
 Berkson, J. and Elveback, L. (1960) Competing Exponential Risks, with Particular Reference to the Study of Smoking and Lung Cancer. Journal of the American Statistical Association, 55, 415-428. https://doi.org/10.1080/01621459.1960.10482072
 Kundu, D. and Sarhan, A.M. (2006) Analysis of Incomplete Data in Presence of Competing Risks among Several Groups. IEEE Transactions on Reliability, 55, 262- 269.
 Sarhan, A.M. (2007) Analysis of Incomplete, Censored Data in Competing Risks Models with Generalized Exponential Distributions. IEEE Transactions on Reliability, 56, 132-138.
 Hossain, A. and Zimmer, W. (2003) Comparison of Estimation Methods for Weibull Parameters: Complete and Censored Samples. Journal of Statistical Computation and Simulation, 73, 145-153. https://doi.org/10.1080/00949650215730
 Bocchetti, D., Giorgio, M., Guida, M. and Pulcini, G. (2009) A Competing Risk Model for the Reliability of Cylinder Liners in Marine Diesel Engines. Reliability Engineering & System Safety, 94, 1299-1307.
 Dukers, N.H.T.M., Renwick, N., Prins, M., Geskus, R.B., Schulz, T.F., Weverling, G.-J., Coutinho, R.A. and Goudsmit, J. (2000) Risk Factors for Human Herpesvirus 8 Seropositivity and Seroconversion in a Cohort of Homosexula Men. American Journal of Epidemiology, 151, 213-224.
 Xiridou, M., Geskus, R., de Wit, J., Coutinho, R. and Kretzschmar, M. (2003) The Contribution of Steady and Casual Partnerships to the Incidence of HIV Infection among Homosexual Men in Amsterdam. Aids, 17, 1029-1038. https://doi.org/10.1097/00002030-200305020-00012
 Geskus, R.B., Gonzalez, C., Torres, M., Del Romero, J., Viciana, P., Masia, M., Blanco, J.R., Iribarren, M., De Sanjose, S., Hernandez-Novoa, B., et al. (2016) Incidence and Clearance of Anal High-Risk Human Papillomavirus in HIV-Positive Men Who Have Sex with Men: Estimates and Risk Factors. AIDS (London, England), 30, 37.