General relative error criterion and M-estimation

Abstract

Relative error rather than the error itself is of the main interest in many practical applications. Criteria based on minimizing the sum of absolute relative errors (MRE) and the sum of squared relative errors (RLS) were proposed in the different areas. Motivated by K. Chen et al.’s recent work [J. Amer. Statist. Assoc., 2010, 105: 1104–1112] on the least absolute relative error (LARE) estimation for the accelerated failure time (AFT) model, in this paper, we establish the connection between relative error estimators and the M-estimation in the linear model. This connection allows us to deduce the asymptotic properties of many relative error estimators (e.g., LARE) by the well-developed M-estimation theories. On the other hand, the asymptotic properties of some important estimators (e.g., MRE and RLS) cannot be established directly. In this paper, we propose a general relative error criterion (GREC) for estimating the unknown parameter in the AFT model. Then we develop the approaches to deal with the asymptotic normalities for M-estimators with differentiable loss functions on ℝ or ℝ\{0} in the linear model. The simulation studies are conducted to evaluate the performance of the proposed estimates for the different scenarios. Illustration with a real data example is also provided.

Keywords

Relative error / accelerated failure time model / M-estimation, asymptotic normality / general loss function

References

[1] Bai Z D, Rao C R, Wu Y. M-estimation of multivariate linear regression parameters under a convex discrepancy function. Statist Sinica, 1992, 2: 237-254

[2] Chambers J M. Graphical Methods for Data Analysis, 1983, Belmont: Wadsworth International Group

[3] Chen K, Guo S J, Lin Y, Ying Z L. Least absolute relative error estimation. J Amer Statist Assoc, 2010, 105: 1104-1112

[4] Chen K, Ying Z L, Zhang H, Zhao L C. Analysis of least absolute deviation. Biometrika, 2008, 95: 107-122

[5] Chen X R, Zhao L C. M-methods in Linear Model, 1996, Shanghai: Shanghai Scientific & Technical Publishers

[6] Khoshgoftaar T M, Bhattacharyya B B, Richardson G D. Predicting software errors, during development, using nonlinear regression models: a comparative study. IEEE Trans Reliability, 1992, 41: 390-395

[7] Makridakis S G. The Forecasting Accuracy of Major Time Series Methods, 1984, New York: Wiley

[8] Narula S C, Wellington J F. Prediction, linear regression and the minimum sum of relative errors. Technometrics, 1977, 19: 185-190

[9] Park H, Stefanski L A. Relative-error prediction. Statist Probab Lett, 1998, 40: 227-236

[10] Rao R C, Zhao L C. Approximation to the distribution of m-estimates in linear models by randomly weighted bootstrap. Sankhyā, 1992, 54: 323-331

[11] R Core Team. R: A Language and Environment for Statistical Computing. Vienna, 2012