Abstract:
|
We study smoothing regularization methods for incorporating derivatives in nonparametric function estimation. Data with derivative info arise in economics, engineering, uncertainty quantification and many other fields. We obtained new results to show that the dimension of the estimation of a multidimensional function can be reduced if the first-order partial derivatives of the function are available. Also, we established that the regularization with incorporation of derivative data is rate-optimal and adapts to unknown smoothness up to an order related to the given kernel. We provide theoretical results to show that in finite sample cases, the proposed regularization estimator produces smaller mean squared error than least squares estimators used in previous studies. The proposed estimation procedure is easy to implement and generally applicable to a wide range of kernels. Numerical examples are provided to corroborate the derived theoretical results.
|