2. This problem explores various aspects of variance estimation in nonparametric re- gression. n-tr(S) We have the usual model y = f + where y is the n-vector of observations, f is the n-vector of unknown function values at each z₁, and e is an n-vector with mean 0 and covariance matrix Io². Suppose we estimate f nonparametrically by a linear smoother Sy. Then, by analogy with the linear model, a reasonable estimate of o² is s²-ly-Syll For the linear model S is the 'hat' matrix H which maps observations to fitted values. Here S is a smoothing matrix and depends on the smoothing parameter A, but I have suppressed this dependence for convenience. Unfortunately, while s2 is unbiased for the standard linear model, this is no longer the case for nonparametric smoothers. Verify this by showing that: Elly-Syl²)=o²n-2tr (S) + tr(STS)] + b²b. where b=f-Sf represents the smoothing bias. Note: This suggests an approximately unbiased alternative estimator, if b=0; see, for (0000)
2. This problem explores various aspects of variance estimation in nonparametric re- gression. n-tr(S) We have the usual model y = f + where y is the n-vector of observations, f is the n-vector of unknown function values at each z₁, and e is an n-vector with mean 0 and covariance matrix Io². Suppose we estimate f nonparametrically by a linear smoother Sy. Then, by analogy with the linear model, a reasonable estimate of o² is s²-ly-Syll For the linear model S is the 'hat' matrix H which maps observations to fitted values. Here S is a smoothing matrix and depends on the smoothing parameter A, but I have suppressed this dependence for convenience. Unfortunately, while s2 is unbiased for the standard linear model, this is no longer the case for nonparametric smoothers. Verify this by showing that: Elly-Syl²)=o²n-2tr (S) + tr(STS)] + b²b. where b=f-Sf represents the smoothing bias. Note: This suggests an approximately unbiased alternative estimator, if b=0; see, for (0000)
MATLAB: An Introduction with Applications
6th Edition
ISBN:9781119256830
Author:Amos Gilat
Publisher:Amos Gilat
Chapter1: Starting With Matlab
Section: Chapter Questions
Problem 1P
Related questions
Question
![2. This problem explores various aspects of variance estimation in nonparametric re-
gression.
We have the usual model y = f + e where y is the n-vector of observations, f is the
n-vector of unknown function values at each z, and e is an n-vector with mean 0 and
covariance matrix Ia. Suppose we estimate f nonparametrically by a linear smoother Sy.
Then, by analogy with the linear model, a reasonable estimate of o² is s = ll-Syl. For
the linear model S is the 'hat' matrix H which maps observations to fitted values. Here S is
a smoothing matrix and depends on the smoothing parameter A, but I have suppressed this
dependence for convenience. Unfortunately, while s is unbiased for the standard linear
model, this is no longer the case for nonparametric smoothers.
Verify this by showing that:
n-tr(S)
E(||u - Syll) = o{n - 2tr(S) + tr(S"s)] + 6" b,
where b= f - Sf represents the smoothing bias.
Note : This suggests an approximately unbiased alternative estimator, if b-0; see, for
example, Loader's (1999) book, or the book by Ruppert et al. (2003).](/v2/_next/image?url=https%3A%2F%2Fcontent.bartleby.com%2Fqna-images%2Fquestion%2Ffd54fbc2-091c-4efc-a0ae-33f00779b90d%2F7892a2a0-7062-4816-ba39-9064ce50836f%2F54zke0m_processed.jpeg&w=3840&q=75)
Transcribed Image Text:2. This problem explores various aspects of variance estimation in nonparametric re-
gression.
We have the usual model y = f + e where y is the n-vector of observations, f is the
n-vector of unknown function values at each z, and e is an n-vector with mean 0 and
covariance matrix Ia. Suppose we estimate f nonparametrically by a linear smoother Sy.
Then, by analogy with the linear model, a reasonable estimate of o² is s = ll-Syl. For
the linear model S is the 'hat' matrix H which maps observations to fitted values. Here S is
a smoothing matrix and depends on the smoothing parameter A, but I have suppressed this
dependence for convenience. Unfortunately, while s is unbiased for the standard linear
model, this is no longer the case for nonparametric smoothers.
Verify this by showing that:
n-tr(S)
E(||u - Syll) = o{n - 2tr(S) + tr(S"s)] + 6" b,
where b= f - Sf represents the smoothing bias.
Note : This suggests an approximately unbiased alternative estimator, if b-0; see, for
example, Loader's (1999) book, or the book by Ruppert et al. (2003).
Expert Solution
![](/static/compass_v2/shared-icons/check-mark.png)
This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
Step by step
Solved in 3 steps with 17 images
![Blurred answer](/static/compass_v2/solution-images/blurred-answer.jpg)
Recommended textbooks for you
![MATLAB: An Introduction with Applications](https://www.bartleby.com/isbn_cover_images/9781119256830/9781119256830_smallCoverImage.gif)
MATLAB: An Introduction with Applications
Statistics
ISBN:
9781119256830
Author:
Amos Gilat
Publisher:
John Wiley & Sons Inc
![Probability and Statistics for Engineering and th…](https://www.bartleby.com/isbn_cover_images/9781305251809/9781305251809_smallCoverImage.gif)
Probability and Statistics for Engineering and th…
Statistics
ISBN:
9781305251809
Author:
Jay L. Devore
Publisher:
Cengage Learning
![Statistics for The Behavioral Sciences (MindTap C…](https://www.bartleby.com/isbn_cover_images/9781305504912/9781305504912_smallCoverImage.gif)
Statistics for The Behavioral Sciences (MindTap C…
Statistics
ISBN:
9781305504912
Author:
Frederick J Gravetter, Larry B. Wallnau
Publisher:
Cengage Learning
![MATLAB: An Introduction with Applications](https://www.bartleby.com/isbn_cover_images/9781119256830/9781119256830_smallCoverImage.gif)
MATLAB: An Introduction with Applications
Statistics
ISBN:
9781119256830
Author:
Amos Gilat
Publisher:
John Wiley & Sons Inc
![Probability and Statistics for Engineering and th…](https://www.bartleby.com/isbn_cover_images/9781305251809/9781305251809_smallCoverImage.gif)
Probability and Statistics for Engineering and th…
Statistics
ISBN:
9781305251809
Author:
Jay L. Devore
Publisher:
Cengage Learning
![Statistics for The Behavioral Sciences (MindTap C…](https://www.bartleby.com/isbn_cover_images/9781305504912/9781305504912_smallCoverImage.gif)
Statistics for The Behavioral Sciences (MindTap C…
Statistics
ISBN:
9781305504912
Author:
Frederick J Gravetter, Larry B. Wallnau
Publisher:
Cengage Learning
![Elementary Statistics: Picturing the World (7th E…](https://www.bartleby.com/isbn_cover_images/9780134683416/9780134683416_smallCoverImage.gif)
Elementary Statistics: Picturing the World (7th E…
Statistics
ISBN:
9780134683416
Author:
Ron Larson, Betsy Farber
Publisher:
PEARSON
![The Basic Practice of Statistics](https://www.bartleby.com/isbn_cover_images/9781319042578/9781319042578_smallCoverImage.gif)
The Basic Practice of Statistics
Statistics
ISBN:
9781319042578
Author:
David S. Moore, William I. Notz, Michael A. Fligner
Publisher:
W. H. Freeman
![Introduction to the Practice of Statistics](https://www.bartleby.com/isbn_cover_images/9781319013387/9781319013387_smallCoverImage.gif)
Introduction to the Practice of Statistics
Statistics
ISBN:
9781319013387
Author:
David S. Moore, George P. McCabe, Bruce A. Craig
Publisher:
W. H. Freeman