IDS 575 PS3
pdf
keyboard_arrow_up
School
University of Illinois, Chicago *
*We aren’t endorsed by this school
Course
575
Subject
Statistics
Date
Apr 3, 2024
Type
Pages
12
Uploaded by ChancellorFogGull33
Graded
Problem Set (PS) #03
Student
Ayushi Rajive Srivastava
Total Points
100 / 100 pts
Question 1
Maximum Likelihood Basic
25
/ 25 pts
1.1
(no title)
5
/ 5 pts
+ 0 pts
Incorrect
+ 5 pts
Correct
1.2
(no title)
8
/ 8 pts
+ 8 pts
Correct
+ 0 pts
Incorrect
1.3
(no title)
7
/ 7 pts
+ 7 pts
Correct
+ 0 pts
Incorrect
1.4
(no title)
5
/ 5 pts
+ 5 pts
Correct
+ 0 pts
Incorrect
Question 2
Maximum Likelihood Estimation
30
/ 30 pts
2.1
(no title)
10
/ 10 pts
+ 10 pts
Correct
+ 0 pts
Incorrect
+ 8 pts
partial mistake
2.2
(no title)
10
/ 10 pts
+ 10 pts
Correct
+ 0 pts
Incorrect
+ 5 pts
half correct
− 1 pt
Click here to replace this description.
+ 8 pts
Click here to replace this description.
2.3
(no title)
10
/ 10 pts
+ 10 pts
Correct
+ 0 pts
Incorrect
+ 5 pts
half correct
− 1 pt
minor mistake
Question 3
Logistic Regression
45
/ 45 pts
3.1
(no title)
7
/ 7 pts
+ 7 pts
Correct
+ 0 pts
Incorrect
3.2
(no title)
7
/ 7 pts
+ 7 pts
Correct
+ 0 pts
Incorrect
+ 1.5 pts
half
3.3
(no title)
5
/ 5 pts
+ 5 pts
Correct
+ 0 pts
Incorrect
3.4
(no title)
6
/ 6 pts
+ 6 pts
Correct
+ 0 pts
Incorrect
3.5
(no title)
10
/ 10 pts
+ 10 pts
Correct
+ 0 pts
Incorrect
3.6
(no title)
10
/ 10 pts
+ 10 pts
Correct
+ 0 pts
Incorrect
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
- Access to all documents
- Unlimited textbook solutions
- 24/7 expert homework help
Q1 Maximum Likelihood Basic
25 Points
Q1.1
5 Points
A coin is tossed 100 times and lands heads 82 times. Choose every correct option in the following.
(select all applied, no partial credits for more or less)
Q1.2
8 Points
In the setting given at Q1.1, what is the probability of head that makes your overall observation most-likely? (autograded short answer: only the final result number, round to 2 decimal places,like 0.55)
0.82
This is a fair coin.
Probability of the overall observation is .
0.5
82
Maximum possible likelihood of the overall observation is .
100
82
Minimum possible likelihood of the overall observation is .
100
18
None of the above
Q1.3
7 Points
Assume that the coin used for Q1.1 turns out to be completely normal, which is supposed to generate almost equal numbers of heads and tails if randomly tossing many times. Choose every possible concern of using Maximum Likelihood Estimation. (select all applied, no partial credits for more or less)
Q1.4
5 Points
Maximum Likelihood Estimation gives us a distribution over the parameters as well as the best parameter itself. In other words, MLE provides not only the best parameter but also other parameters with the associated uncertainty of being "non-best".
Does not fully use our observation.
Does not incorporate our prior knowledge.
Does fit tightly to the given observation.
Does fit loosely to the given observation.
None of the above.
θ
^
θ
p
(
θ
)
True
False
Q2 Maximum Likelihood Estimation
30 Points
Consider the following density function , ; , . This is a legal probability density (parametrized by ) because one can verify that the integral over is equal to 1. If necessary, mean and variance of this distributions can be verifed as and , respectively.
f
(
x
∣
θ
) =
θ xe
2
−
θx
x
≥ 0
f
(
x
∣
θ
) = 0
x
< 0
f
θ
∈
R
x
∈ [−∞,∞]
2/
θ
2/
θ
2
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
- Access to all documents
- Unlimited textbook solutions
- 24/7 expert homework help
Q2.1
10 Points
Derive a likelihood of a dataset that consists of independent samples from this distribution. (Hint: The likelihood must be a function of the parameters )
MLE Q2.1.pdf
Download
Your browser does not support PDF previews. You can download the file instead.
D
= {
x
,
x
,...,
x
}
(1)
(2)
(
m
)
m
L
(
θ
;
D
)
θ
Q2.2
10 Points
Derive the log-likelihood function of the dataset from Q2.1. (Hint: The log-
likelihood )
MLE Q2.2.pdf
Download
Your browser does not support PDF previews. You can download the file instead.
D
l
(
θ
;
D
) = log
L
(
θ
;
D
)
Q2.3
10 Points
Find the Maximum Likelihood Estimator . (Hint: Set the derivative equal to zero, and then solve the formula)
MLE Q2.3.pdf
Download
Your browser does not support PDF previews. You can download the file instead.
θ
^
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
- Access to all documents
- Unlimited textbook solutions
- 24/7 expert homework help
Q3 Logistic Regression
45 Points
Q3.1
7 Points
Suppose that you have trained a logistic regression classifier, and it outputs a prediction on a new example . Choose every correct interpretation in the following. (select all applied, no partial credits for more or less)
Q3.2
7 Points
Which of the following ways can we train a logistic regression model? (select all correct, no partial credits for more or less)
h
(
x
) =
θ
0.2
x
Our estimate for is 0.2.
P
(
y
= 0∣
x
;
θ
)
Our estimate for is 0.2.
P
(
y
= 1∣
x
;
θ
)
Our estimate for is 0.8.
P
(
y
= 0∣
x
;
θ
)
Our estimate for is 0.8.
P
(
y
= 1∣
x
;
θ
)
Minimize least-square error
Maximize likelihood
Solve normal equation
Minimimize negative log-likelihood
Q3.3
5 Points
In logistic regression, what do we estimate for one each unit’s change in ?
Q3.4
6 Points
Choose every option that correctly describes properties of the logistic function. (select all applied, no partial credits for more or less)
X
The change in multiplied with .
Y
Y
The change in from its mean.
Y
How much changes.
Y
How much the natural logarithm of the odds (i.e., ) changes.
log
p
(
y
=0)
p
(
y
=1)
It maps a real-valued confidence value into a probability value.
It is essentially an identity function between .
[0,1]
It always maps zero confidence exactly into the probability 0.5.
It is a continuous function that is differentiable everywhere.
Its derivative can be easily evaluated with itself.
Q3.5
10 Points
Recall the grading problem to predict pass/fail in the class. Suppose you collect data for a group of students in the class that consist of two input features = hours studied and = undergrad GPA. Your goal is to predict the output {pass, fail}. Suppose that you fit a logistic regression, learning its parameter .
What will be the probability for a student who studies for 40 hours and has a GPA of 3.5 to pass the class?
(augraded short answer: only final result number, round to 2 decimal places, like 0.11)
0.38
Q3.6
10 Points
How many hours would the student in part Q3.5 need to study in order to have at least 50% chance of passing the class?
(autograded short answer: only final result number: an integer)
50
X
1
X
2
Y
∈
(
θ
;
θ
;
θ
) =
0
1
2
(−6;0.05;1)
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
- Access to all documents
- Unlimited textbook solutions
- 24/7 expert homework help
Related Documents
Related Questions
test statistic and p value are still incorrect, please help me and show me steps, answer rounded
arrow_forward
null/observed/alternative20/25/50%compatible/not compatibleinside/outside30/50/95is/is no
https://learning.statistics-is-awesome.org/threethings/
arrow_forward
Describe a study in which you can use both nonparametric and parametric statistics. A researcher has participants expecting to receive either painful or mild electrical shocks during a study wait in a quarter-full waiting room with other participants. He then measures whether they choose to sit next to other participants or if they sit far away on their own. What is the best test to run for this study and why?
arrow_forward
I need you to explain the 2 sentences at the bottom in more detail. I do not understand the concepts of the following two sentences from part 2 of this question.
Auditor to obtain a high level of certainty that misstatement or deviation is not representative of the population.
As the risk increases the amount of evidence by identifying the risk of material misstatement and risk associated with the control
Thank you
arrow_forward
Question #2
The table below includes results from polygraph (lie detector) experiments conducted by researchers. In each case, it was known if the subjected lied or did not lie, so the table indicates when the polygraph test was correct. Use a 0.05 significance level to test the claim that whether a subject lies is independent of the polygraph test indication. Do the results suggest that polygraphs are effective in distinguishing between truth and lies?
View the table
Dialog content starts
Did the Subject Actually Lie?
No (Did Not Lie)
Yes (Lied)
Polygraph test indicated that the subject lied.
20
48
Polygraph test indicated that the subject did not lie.
23
11
Determine the test statistic.
χ2= ___________
(Round to three decimal places as needed.)
Determine the P-value of the test statistic.
P-value= ____________
(Round to four decimal places as needed.)
arrow_forward
IQ and Lead Exposure Data Set 7 “IQ and Lead” in Appendix B lists full IQ scores for a random sample of subjects with low lead levels in their blood and another random sample of subjects with high lead levels in their blood. The statistics are summarized on the top of the next page. Use a 0.05 significance level to test the claim that IQ scores of people with low lead levels vary more than IQ scores of people with high lead levels.
arrow_forward
Please can someone take a look at the questions not sure if the answers are right.
arrow_forward
[3] Instruction: Draw a conclusion by analyzing the given sets of data using the z test. Use the 7 steps below in answering a word problem in inferential statistics. (Type the answers with solution, NOT HANDWRITTEN + Please put a label with "step #" on every solution).
Note (1): pls refer for the format in the photo below and few example on how to answer each steps.
Note (2): pls refer for the problem on the next photo
arrow_forward
IQ and Lead Exposure Data Set 7 “IQ and Lead” in Appendix B lists full IQ scores for a random sample of subjects with “medium” lead levels in their blood and another random sample of subjects with “high” lead levels in their blood. Use a 0.05 significance level to test the claim that subjects with medium lead levels have a higher median of the full IQ scores than subjects with high lead levels. Does lead level appear to affect full IQ scores?
arrow_forward
Here's the data copy and paste it on your web browser. For a better view I think you can open it up on excel.
arrow_forward
Please show how it is solve
arrow_forward
Heights of Fathers and Sons Listed below are heights (in.) of fathers and their first sons. The data are from a journal kept by Francis Galton. (See Data Set 5 “Family Heights” in Appendix B.) Use a 0.05 significance level to test the claim that there is no difference in heights between fathers and their first sons.
arrow_forward
If you reject the null hypothesis ar the 5% significance level would you reject the null hypothesis at the 3% significance level?
Group of answer choices
yes
no
not enough information to determine.
arrow_forward
Can someone please help me to better understand?
ASSIGNMENT:
A town official claims that the average vehicle in their area sells for more than the 40th percentile of your data set. Using the data, you obtained in week 1, as well as the summary statistics you found for the original data set (excluding the super car outlier), run a hypothesis test to determine if the claim can be supported. Make sure you state all the important values, so your fellow classmates can use them to run a hypothesis test as well. Use the descriptive statistics you found during Week 2 NOT the new SD you found during Week 4. Because again, we are using the original 10 sample data set NOT a new smaller sample size. Use alpha = .05 to test your claim.
(Note: You will want to use the function =PERCENTILE.INC in Excel to find the 40th percentile of your data set. Hopefully this Excel function looks familiar to you from Week 2.)
First determine if you are using a z or t-test and explain why. Then conduct a…
arrow_forward
Look at the first picture than answer questions in the 2nd one
arrow_forward
Step by step solution please
arrow_forward
SEE MORE QUESTIONS
Recommended textbooks for you
Glencoe Algebra 1, Student Edition, 9780079039897...
Algebra
ISBN:9780079039897
Author:Carter
Publisher:McGraw Hill
Related Questions
- test statistic and p value are still incorrect, please help me and show me steps, answer roundedarrow_forwardnull/observed/alternative20/25/50%compatible/not compatibleinside/outside30/50/95is/is no https://learning.statistics-is-awesome.org/threethings/arrow_forwardDescribe a study in which you can use both nonparametric and parametric statistics. A researcher has participants expecting to receive either painful or mild electrical shocks during a study wait in a quarter-full waiting room with other participants. He then measures whether they choose to sit next to other participants or if they sit far away on their own. What is the best test to run for this study and why?arrow_forward
- I need you to explain the 2 sentences at the bottom in more detail. I do not understand the concepts of the following two sentences from part 2 of this question. Auditor to obtain a high level of certainty that misstatement or deviation is not representative of the population. As the risk increases the amount of evidence by identifying the risk of material misstatement and risk associated with the control Thank youarrow_forwardQuestion #2 The table below includes results from polygraph (lie detector) experiments conducted by researchers. In each case, it was known if the subjected lied or did not lie, so the table indicates when the polygraph test was correct. Use a 0.05 significance level to test the claim that whether a subject lies is independent of the polygraph test indication. Do the results suggest that polygraphs are effective in distinguishing between truth and lies? View the table Dialog content starts Did the Subject Actually Lie? No (Did Not Lie) Yes (Lied) Polygraph test indicated that the subject lied. 20 48 Polygraph test indicated that the subject did not lie. 23 11 Determine the test statistic. χ2= ___________ (Round to three decimal places as needed.) Determine the P-value of the test statistic. P-value= ____________ (Round to four decimal places as needed.)arrow_forwardIQ and Lead Exposure Data Set 7 “IQ and Lead” in Appendix B lists full IQ scores for a random sample of subjects with low lead levels in their blood and another random sample of subjects with high lead levels in their blood. The statistics are summarized on the top of the next page. Use a 0.05 significance level to test the claim that IQ scores of people with low lead levels vary more than IQ scores of people with high lead levels.arrow_forward
- Please can someone take a look at the questions not sure if the answers are right.arrow_forward[3] Instruction: Draw a conclusion by analyzing the given sets of data using the z test. Use the 7 steps below in answering a word problem in inferential statistics. (Type the answers with solution, NOT HANDWRITTEN + Please put a label with "step #" on every solution). Note (1): pls refer for the format in the photo below and few example on how to answer each steps. Note (2): pls refer for the problem on the next photoarrow_forwardIQ and Lead Exposure Data Set 7 “IQ and Lead” in Appendix B lists full IQ scores for a random sample of subjects with “medium” lead levels in their blood and another random sample of subjects with “high” lead levels in their blood. Use a 0.05 significance level to test the claim that subjects with medium lead levels have a higher median of the full IQ scores than subjects with high lead levels. Does lead level appear to affect full IQ scores?arrow_forward
- Here's the data copy and paste it on your web browser. For a better view I think you can open it up on excel.arrow_forwardPlease show how it is solvearrow_forwardHeights of Fathers and Sons Listed below are heights (in.) of fathers and their first sons. The data are from a journal kept by Francis Galton. (See Data Set 5 “Family Heights” in Appendix B.) Use a 0.05 significance level to test the claim that there is no difference in heights between fathers and their first sons.arrow_forward
arrow_back_ios
SEE MORE QUESTIONS
arrow_forward_ios
Recommended textbooks for you
- Glencoe Algebra 1, Student Edition, 9780079039897...AlgebraISBN:9780079039897Author:CarterPublisher:McGraw Hill
Glencoe Algebra 1, Student Edition, 9780079039897...
Algebra
ISBN:9780079039897
Author:Carter
Publisher:McGraw Hill