A startup company makes a specialized ML (machine learning) hardware which trains a model 20 times faster than the normal hardware. a. If the system spends 70% of the time training the model and 30% running inference, what is the speedup if the new ML hardware is used? Assume the old hardware is used for inferencing. b. Assume the model only needs to be trained once and then used for inferencing for a while. What percentage of training and inferencing result in an overall speedup of 4? Assuming the new hardware is used only for training, while old hardware is used for inferencing. c. Suppose you have measured the percentage of model training is 70%, and 80% of the training operations could be performed in parallel. What is the speedup of using 4 units of new ML hardware?

Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
icon
Related questions
Question

] A startup company makes a specialized ML (machine learning) hardware which trains a model
20 times faster than the normal hardware.
a. If the system spends 70% of the time training the model and 30% running inference, what is the
speedup if the new ML hardware is used? Assume the old hardware is used for inferencing.
b. Assume the model only needs to be trained once and then used for inferencing for a while. What
percentage of training and inferencing result in an overall speedup of 4? Assuming the new
hardware is used only for training, while old hardware is used for inferencing.
c. Suppose you have measured the percentage of model training is 70%, and 80% of the training
operations could be performed in parallel. What is the speedup of using 4 units of new ML
hardware?

Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 2 steps

Blurred answer
Similar questions
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY