Need help with this code completion below in python: class LinearLayer:     def __init__(self,M,N):         self.W = np.random.randn(N, M) * 0.1         self.b =np.zeros(shape =(N, 1))          self.Wgrad = None         self.bgrad = None         self.X = None                       def forward(self,X):         self.X = X                   # YOUR CODE HERE         return                    def backward(self,dY):         # YOUR CODE HERE                  return diff

Database System Concepts
7th Edition
ISBN:9780078022159
Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Chapter1: Introduction
Section: Chapter Questions
Problem 1PE
icon
Related questions
Question
100%

Need help with this code completion below in python:

class LinearLayer:
    def __init__(self,M,N):
        self.W = np.random.randn(N, M) * 0.1
        self.b =np.zeros(shape =(N, 1)) 
        self.Wgrad = None
        self.bgrad = None
        self.X = None
        
        
    def forward(self,X):
        self.X = X
         
        # YOUR CODE HERE
        return 
    
        
    def backward(self,dY):

        # YOUR CODE HERE
        
        return diff

Linear Layer
The linear layer
Y = L(X)
takes X of size M × P and translates it to Y of dimension N x P. It performs
Y = WX + b.
Here W is of dimension N × M and b is of dimension N x 1
The backward step need to compute
VxC, VwC = VyC×XT, and V,C =VyCx1
The intermediate variable X need to be saved during the forward pass
Transcribed Image Text:Linear Layer The linear layer Y = L(X) takes X of size M × P and translates it to Y of dimension N x P. It performs Y = WX + b. Here W is of dimension N × M and b is of dimension N x 1 The backward step need to compute VxC, VwC = VyC×XT, and V,C =VyCx1 The intermediate variable X need to be saved during the forward pass
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 2 steps

Blurred answer
Knowledge Booster
Array
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.
Similar questions
Recommended textbooks for you
Database System Concepts
Database System Concepts
Computer Science
ISBN:
9780078022159
Author:
Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan
Publisher:
McGraw-Hill Education
Starting Out with Python (4th Edition)
Starting Out with Python (4th Edition)
Computer Science
ISBN:
9780134444321
Author:
Tony Gaddis
Publisher:
PEARSON
Digital Fundamentals (11th Edition)
Digital Fundamentals (11th Edition)
Computer Science
ISBN:
9780132737968
Author:
Thomas L. Floyd
Publisher:
PEARSON
C How to Program (8th Edition)
C How to Program (8th Edition)
Computer Science
ISBN:
9780133976892
Author:
Paul J. Deitel, Harvey Deitel
Publisher:
PEARSON
Database Systems: Design, Implementation, & Manag…
Database Systems: Design, Implementation, & Manag…
Computer Science
ISBN:
9781337627900
Author:
Carlos Coronel, Steven Morris
Publisher:
Cengage Learning
Programmable Logic Controllers
Programmable Logic Controllers
Computer Science
ISBN:
9780073373843
Author:
Frank D. Petruzella
Publisher:
McGraw-Hill Education