Question

Q8: (8 marks) [basic design problem] Given below is a single node in a neural network. Supposing that d is 4, x={4,2,5,2), and w={0.2,0.3.0.4,0.1), b=0.1, and that the activation function is a standard ReLU, that is =max(0.x), where x is the input to the activation function. b W1 W X 1 Xd (a) What is the output of this node? [2 marks]

Answer 1

In the given neural network, the data points value, and the weights are given. To find the output of the neural network, the following steps are taken :

1. At first, the data values are multiplied with the corresponding weights and the sum of all products is taken.
2. Then, the bias is added to the sum found in the above step.
3. Finally, the activation function is applied to the data calculated in the above step.
4. The output of the node is given below as :

Data Value (x)	Weight(w)	Multiplication
4	0.2	0.8
2	0.3	0.6
5	0.4	2
2	0.1	0.2
Sum	-	3.6
Sum + Bias(b)	-	3.6 + 1 = 4.6
Activation function(relu)	-	max(0,4.6) = 4.6

Node Output = 4.6