Question 1
4 marks
Role of connection weights and structural characteristics of recurrent neural networks
- Modelling and simulation
(a)
2 marks
- In recurrent neural networks, connection weights are adjustable numerical coefficients that dictate the strength, polarity, and relative influence of signals passing between neurons.
- During forward propagation, weights scale both current input tokens and prior hidden state activations to compute the next hidden state; during training, they are iteratively updated via backpropagation through time (BPTT) using gradient descent to minimize predictive loss.
Mentor tip
Explain their functional role (scaling input and recurrent signals) and their adaptation via backpropagation through time to reduce model loss.
(b)
2 marks
- Internal Hidden State Memory: An internal vector representation () that persists across time steps, acting as working memory that retains information about prior inputs in the sequence.
- Recurrent Cyclic Connections: Feedback loops where the hidden layer output at time step feeds directly back into the hidden layer at time step , enabling sequential temporal modeling.
Mentor tip
Identify two distinct characteristics such as the persistent hidden state vector, recurrent feedback loops, or activation functions like tanh and sigmoid.

