Does setting BiasLearnRateFactor=0 prevent bias updates in a fullyConnectedLayer?
1 visualización (últimos 30 días)
Mostrar comentarios más antiguos
actorNet = [
featureInputLayer(prod(obsInfo.Dimension))
fullyConnectedLayer(64, Bias=zeros(64,1), BiasLearnRateFactor=0)
reluLayer
fullyConnectedLayer(64, Bias=zeros(64,1), BiasLearnRateFactor=0)
fullyConnectedLayer(prod(actInfo.Dimension))
scalingLayer(Scale=5000, Bias=0)
];
actorOptions = rlOptimizerOptions( ...
LearnRate=1e-4, ...
GradientThreshold=1, ...
L2RegularizationFactor=1e-4);
I constructed an actor network and set the optimizer options as shown above.
My question is:
If I set BiasLearnRateFactor=0 in the fullyConnectedLayer, does this mean that the bias will not be updated at all during training?
0 comentarios
Respuestas (1)
Ver también
Categorías
Más información sobre Matrix Computations en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!