Hello, I'm attempting to utilize lstm to categorize data but the validation loss Is Nan.
I reduced the learning rates to 1e-12 but I am still receiving Nan results.
Appreciate any guidance.
Best Regards,
options = trainingOptions("sgdm", ...
"MaxEpochs",400, ...
"InitialLearnRate",0.000000000001, ...
"Shuffle", 'never', ...
"Plots","training-progress",...
"ValidationData",{XValidation,YValidation},...
'ValidationFrequency',1);
%%
layers = [ ...
sequenceInputLayer(1)
bilstmLayer(100,"OutputMode","last")
fullyConnectedLayer(2)
softmaxLayer
classificationLayer];
% displaySequence(tones_cell{1}, label1{1})
net = trainNetwork(XTrain,labelTrain, layers, options )
YPred = classify(net,XTest);

1 comentario

KSSV
KSSV el 7 de Feb. de 2022
Increase the learning rate and see.

Iniciar sesión para comentar.

 Respuesta aceptada

yanqi liu
yanqi liu el 8 de Feb. de 2022

1 voto

yes,sir,may be add dropoutLayer、batchNormalizationLayer to the model

Más respuestas (0)

Categorías

Más información sobre Deep Learning Toolbox en Centro de ayuda y File Exchange.

Productos

Versión

R2021a

Preguntada:

el 6 de Feb. de 2022

Comentada:

el 8 de Feb. de 2022

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by