Optimization of dimensions of hidden layer in neural network
3 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
piyush dugar
el 30 de Mayo de 2014
Comentada: Greg Heath
el 1 de Jun. de 2014
Hello all
I want to optimize the number of neurons in 3 hidden layers which I've used in my neural network. Is there any way (apart from applying 3 nested for loops and checking the test performance for each of them ) so that I can know the optimized dimensions of all the three layers?
My Input vector is (208X200) and target is (5x200).
Please help me!
0 comentarios
Respuesta aceptada
Greg Heath
el 31 de Mayo de 2014
Editada: Greg Heath
el 31 de Mayo de 2014
There is no a priori way to optimize the number of hidden neurons for 1 hidden layer, much less 3. However, you can get a good estimate for the minimum number of the former via trial and error. Increasing the number of hidden layers tends to reduce the total number of hidden neurons. So, maybe a first step would be to design a single hidden layer model first.
A priori information can help, especially with classification where it is known that each class consists of a number of known subclasses. Then a divide and conquer approach can be followed. I have only used this with elliptical basis functions (most of the time with radial basis functions). A first step in this case could be the clustering of each class into subclasses. I can't say much more without revealing proprietary info.
Both clustering and principal component decompositions help understand the data. Look at those first before determining how to construct a divide and conquer approach.
Also take a look at cascade correlation.
1 comentario
Greg Heath
el 1 de Jun. de 2014
I just noticed your input dimensions of [ 208 200 ]. If you use the default data division ratios Ntrn = 140.
Do you really expect to get reliable performance when you are trying to define a 208 dimensional space with 140 vectors?
Reduce the input dimensionality and/or get more data.
Más respuestas (0)
Ver también
Categorías
Más información sobre Deep Learning Toolbox en Help Center y File Exchange.
Productos
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!