Display how sure a ML-model is about it's answer (percentage)

Hey MATLAB-Community!

I was wondering if there is any possibility in MATLAB to show me how sure/confident a Machine-Learning model is about it's own prediction (in percent?). I am using a neural network to classify 2 classes, if that's important.

I googled and searched for it, but didn't find anything :(

Best regards

Dennis

Answer 1

[Sudarshan]

Hi Dennis,

You can refer to these links to measure confidence intervals for various models.

For Neural Networks, check this ML Answers thread:https://in.mathworks.com/matlabcentral/answers/254082-how-to-calculate-confidence-intervals-with-neural-network-prediction

Additional resources:

https://in.mathworks.com/help/stats/assess-neural-network-classifier-performance.html?searchHighlight=Confidence%20scores%20for%20neural%20networks&s_tid=srchtitle_Confidence%20scores%20for%20neural%20networks_1

For SVM, you can check this link (you can do a binary classification using SVMs as well): https://in.mathworks.com/help/stats/classreg.learning.classif.compactclassificationsvm.predict.html