Run DeepSeek models on your own machine and interact with them using MATLAB

Generative AI
Seguir


Run DeepSeek models on your own machine and interact with them using MATLAB

Mike Croucher el 4 de Feb. de 2025 a las 14:27
Actividad más reciente Respuesta de Mike Croucher a las el 4 de Feb. de 2025 a las 17:35

You've probably heard about the DeepSeek AI models by now. Did you know you can run them on your own machine (assuming its powerful enough) and interact with them on MATLAB?
In my latest blog post, I install and run one of the smaller models and start playing with it using MATLAB.
How to run local DeepSeek models and use them with MATLAB » The MATLAB Blog - MATLAB & Simulink
Larger models wouldn't be any different to use assuming you have a big enough machine...and for the largest models you'll need a HUGE machine!
Even tiny models, like the 1.5 billion parameter one I demonstrate in the blog post, can be used to demonstrate and teach things about LLM-based technologies.
Have a play. Let me know what you think.

2 Comentarios

Inicie sesión para participar
David
David el 4 de Feb. de 2025 a las 17:21
For comparison, I can run the 14b parameter distilled model just fine on my M1 Mac with 16 gigs of RAM.
Mike Croucher
Mike Croucher el 4 de Feb. de 2025 a las 17:35
Nice! I'll try that next
Mike Croucher

Mike Croucher

I write The MATLAB Blog at MathWorks and specialize in High Performance Computing, Research Software Engineering and Machine Learning. You can also follow me at BlueSky https://bsky.app/profile/walkingrandomly.bsky.social
25
Publicacións
225
Responders
40
Seguidores
Seguir
Ver perfil

Publicaciones de este autor

Ver todo

Etiquetas

Aún no se han introducido etiquetas.

Go to top of page