I’ve made some baby steps into local AI, I installed Alpaca (GUI Local AI Client for Linux) and I installed Llama 3.2 with 1B parameters. For now, the experience seems great. I don’t know if I will continue using Local AI instead of something like Duck AI but it’s fantastic nonetheless.
If anyone has lightweight models (1B to 3B parameters) that are interesting checking out, let me know!
Edit: Currently testing DeepSeek R1 with 1.5B Parameters.