Can I use Porteus 5.0 to run an AI Assistant and an Open Source LLM?

[joejac]

Hello to all,
Can I use Porteus 5.0 to run an AI Assistant and an Open Source LLM?.
And if yes, how challenging it can be?
For example:
Run your LLM locally: state-of-the-art 2025
https://e-verse.com/learn/run-your-llm- ... art-2025/

Thanks and regards.

[AcnapyxoB]

GPT4All:
https://docs.gpt4all.io/index.html
https://github.com/nomic-ai/gpt4all

If You can't download models from app, use:
https://github.com/nomic-ai/gpt4all/blo ... dels3.json

Keep in mind that most of the models are ~4GB and more, the application itself is also not small !

[joejac]

Thanks a lot @AcnapyxoB, so it can run on Porteus, I will try , regards.