Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I have an old 2060 with 6GB (I think). I also have a work laptop 3060 with 6GB (shared to 8GB). What can I do with those? I dabble a bit here and there but I would like to run my own local LLM for 'fun'.

Thanks!



If you just want to run a local LLM you could download ollama and do it in minutes. You'll be limited to small models (I would start with qwen3:1.7b) but it should be quite fast.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: