It's pretty clear that AI is here to stay. However, as more models are being released, we can very well assume that they will collect every bit of information about us as possible. This is why I'm avoiding using AI for very sensitive information like analyzing financial statements or medical records, and I try to be mindful to never open `.env` file in an AI enabled neovim buffer in order to avoid leaking credentials.

Having said that, it would be nice to run local AI models in order to be able to use them for sensitive information, or fine tune them for my use cases without worrying of data leak.

Is anyone here on HN running models locally? What hardware do you recommend getting (I prefer to get a dedicated machine, as it can also be used as a homelab/home server, so no macbook/mac mini recommendations please)? Is it worth it in terms of costs? Would you recommend owning the hardware/renting it/or colocating your hardware in a datacenter?