It’s safe to say that AI is permeating all aspects of computing. From deep integration into smartphones to CoPilot in your favorite apps — and, of course, the obvious giant in the room, ChatGPT. However, working with AI, especially as a journalist, raises a lot of concerns. For one, it has been trained on the work — creative or otherwise — of others. More importantly, it learns from every prompt or input you send its way. So, I’ve been dabbling with hosting my own LLM for the last few months.
Running your own LLM is free and gives you full control.
AI has shifted from being a futuristic concept to an everyday tool. Its role in creative industries, productivity apps, and customer interactions is undeniable. But amid this surge, it’s easy to forget the importance of ownership. Who owns your queries? Who controls your insights? Running a local LLM allows you to answer those questions decisively — you do.