API vs local models... what makes your choice?
I notice much of the talk in this sub is centered around API providers, and, tbh, it feels like chasing API providers and I'm curious what the reason is. The convenience of a phone as the primary RP device? Lack of local hardware to run even modest models?
I guess what I mean is that chasing API models for the "latest and smartest" gets undercut by increasing content restriction by the providers themselves, so it feels like kind of like a losing game of using model size to be smarter and better but it comes with a price tag and fighting a war against moderation.
Then on the other hand, for those who are only on local models (like myself), why choose local over API convenience? I guess I understand at least my own reasons like I already have the needed hardware for it, but maybe it would be nicer to not have to deal with all the setup if I wasn't already really into tinkering in the first place.
And, for people who have tried or use both API and local, what's the difference from your perspective?