RedditPP Mascot

RedditPP

r/shortcuts • … • u/bingobucketster

Groq AI API faster than ChatGPT

I don't know who needs to hear this, but I found out yesterday that using Groq (not Grok) API (which, in turn, is based off of OpenAI API) cut my ChatGPT API request time from 25 seconds to less than a second. It uses the same "get contents of URL" action as the ChatGPT API request. I'm using it to parse my inputs into standardized formats that Shortcuts can then process to automatically batch generate tasks in my Things 3 app to recognize things like title, date, time, and tags if present, and it works really well! This API has a generous free tier that I don't expect this particular use case to use up, but more aggressive use cases may require a developer tier, which is just pay-as-you-go. I'm also using the Llama 70 billion versatile model.

— 0