Large language models have become easier to integrate into applications, but running them efficiently is still a major engineering challenge.…