TechnologyFine Serve: A Fine-Grained Dataset and Characterization of Global LLM Serving Workloads By Reetam Bodhak The increasing use of large language models (LLMs) as ongoing online services brings a significant challenge: optimizing their serving infrastructures....