Huawei Edge-Cloud Collaborative Inference Contest: 960/4428 [active participants], top 22%
Wrote a performant cloud inference optimizer for LLM usage based on a prediction-driven heuristic scheduling methodology. A difficulty I tackled in this challenge was learning how to apply queueing theory to systems like this.