Splitwise: Efficient Generative LLM Inference Using Phase Splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Aashaka Shah, Saeed Maleki, Ricardo Bianchini
International Symposium on Computer Architecture