Suchita Pati's Webpage

Recent News

Apr 2024: Presented the paper, T3, on hiding communication in distributed LLMs at ASPLOS 2024.

Feb 2024: Defended my PhD thesis!

Feb 2024: Paper on Just-In-Time quantization for ML using PIM accepted at MLSys 2024.

Dec 2023: Paper on hiding communication in distributed LLMs accepted at ASPLOS 2024.

Oct 2023: Presented work on communication in distributed LLM (Tale of 2C's) at IISWC 2023.

Jun 2023: Joined AMD Research.

Dec 2022: Passed my preliminary thesis defense!

Nov 2022: Presented paper on Transformers at IISWC 2022.

Sept 2022: Paper on Transformers accepted at IISWC 2022.

Mar 2021: Paper on fine-grained synchronization accepted at YArch 2021.

Aug 2020: Presented SeqPoint at ISPASS 2020.

May 2020: Will be serving as the President of WACM (ACM-W's Madison chapter).

Feb 2020: Passed my PhD Qualifiers!

Jan 2020: Paper accepted at ISPASS 2020, see preprint on ArXiv .

May 2019: Started my PhD!

April 2019: Presented GPGPU-Sim/ML Poster at ISPASS 2019.

Jan 2019: Poster accepted at ISPASS'19.

Dec 2018: Invited to attend the CRA-W Grad Cohort Workshop 2019.

Oct 2018: Awarded the Hiran Mayukh Award at UW Computer Architecture Affiliates 2018

May 2018: Awarded the Grace Hopper Scholarship 2018

Publications

JIT-Q: Just-in-time Quantization with Processing-In-Memory for Efficient ML Training [PDF]
Mohamed Assem Ibrahim, Shaizeen Aga, Ada Li, Suchita Pati, Mahzabeen Islam
Proceedings of Machine Learning and Systems (MLSys) 2024

T3: Transparent Tracking & Triggering for Fine-grained Overlap of Compute & Collectives [PDF]
Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matt Sinclair
International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2024

Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware [PDF]
Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matt Sinclair
ArXiv preprint arXiv 2302.02825, January 2023
IEEE International Symposium on Workload Characterization (IISWC) 2023

Demystifying BERT: System Design Implications [PDF], preprint>
Suchita Pati, Shaizeen Aga, Nuwan Jayasena, Matt Sinclair
ArXiv preprint arXiv 2104.08335, April 2021
IEEE International Symposium on Workload Characterization (IISWC) 2022

SeqPoint: Identifying Representative Iterations of Sequence-based Neural Networks [PDF], preprint on ArXiv .
Suchita Pati, Shaizeen Aga, Matt Sinclair, Nuwan Jayasena
IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) 2020

Analyzing Machine Learning Workloads Using a Detailed GPU Simulator [PDF]
Jonathan Lew, Deval Shah, Suchita Pati, Shaylin Cattell, Mengchi Zhang, Amruth Sandhupatla, Christopher Ng, Negar Goli, Matthew D. Sinclair, Timothy G. Rogers, Tor Aamodt
IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) 2019

Analyzing Machine Learning Workloads Using a Detailed GPU Simulator [PDF]
Jonathan Lew, Deval Shah, Suchita Pati, Shaylin Cattell, Mengchi Zhang, Amruth Sandhupatla, Christopher Ng, Negar Goli, Matthew D. Sinclair, Timothy G. Rogers, Tor Aamodt
ArXiv preprint arXiv:1811.08933, November 2018

DARTS: Performance-counter driven sampling using binary translators [PDF]
Rajesh Kumar, Suchita Pati, Kanishka Lahiri
IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) 2017

Workshops and Misc

Improving GPU Utilization in ML Workloads Through Finer-Grain Synchronization [PDF]
Reese Kuper, Suchita Pati, Matthew D. Sinclair
The 3rd Young Architect Workshop co-located w/ ASPLOS (YArch-2021)

Exploring GPU Architectural Optimizations for RNNs [PDF]
Suchita Pati, Matthew D. Sinclair
The 1st Young Architect Workshop co-located w/ HPCA (YArch-2019)

Simulating Deep Learning Workloads in GPGPU-Sim [PDF]
Suchita Pati and Matthew D. Sinclair
UW Computer Architecture Affiliates 2018