Publications

EfficientAgent: What Makes KV Cache Offloading Work for Concurrent Agents?

Kunming Shao, Jierun Chen, Jiangnan Yu, Xiao-Hui Li, Chaofan Tao, Yanli Wang, Huanxin Lin, Kwang-Ting Cheng, Chi Ying Tsui, Haoli Bai

arXiv preprintFirst author arXivCode

PQ-HSA: Reusing Product-Quantized Scores for Hybrid Sparse-Approximate Attention

Kunming Shao, Jierun Chen, Yanli Wang, Ruoyu Wang, Haoli Bai, Kwang-Ting Cheng, Chi Ying Tsui

arXiv preprintFirst author arXivCode

PQ-SIM

Kunming Shao, et al.

IEEE Asian Solid-State Circuits Conference (A-SSCC)First author

HyMoE-CIM: A Hybrid-Bit SRAM/ReRAM CIM Architecture with Hardware-Aware Token Dispatch for Mixture-of-Experts LLM Inference

Zhibiao Xue, Xu Chen, Kunming Shao, et al.

IEEE International Conference on Computer Design (ICCD)

SwiftCIM: a 55nm 23.2μJ/Token L-0.5 ReRAM Coupled Digital CIM Accelerator with Fully-Fused Multi-Head Attention Dataflow for FlashAttention

Kunming Shao, Xiaomeng Wang, et al.

IEEE European Solid-State Electronics Research Conference (ESSERC)First author Paper

Balancing FP8 Computation Accuracy and Efficiency on Digital CIM via Shift-Aware On-the-fly Aligned-Mantissa Bitwidth Prediction

Liang Zhao, Kunming Shao, Zhipeng Liao, Xijie Huang, Tim Kwang-Ting Cheng, Chi-Ying Tsui, Yi Zou

IEEE Transactions on Very Large Scale Integration (VLSI) Systems (TVLSI)Co-first author arXiv

DS-CIM: Digital Stochastic Computing-In-Memory Featuring Accurate OR-Accumulation via Sample Region Remapping for Edge AI Models

Kunming Shao, Liang Zhao, Jiangnan Yu, Zhipeng Liao, Xiaomeng Wang, Yi Zou, Tim Kwang-Ting Cheng, Chi-Ying Tsui

Design, Automation & Test in Europe Conference (DATE)First author arXiv

Configurable Dataflow and Adaptive Mapping Optimization for Hybrid ReRAM and SRAM Compute-in-Memory Accelerator

Jingyu He, Xiaomeng Wang, Kunming Shao, Kwang-Ting Cheng, Chi-Ying Tsui

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) Paper

Lemem: A 179.8TFLOPS/W, 24.21TFLOPS Learning-In-Memory Processor with Layer-Fused Forward/Backward Pipeline for Edge DNN/SNN Training/Inference

Fengshi Tian, Kunming Shao, Jiakun Zheng, Zilu Liu, Hui Wu, Zhipeng Liao, Jingyu He, Xihao Guan, Pingcheng Dong, Chaoming Fang, Ziyang Shen, Shiqi Zhao, Jie Yang, Mohamad Sawan, Chi-Ying Tsui, Kwang-Ting Tim Cheng

IEEE Asian Solid-State Circuits Conference (A-SSCC) Paper

A Memory-Efficient Retrieval Architecture for RAG-Enabled Wearable Medical LLMs-Agents

Zhipeng Liao, Kunming Shao, Jiangnan Yu, Liang Zhao, Tim Kwang-Ting Cheng, Chi-Ying Tsui, Jie Yang, Mohamad Sawan

IEEE Biomedical Circuits and Systems Conference (BioCAS)Co-first author arXivPaper

DIRC-RAG: Accelerating Edge RAG with Robust High-Density and High-Loading-Bandwidth Digital In-ReRAM Computation

Kunming Shao, Zhipeng Liao, Jiangnan Yu, Liang Zhao, Qiwei Li, Xijie Huang, Jingyu He, Fengshi Tian, Yi Zou, Xiaomeng Wang, Tim Kwang-Ting Cheng, Chi-Ying Tsui

IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED)First author arXivPaper

A Flexible Precision Scaling Deep Neural Network Accelerator with Efficient Weight Combination

Liang Zhao, Kunming Shao, Fengshi Tian, Tim Kwang-Ting Cheng, Chi-Ying Tsui, Yi Zou

IEEE International Symposium on Circuits and Systems (ISCAS)Co-first author arXivPaper

E-NPU: A 34~126nJ/Class Event-Driven Adaptive Neural SoC with Signal-Dynamics-Aware Feature Clustering and Multi-Model In-Memory Inference/Training for Personalized Medical Wearables

Fengshi Tian, Jinbo Chen, Kunming Shao, Zilu Liu, Jiakun Zheng, Hui Wu, Chaoming Fang, Xiaomeng Wang, Ziyang Shen, Pingcheng Dong, Yuan Yao, Xuliang Wang, Jie Yang, Mohamad Sawan, Chi-Ying Tsui, Kwang-Ting Cheng

IEEE Custom Integrated Circuits Conference (CICC)Co-first author Paper

SynDCIM: A Performance-Aware Digital Computing-in-Memory Compiler with Multi-Spec-Oriented Subcircuit Synthesis

Kunming Shao, Fengshi Tian, Xiaomeng Wang, Jiakun Zheng, Jia Chen, Jingyu He, Hui Wu, Jinbo Chen, Xihao Guan, Yi Deng, Fengbin Tu, Jie Yang, Mohamad Sawan, Tim Kwang-Ting Cheng, Chi-Ying Tsui

Design, Automation & Test in Europe Conference (DATE)First author arXivPaper

ReSCIM: Variation-Resilient High Weight-Loading Bandwidth In-Memory Computation Based on Fine-Grained Hybrid Integration of Multi-Level ReRAM and SRAM Cells

Xiaomeng Wang, Jingyu He, Kunming Shao, Jiakun Zheng, Fengshi Tian, Tim Kwang-Ting Cheng, Chi-Ying Tsui

IEEE/ACM International Conference on Computer-Aided Design (ICCAD) Paper

AutoDCIM: An Automated Digital CIM Compiler

Jia Chen, Fengbin Tu, Kunming Shao, Fengshi Tian, Xiao Huo, Chi-Ying Tsui, Kwang-Ting Cheng

ACM/IEEE Design Automation Conference (DAC) Paper