没有合适的资源?快使用搜索试试~ 我知道了~
isscc 2023 v16 efficient computing in memory
需积分: 4 3 下载量 113 浏览量
2023-03-16
16:34:30
上传
评论
收藏 59.83MB PDF 举报
温馨提示
试读
315页
isscc 2023 v16 efficient computing in memory
资源推荐
资源详情
资源评论
ISSCC$$ 2023
SESSION&16
Efficient'Comput e-In-Memory'
Based'Processors'for'ML
16.1: MulTCIM: A 28nm 2.24μJ/Token Attention-Token-Bit Hybrid Sparse Digital CIM-based Accelerator for Multimodal Transformers
© 2023 IEEE
International Solid-State Circuits Conference
1 of 48
MulTCIM: A 28nm 2.24μJ/Token Attention-Token-Bit
Hybrid Sparse Digital CIM-based Accelerator for
Multimodal Transformers
Fengbin Tu, Zihan Wu, Yiqi Wang, Weiwei Wu, Leibo Liu, Yang Hu,
Shaojun Wei, Shouyi Yin
Tsinghua University, Beijing, China
16.1: MulTCIM: A 28nm 2.24μJ/Token Attention-Token-Bit Hybrid Sparse Digital CIM-based Accelerator for Multimodal Transformers
© 2023 IEEE
International Solid-State Circuits Conference
2 of 48
Outline
Motivation
MulTCIM Accelerator Features
Long Reuse Elimination Scheduler
Runtime Token Pruner and Modal-Adaptive CIM Network
Effective Bitwidth Balanced CIM
Measurement Results
Conclusion
16.1: MulTCIM: A 28nm 2.24μJ/Token Attention-Token-Bit Hybrid Sparse Digital CIM-based Accelerator for Multimodal Transformers
© 2023 IEEE
International Solid-State Circuits Conference
3 of 48
Multimodal Transformers are Promising
[NeurIPS’19] ViLBERT for Video Question Answering
Human Perception is Multimodal
Multimodal AI Tasks
[NeurIPS’21] MBT for Video Classification
16.1: MulTCIM: A 28nm 2.24μJ/Token Attention-Token-Bit Hybrid Sparse Digital CIM-based Accelerator for Multimodal Transformers
© 2023 IEEE
International Solid-State Circuits Conference
4 of 48
Prior Work1: Digital Transformer Accelerator
Transformers require specialized hardware architecture.
The digital Transformer accelerator (ISSCC’22) utilizes
approximate computing for tokens to improve efficiency.
ISSCC’22-29.2
剩余314页未读,继续阅读
资源评论
netshell
- 粉丝: 11
- 资源: 185
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功