Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks.

Charbel Sakr Naigang Wang Chia-Yu Chen Jungwook Choi Ankur Agrawal Naresh R. Shanbhag Kailash Gopalakrishnan Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks. 2019 ICLR (Poster) https://openreview.net/forum?id=BklMjsRqY7 conf/iclr/2019 db/conf/iclr/iclr2019.html#SakrWCCASG19