绿色深度学习

Green Deep Learning——许晶晶，字节AI Lab

https://www.iqiyi.com/v_ht1oevcbiw.html

计算量爆炸问题

image-20210703142252609

image-20210703142432020

image-20210703142806315

image-20210703142904007

image-20210703143034504

image-20210703143143352

image-20210703143222250

image-20210703143254507

image-20210703143510434

词表

image-20210703143837990

如何生成最优的词表

image-20210703144112341

最后一个是主流的选择。第一个会出现稀疏单词的问题Rare words，第二个是Too long sequence。

image-20210703144329752

image-20210703144515413

image-20210703144614672

image-20210703144623490

最大边际效应

image-20210703144843745

image-20210703144934583

image-20210703144943048

image-20210703145020667

image-20210703145043686

image-20210703145310680

每种搬运方式对应一种词表

image-20210703150001421

image-20210703145656779