File:RWKV block elements.png
Size of this preview: 504 × 599 pixels. Other resolution: 514 × 611 pixels.
Original file (514 × 611 pixels, file size: 55 KB, MIME type: image/png)
Summary
| Description | English: On the left, you can see the individual components of the RWKV block, and on the right, the RWKV residual block with a final head designed specifically for language modeling. |
| Date | 2023 |
| File source | https://arxiv.org/abs/2305.13048 |
| Author | Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Huanqi Cao, Xin Cheng, Michael Chung, Matteo Grella, Kranthi Kiran GV, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Xiangru Tang, Bolun Wang, Johan S. Wind, Stansilaw Wozniak, Ruichong Zhang, Zhenyuan Zhang, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu |
Licensing
|
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 06:08, 11 October 2023 | | 514 × 611 (55 KB) | AmirhosseinAbaskohi (talk | contribs) | Uploaded a work by Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Huanqi Cao, Xin Cheng, Michael Chung, Matteo Grella, Kranthi Kiran GV, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Xiangru Tang, Bolun Wang, Johan S. Wind, Stansilaw Wozniak, Ruichong Zhang, Zhenyuan Zhang, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu from https://arxiv.org/abs/2305.13048 w... |
You cannot overwrite this file.
File usage
The following page uses this file:
