New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于实现问题 #113

Open

wutongshu819274135 opened this issue Apr 5, 2022 · 2 comments

wutongshu819274135 commented Apr 5, 2022

看代码怎么感觉和论文中结构不一样啊，没看见有WH×（H+W-1）的结构啊

Auspiciouszzz commented Mar 2, 2023

请问你看懂了吗？看代码好难理解...

Zetianuser commented Mar 30, 2023

作者分为WHH和WWH两个结构，拼接之后就是了，然后在H当中采用对角线负无穷，在softmax中相当于隐去一项，就是WH（H+W-1）了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment