【Hackathon 5th No.12】为Paddle新增AdaptiveLogSoftmaxWithLoss API #713
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
GGBond8488
reviewed
Nov 6, 2023
| @@ -17,6 +17,8 @@ Paddle需要扩充API,新增 AdaptiveLogSoftmaxWithLoss API， | |||
| 调用路径为：`paddle.nn.AdaptiveLogSoftmaxWithLoss` 和 `paddle.nn.functional.adaptive_log_softmax_with_loss`。 | |||
| 实现Softmax快速近似计算的功能。 | |||
|
|
|||
| ## 2、功能目标 | |||
There was a problem hiding this comment.
功能目标写上吧，写上这个API具体会做哪些事情，并补充计算公式
| |提交作者<input type="checkbox" class="rowselector hidden"> | PeachML | | ||
| |提交时间<input type="checkbox" class="rowselector hidden"> | 2022-03-22 | | ||
| |提交作者<input type="checkbox" class="rowselector hidden"> | liethann | | ||
| |提交时间<input type="checkbox" class="rowselector hidden"> | 2023-10-20 | |
| `paddle.nn.functional.adaptive_log_softmax_with_loss(input, label, | ||
| in_features, n_classes, cutoffs, div_value=4.0, head_bias=False, name=None)`, 返回为`NamedTuple` 包含 `output` 和 `loss`字段 | ||
|
|
||
| - function API：`paddle.nn.functional.adaptive_log_softmax_with_loss(input, target, head_weight, head_bias, tail_weights, cutoffs, shortlist_size)` 用于训练计算 |
|
已经有 RFC 合入了，如果需要更新和完善，可以在原来的 RFC 上进行修改，感谢！ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
对之前放弃继续开发的AdaptiveLogSoftmaxWithLoss API的rfc进行修改，重新组织实现方式，将API分离为layer层和function，使API更易用，结构更清晰。并重新更换邮箱以解决pr中cla无法通过的问题