|
About the autograd category
|
|
0
|
4027
|
May 13, 2017
|
|
Function 'Scaled Dot Product Efficient Attention Backward0' returned nan values in its 0th output
|
|
13
|
2096
|
February 9, 2026
|
|
RNN memory management: RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation
|
|
2
|
24
|
February 6, 2026
|
|
About the sign of gradients from token probability w.r.t. intermediate activations during inference
|
|
1
|
31
|
January 12, 2026
|
|
Using `forward_pre_hook` to attribute CUDA OOMs to module execution context
|
|
2
|
45
|
January 8, 2026
|
|
PyTorch CPU RAM Usage Grows Rapidly When Assembling Forces from CNN Output—How to Prevent Memory Leak?
|
|
0
|
38
|
December 11, 2025
|
|
Simple extension of autograd saved tensor hook mechanism
|
|
4
|
39
|
December 10, 2025
|
|
Does scaled_dot_product_attention's backward support reproduce
|
|
0
|
27
|
December 10, 2025
|
|
How to make a manually changed loss work in backpropagation
|
|
1
|
40
|
December 3, 2025
|
|
torch.autograd.Function and free function
|
|
2
|
49
|
December 3, 2025
|
|
Autograd and dead-code elimination
|
|
2
|
86
|
November 18, 2025
|
|
Does PyTorch muon optimizer supports 4D weights?
|
|
1
|
85
|
November 17, 2025
|
|
Gradient ascent on some parameters while descent on others in a single model
|
|
3
|
75
|
November 11, 2025
|
|
Batchnorm and back-propagation
|
|
8
|
4050
|
November 3, 2025
|
|
How to debug origin of nans in gradient of custom module
|
|
3
|
68
|
October 29, 2025
|
|
Optimizing a mask instead of weights
|
|
2
|
70
|
October 27, 2025
|
|
PyTorch AD with non-python functions
|
|
1
|
42
|
October 22, 2025
|
|
Brenier maps in Pytorch
|
|
1
|
56
|
October 18, 2025
|
|
Updating Selected parameters in each epoch
|
|
1
|
39
|
October 17, 2025
|
|
No grad & Autocast not working together
|
|
1
|
45
|
October 14, 2025
|
|
How to do back propagation with loss = ||f_{\Theta + \Delta P}(X) - Y||^2 + ||\Delta P||^2 instead of the usual loss = || f_{\Theta + \Delta}(X) - Y ||^2?
|
|
2
|
44
|
October 14, 2025
|
|
"RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.FloatTensor [64, 1]], which is output 0 of AsStridedBackward0, is at version 3; expected version 2 instead. Hint: the backtrace further a
|
|
10
|
33260
|
October 9, 2025
|
|
Defining loss that maximizes separation
|
|
0
|
44
|
October 1, 2025
|
|
Ablation Hook I created seems to affect the calculations of the gradients on later layers
|
|
5
|
78
|
September 30, 2025
|
|
How do I set the order of pytorch hooks?
|
|
5
|
82
|
September 29, 2025
|
|
Updating tensors that are used in backpropagation but are not network parameters
|
|
2
|
87
|
September 20, 2025
|
|
Making autograd saved tensors hooks specific to certain arguments
|
|
8
|
284
|
September 17, 2025
|
|
what happens when I use torch.profiler.profile with activities=[torch.profiler.ProfilerActivity.CPU, torch.profiler.ProfilerActivity.CUDA]
|
|
1
|
515
|
September 16, 2025
|
|
Autograd engine thread creation
|
|
2
|
82
|
September 8, 2025
|
|
Solving PDEs using neural networks
|
|
1
|
2468
|
September 5, 2025
|