TORCH_WARN("Both fused kernels do not support non-zero dropout.");

1

Couple of questions.

  1. What kernels are referred to in the following line
    TORCH_WARN(“Both fused kernels do not support non-zero dropout.”);
    from
    pytorch/aten/src/ATen/native/transformers/sdp_utils_cpp.h at 51f91e3428be9201e9c1199ec704bc132f979955 · pytorch/pytorch · GitHub

  2. Is there a way to see what attention kernel torch picked up for running ?