How can I see the source of guards?
I get stuff like:
[2024-02-09 20:55:17,752] [1/0] torch.fx.experimental.symbolic_shapes: [INFO] create_env
[2024-02-09 20:55:17,780] [1/0] torch.fx.experimental.symbolic_shapes: [INFO] create_symbol s0 = 2 for L['arg1_1'].size()[1] [2, 15] (_dynamo/variables/builder.py:1809 in <lambda>)
[2024-02-09 20:55:17,783] [1/0] torch.fx.experimental.symbolic_shapes: [INFO] create_symbol s1 = 2 for L['arg2_1'].size()[1] [2, 32766] (_dynamo/variables/builder.py:1809 in <lambda>)
[2024-02-09 20:55:17,786] [1/0] torch.fx.experimental.symbolic_shapes: [INFO] create_symbol s2 = 2 for L['arg3_1'].size()[1] [2, 32766] (_dynamo/variables/builder.py:1809 in <lambda>)
[2024-02-09 20:55:17,790] [1/0] torch.fx.experimental.symbolic_shapes: [INFO] create_symbol s3 = 2 for L['arg4_1'].size()[1] [2, 32766] (_dynamo/variables/builder.py:1809 in <lambda>)
[2024-
or something like:
[2024-02-09 20:54:31,191] [0/0] torch.fx.experimental.symbolic_shapes: [INFO] create_env
[2024-02-09 20:54:31,215] [0/0] torch.fx.experimental.symbolic_shapes: [INFO] create_symbol s0 = 2 for L['arg0_1'].size()[1] [2, 16] (_dynamo/variables/builder.py:1809 in <lambda>)
[2024-02-09 20:55:04,670] [0/0] torch.fx.experimental.symbolic_shapes: [INFO] produce_guards
but the source listed in parentheses is the dynamo code that generated the guard not the model code.