How to replace a layer with own custom variant?

[phucdoitoan]

How to Replace a layer or Module in a pretrained network?

Just in case people find this useful, you can replace specific layers in a pretrained network with your customed layer iteratively as follow (or modify it according to your need). def replace_module(module, target_name, new_module): for child_name, child_module in module.named_children(): if target_name in child_name: setattr(module, child_name, new_module) else: replace_module(child_module, target_name, new_module) # example: t5_model = T5ForConditi…