How to check correctness of implementation?

I want to use captum to try to understand a fine-tuned language model using Integrated Gradients. I have an implementation that runs without raising any errors. Before looking at the results, what are good checks to tell me that my implementation is correct?