Multiple isend, multiple irecv between two processes

If I send multiple tensors to another process, does the receiving process receive tensors by the order irecv is called?

Yes, if you use the same tag for the isend and irecv.