Pybind11v3 support

I understand that PyTorch uses pybind11 internally. I am wondering if that usage will be moved to pybind11v3? It has attractive features such as support for dynamic attributes and py::smart_holder for managing references.

py::native_enum might also be nice.