Here is the answer of the networkmanager team if someone want to explore the problem. https://gitlab.freedesktop.org/NetworkManager/NetworkManager/-/issues/802