High ping issue with Xbox One

Hello!

Is this already solved somehow? I read about remarkably high pings with several xbox one users few years ago but did not notice how this was resolved. I bring this up because we are currently facing this problem. Network setting is optimized as far as I know (such as nat is OPEN, DNS and IPS are automatic, port is set to 3074). Ping is 60ms when running the test but when playing (Fortnite) ping is far more that 100ms (often 150). Connection is wired and is theoretically 500/500 (download/upload). Just updated the router, no difference between the old and the new one. The same (wired) connection gave ping around 15-20 in PC, so the problem is in the console end. Any suggestions?

:)