Xbox turns on for a second then turns off immediately, also power brick has a orange light.

When you unplugged everything did you also unplug the power brick from the outlet?

Everytime I had power brick issues before upgrading to the Xbox One X I would have to unplug everything including the power brick from the wall and let it sit for a few minutes and then reconnect it all and it would sort it out.

You want to eliminate the actual issue and that could be either the console or the power supply. When you turn on the console, does the LED on the power supply change colors at all. Try another outlet and make sure to plug it directly into the wall,
not using a surge protector or power strip. Do you have any friends with an xbox one, if you do try their power supply on your console and your power supply on their console. This should identify the actual culprit. If you do not have availability of another
console, take your console to game stop, they will normally help with issues like this.

Orange is the right colour for your brick, when the Xbox turns on quickly do this

1. Turn off your console by holding the Xbox button  on the front of the console for approximately 10 seconds. The console will turn off.
2. Turn your console back on by pressing the Xbox button  on the console or the Xbox button  on your controller.

If you don't see the green boot-up animation when the console restarts, repeat these steps. Make sure that you hold the power button until the console completely shuts down.

Important If your console is in instant-on power mode, the above steps will shut the console off completely. Instant-on mode, or the ability to turn on your console by saying "Xbox on," won't be enabled until you restart the console.

The Xbox One has 2 power modes. The first is "Instant-On" mode in which the console is in a low power state in order to update in the background and boot-up in less than 10 seconds when you turn it on(Power Brick light is white when off)). The second option
is "Energy-Saver" and this results in the console turning completely off when you power it down. In this mode, the console does not update itself while off and it takes about a minute to boot-up the system when turned on (Power Brick light is orange when off).

Try doing a hard reset.... Hold down the Xbox power button for ten seconds until it powers off. When the power brick light turns orange you can turn your Xbox back on. Hope this helps.