I just learnt this from a cool YT video if you press F11(Fullscreen) and then again to disable fullscreen on windows 11's explorer, it becomes as fast as it should've always been.