I had the same issue, just alt f4 and when you start it again just play fullscreen by pressing the fullscreen button
I thought I fixed this a while ago, it should be starting automatically in windowed fullscreen now, what OS are you on?
Windows 11 I guess
