If you would prefer Outlook to open a reply in a new window, this can be achieved by disabling inline replies. 

Switching this feature off also assists under-resourced machines, since it is more resource intensive for the workstation to do an inline reply rather than open the reply in a new Window. 

In Outlook go to File > Options > Mail and scroll down till you get to Replies and Forwards: