Really, don’t look any further.
You have two options. Windows’ own powershell or Ubuntu. That is it.
Ubuntu looks nicer out of the box. But powershell also does the job. Compared to my previous experience with PuTTY (a free SSH and telnet client on Windows 7) – everything is smoother than PuTTY.