There is a Windows version of MySQL, but it is still MySQL, meaning it doesn't come with a nifty graphical interface. (of course, there are a few 3rd-party interfaces available)
Mainly, you run it from the command prompt, and it works pretty much the same as in Unix.