That right there *is the alignment problem*.

If I task an AI with "peace on earth" and the solution the AI comes up with is ripped from The X-Files* and it kills everyone, it isn't good enough to say "that's cheating" or "that's not what I meant".

* https://en.wikipedia.org/wiki/Je_Souhaite