In a sense, fantasy is a freer play of the imagination. You can achieve exactly the situation you want with less groundwork, less of a need to fill in all of the background. For science fiction, I would use a lot of sources to set up, for instance, what a being from another planet would be like.