Are you saying the outside wall of the slide is not plumb, or parallel with the main wall? If so, that is the shape of the slide box. It has to do with sealing when the slide is closed, I believe.
Have you checked the seal inside when the slide is extended? It it against the inside wall all the way around?