Do I ollie wrong or is it my board?

I have a skateboard that is warped. By warped I mean like if you took a popsicle stick on the ends beween your thumb and index fingers then twisted each hand opposite directions. All of the wheels never touch the ground all at once; at max 3. It is not too bad but great enough to affect your balance. The board is cheap so the kicktails wore down fast and there is not much pop. Could this affect my ability to learn the ollie? I can only do it stationary, never get very high (board has little pop) and the board always swings in odd directions so I have to shift position in the air like a shuvit. Is this the board or just me? Could this board make me learn it wrong? Are there any other reasons why the board could be swinging out?