Some objects have a clear top, bottom, front, and back. For objects that have these, the "side" is either of the other two directions.

When you "lay" something "on its side", you put it in a position with the side facing down. For example, you can tip a bottle over and lay it on its side on a table.