It is possible to include P tags inside a sidebar - I have seen this done before. Are you sure those P tags are contributing to the block being pushed downwards?
I have added
, but this has not resolved the issue.
Can you see a solution using CSS, as Magento Go does not allow you to edit the HTML of the templates, unfortunately.