Sorry to be so long. Missed this for some reason…
I copied your image to the clipboard, did file and new from clipboard in Preview (assuming you’re on a Mac), rotated the image and saved it as a png. Then uploaded it into the profile icon, resized the square, and hey-presto. (I think Preview on the Mac has some issues with setting the rotation of images when these are jpegs – not every other image reading program understands what it has done.) So I used a png.
So the upshot is – probably better to get the original file orientated, then upload.