If you want to put the caption under your images, then you can make use of Image Caption wordpress plugin. This plugin extracts the title or alt attribute from images within your blog post and generates a neat caption directly underneath those images. Apart from that, it also supports custom CSS styling for captions.