As léonie says, the trusted 3rd party app PowerPhotos ($35) is the best choice, since it is so useful for other things, too-- even the free version.
If you don't need the captions to update in real time, then another useful way to show captions, on the Mac, is to use Print>Contact Sheet.

You can choose different sizes of pictures, and different numbers per page.
And you get lots of options for what appears under the pictures:

And you don't have to actually print, of course. You can save the result as a PDF

and keep it for future reference.
I've used this to send copies of old pictures with my descriptions to other family members for comments.
Would this work for you?