You need to think about the final use of your print.
If you plan on printing and matting it, crop your picture so that the .25 inch that fits under the mat on each side won't hurt the composition.
Note that the display area for prints with a mat is less than the nominal size.
4 x 5 -> 3.5 x 4.5
8 x10 -> 7.5 x 9.5
11 x 14 -> 10.5 x 13.5
16 x 20 -> 15.5 x 19.5
You may even find it necessary to resize the picture to the final format and
add a tiny border.
For example, I have just printed a picture of a Ukrainian church for a competition and in the original picture the cross on the top of the church was close to the margin. OK but close.
If I had just resized the picture to 11x 14 the .25 inch lost at the top under the mat would have caused the cross to crowd the top edge so I resized to 11 x 13.80 and added a .20 inch border at the top. In this case the border was sky color.
You can get in the habit of editing so the composition fits perfectly into a 15.5 x 19.5 rectangle- this will print well at any frame size from 4 x 5 to 16 x 20. However, I resize and sharpen at the target size.
The argument of cropping for the composition is ideally correct but costly if you plan on printing, matting and framing. I view the 4 x5 aspect ratio as ideal for most portraits and view that as just one more goal to shoot for.