Have you put glue on the corners? And also note, there are often little issues that we see with our armor that others don't. Once you have the button plate painted and you suit is complete I bet no one will notice.
If it is a problem, try re-gluing, and use strong rare earth magnets to hold in place while curing.
Your GML will let you know if it needs to be fixed as well.