Some glue elastic to the inside of the hand plate which then goes around the glove, you could also attach Velcro to the glove and hand plate, I find E6000 to hold really well.
The more times you put on armor the easier it gets, I practiced about half a dozen times before my first troop, then got there and realised I had been practicing with everything set out on a table and when I got to the trooper and there wasn't any tables
I get kitted up these days within 5 minutes, definitely gets easier