Alright, here is the alteration. Now, luckily I had enough of the silk left over so I could do the alteration and didnt have to buy more.

I did have to redraft the pattern piece for the front so I could extend the shoulders about 3/4 an inch.
I tried to reuse as much as I could, and I managed to reuse the facing pieces, but added on to the bottoms.

Here is the back shoulders and you can see I added a small piece so I could extend the shoulders a bit.

Now that I have the fit worked out, I do intend to make this dress again.