Update: I just ripped the lining a bit where the dress doesn't fit me (hip area) and now the dress fits like a glove. It's not visible I ripped the lining, but maybe I'll ask a seamstress to add some lining so it will look a bit more neat when you see it inside out.
Also, I closed the slit/split at the rear. I was showing a bit too much skin with that! ;)