I received an email from Amazon last Oct warning me for further consequences because I had a little too much order cancellations frequently, so I understand if you don't want to cancel an order unless it is really important.
I paid for the lpg booking yesterday in the very exact way that you're looking for. However, my Amazon Pay wallet was almost empty, so I was able to buy and add a gift card for the exact amount needed (lpg price - 500). So at the payment page, I was only needed to pay ₹500 which I paid using the Rupay Platinum DC. Also, the Amazon app wasn't allowing partial payment through the wallet, so I switched to the website and it worked.
Another way is to buy voucher from MyJio app, and pay using Amazon Pay wallet. That way, your wallet balance will be utilised and you can use or transfer that voucher to anyone else if needed. And if all this seems too much, then the last option is to place an Amazon order and then cancel it later as suggested by others here.
Order an item worth 149 before making bill payment and then cancel it post making the payment