Fortunately, my sister Rachel likes really flat pillows, and she had me remove some stuffing from some pillows that came with a couch they bought. So I had leftover stuffing to replace the fabric scraps that weren't working.
It's going to be an immensely satisfying to not have this on my to do list! The whole thing will probably take half an hour, but I just haven't gotten to it.