Thanks for the detailed feedback! :)
I've heard this issue a few times now so I already added an input buffer to the current build which I'm going to upload whenever the game jam unlocks uploads.