Just old and sturdy Godot 3.5. I am however using some shaders and tricks with layers/lights to give shadows a bit more depth, so maybe that's what causing it.
Appreciate your testing. You even made the gif! Thanks.
No problem, glad I could help.