There's no giant at all. What's washed ashore is just the corpse of a whale, as is suggested near the end by the narrator. And the story is told through the scientist's perspective, with his fantasy where the whale is imagined to be a giant. That explains all the other people's reaction.
Review of The Drowned Giant
