The craziest hand ever. Bad decision? Ballys $1-$2

Crazy interesting hand. Five handed. Button straddles for $5. UTG blind raises to 15, action starts on me. I call the $5 button straddle, big blind shoves all-in for $140. UTG pulls his bet back and folds. So now the big blind flips out, floor rules that because the action changed, UTG was able to take his bet back. So now BB throws his cards face up on the table, picks up his chips and starts to walk away.  As he's walking away, dealer takes his hand, and places it on top of the muck. I tell the guy "that money is in the pot, he cant take it off the table." So he walks back throws the money on the table and button folds. Action gets back to me. I say, "I'm the only one with a hand, that money is mine." Floor decides that because the hand was tabled, and is 100% retrievable, his hand is live. I argue that his hand was dead, because it was in the muck, and he left the table. After a few minutes of arguing, I decide to let the guy have the pot. (I ended up stacking him two hands later. Karma.)