Do they return the device afterwards like “oh well, here ya go then” durp durp. Or do they keep it “for evidence” out of spite?

I once met a guy who robbed a bank with a fake gun. (There was once an article somewhere but this was maybe 12 years ago.) He did some time in prison and he said they gave him the fake gun back afterwards.