The family of a man with Down's syndrome who died in hospital after reportedly being left without food said they are heartbroken.