Wouldn't they have just let Jang Dong-gun's brothers go in Taegukgi?

In Taegukgi, when Jang Dong-gun and Won Bin's brothers tried to go home, the soldiers absolutely refused to let them go. Why didn't they just let them go? I feel like it would have been better if they had just let them leave when they said they were getting off..