If being a vigilante and killing a murderer can get you arrested...?

What you just described has all the elements of premeditated murder, and yes, the person would be arrested. It would be up to a jury to decide his fate.