That was the Muramasa Blade. A katana forged from a portion of Logan's soul. He also killed Omega Red with it. The irony though is that after Logan and Victor both escapes Hell, Logan found Creed on his birthday and whooped him along with a bunch of other villains including Mystique, his son Dalen,a Rock Troll named Roughhouse and a bunch of others.