After the cutscene where Kanbei promises to make Naoie an offer he can’t refuse, you’ll get to choose between Naoe and Yasuke. Pick Yasuke, and head on inside. There’s a bunch of guards around, but keep off the weaponry a minute, don’t start nothing with these initial guys, won’t be nothing.