should the oleh answer chazak chazak v'nischazeik?

The Ketzos haShulchan writes that when the baal koreh finishes the parsha at the end of a sefer, the oleh should not answer "chazak chazak v'nitchazeik" along with everyone else.  Doing so creates a hefsek between the kriah and the final bracha, and secondly, we are the ones saying "chazak" to the oleh, to give him chizuk.  It makes no sense for him to chime in and say it to himself.  This is also the view of R' Elyashiv, but others disagree (see here).