set -o vi

Activate the vi command set as your history editor type:
set -o vi

So that you can use [esc][hjkl] to move left, down, up, right between history.
also other vi command at command line.