Little did he imagine that it would be such a challenge, 부정어 도치 문장

“Little did he imagine that it would be such a challenge”를 평서문으로 쓸 때 little은 어디에 두면 자연스러울까요?
“He little imagined that it would be such a challenge”라고 해도 맞나요?