No?I only talked to him once.
It was a guess based on what you said last time we talked about it.
Other options:
no subject
No?
I only talked to him once.
'Talk' used loosely of course.
It was a guess based on what you said last time we talked about it.