Smells are the strongest memory revokers though. That is why I suggested the blind test. If he was wearing it, it may trigger a reaction even though you didn't consciously smell it.
I think a trip to the perfumery is due..