I have difficulty to remember all the words in the lesson.
I have difficulty remembering all the words in the lesson.
I have difficulty in remembering all the words in the lesson.
Use have difficulty (in) + -ing, not have difficulty + to-infinitive.