Speaking English is very difficult for my.
Speaking English is very difficult for me.
My is a possessive adjective. Use it before a noun: ‘my car’, ‘my house’, ‘my name’.
After a preposition such as for, with, to or about, use an object pronoun: ‘for me’, ‘with him’, ‘to her’, ‘about them’.