peculiar

I like him because his music is rather peculiar.
I like him because his music is rather unusual.

Peculiar means ‘strange or unusual’, often in a way that seems unpleasant or worrying: ‘There was a peculiar smell in the room.’

The purple sentence is possible, but unusual is clearer if we simply mean that his music is different from other music.