As I could not use $USER, I changed my idea.
I want to let user choose between 3 colorsets in my theme. So know, I look for this preference only in the layout page. Than I add a class to body : colorset1 or colorset2 ou colorset3.
So, the css is unique and does not change for each user. It can be cached without problems.