[gentoo-hardened] hardened workstation - is that worth it?

[Jan Klod]

Suppose, I want to take some extra precautions and set up PaX&co and MAC on a 
workstation with Xorg and other nice KDE apps (only some of which should be 
granted access to files in folder X). I would like to read others opinion, if 
I can get considerable security improvements or I will have to make that much 
of exceptions to those good rules, as it makes protection too useless?

Regards,
Jan