No not with just css. But you could inject some js with a markdown component that dynamically generates styles to add the color based on label, with python logic that can use the priority to choose what label has what color.
Used it for something similar here
Are you familiar enough with css/ js injection to find it on your own? i can give a more fleshed out example tmw