As a bike rider/sidecar driver I want to be seen in bad weather or when broken down on some autobahn; Dayglo Orange
When rough camping I want to be invsible; no Dayglo, Khaki.
When going through borders where there might be stupid people with guns I don't want to look like the dictator next doors stupid people with guns; no khaki, white.
When it's a hundred and ten in shade I'd like to avoid having my lunch melt: white
I don't want the poor chaps who live under said dictator to think I'm giving too much away: White with any light blue is out, go red.
When the outfit is under a foot of snow it's nice to be able to find it: dayglo red
Any choice is a compromise. I wouldn't spend too much time on it. Avoid the military look and pick something that'll blend in when filthy but can be made to stand out with a clean. Off white sounds OK.