You did what you needed to do.
The reason why all 3 don't move together is simple: that settings panel is for being able to adjust all 3 of the colors in one place. It's giving you the ability to adjust any of the 3. Your confusion comes from the fact that you went into that panel with the goal of adjusting all 3 to the same color.