When and why did the color orange (and yellow and 'red') become associated with Buddhism? Buddhist religious figures often wear orange robes. 

And I think that orange is, also, associated with Buddhist religious buildings -- and other religious "stuff" (although this may be simply a coincidence that I have given meaning it does not have) -- things like fabric, prayer flags, and religious art in temples, and painting of religious structures and artistic adornments in religious structures.

When did the color orange become associated with Buddhism? Does this have any specific significance or meaning, and if so what is that meaning or significance?

Also, sometimes a yellow or red color is used instead in the a similar context. The yellow color often looks like just a use/weather faded orange, or a trick of photography and lighting, or a different shade of orange, that may not be meaningful. But the red color (as depicted below), however, seems to be an intentional choice.

Do either of these colors (yellow or red) these have different meanings than orange? And, when did these colors gain significance?

Is it simply derived from robes -- What is the meaning behind different robe colors? -- or is there more to it than that?



From here (Pixabay License - Free for commercial use - No attribution required).



From here (Pixabay License - Free for commercial use - No attribution required).



From here (Pixabay License - Free for commercial use - No attribution required).

Footnote Re Color Terminology 

While this question, as edited, is not predominantly about robes as that has already been answered, the photographs above are primarily included to illustrate the colors that I am talking about as I am art terminology illiterate. I have used the primary color names orange, yellow and red because I have a thin vocabulary of colors and no art background (I haven't taken an art class since I was 13 years old, and I'm now more than three decades older than that). If that is not the proper name of the relevant colors feel free to correct me.
The oldest Buddhist robe color we know of is yellow/orange. The original monks made their robes from discarded cloth found in rubbish and on cremation grounds. After washing, the robe-cloth was boiled with vegetable matter—leaves, roots and flowers—and often spices, which would turn the cloth some shade of orange. Hence the name, "saffron robe." 

The tradition stuck and yellow/orange is now the color of choice for Theravada Buddhists in Southeast Asia, as opposed to a maroon color for Chinese and Tibetan monks. This has various reasons: first, the climate is very different,so the natural dyes of South-East Asia are not found in Tibet. The harsher climate also means that the traditional triple robe would offer little protection from the elements. The second reason is traditional robes expose the arms and shoulders, which was deemed unseeming in Chinese culture. So monks began to wear a long robe with sleeves that fastened in the front, similar to robes worn by Taoist scholars. The robes worn by Tibetan monks are derived from a mixture of the clothing "rules" from the traditional robes and Tibetan &amp; Chinese "dress code".

Japanese and Korean Buddhist monks also wear robes styled after the clothing traditions of their culture. In Japanese culture, red is associated with power and blood, and yellow is associated with nature. Shinto priests predominantly wear black, so this became the most common color for Buddhist robes in Japan.