In all my searching I have been unable to find any book which covers the symbolism of colors exclusively. All I can offer here are references to sections in other books.
Clement, Clara Erskine. A Handbook of Christian Symbols and Stories of the Saints.
Ferguson, George. Signs and Symbols in Christian Art.
Forstner, Dorothea. Die Welt der Symbole.
Hall, James. Dictionary of Subjects and Symbols in Art.
Sill, Gertrude Grace. A Handbook of Symbols in Christian Art.
Vries, Ad de. Dictionary of Symbols and Imagery.
Whittick, Arnold. Symbols, Signs and Their Meaning.
From the listing on Liturgical Symbols
Durandus, William. The Symbolism of Church and Church Ornaments.
Horn, Edward T.III. The Christian Year.
Kleinhans. Theodore J. The Year of the Lord.