Compute! magazine "was published from 1979 through September 1994. It covered every major platform until it became a PC-only publication in May 1988" according to atariarchives.com.
It did not have a specific Color Computer section, but since it was designed for the typical home user of the time, the programs published were occasionally offered in Color Computer form.
There was a variant of Compute! named Compute!'s Gazette, which was only for the Commodore line of computers.