Do the number of color channels in your dataset impact the input shape of the convolution layer?
The number of color channels also referred to as depth is one of the array inputs to the CNN.
As the number of epochs increases, the same number of times weights are changed in the neural network and hence it takes longer.