For 20 years we have known that average values of characteristic polynomials of random unitary matrices provide a good model for moments of the Riemann zeta function. Now we consider mixed moments of characteristic polynomials and their derivatives, calculations which are motivated by questions on the distribution of zeros of the derivative of the Riemann zeta function.