The encoding section in the docker ruby image documentation explains how to change the locale and encoding for the image. By default, it uses C as locale so, to change the encoding, you can add this to your dockerfile:
C
ENV LANG C.UTF-8