If you base a Dockerfile on this image:
FROM juptyerhub/jupyterhub-onbuild:0.6
...
then your jupyterhub_config.py adjacent to your Dockerfile will be loaded into the image and used by JupyterHub.
This is how the jupyter/jupyterhub docker image behaved prior to 0.6.