I use VirtualBox (via Docker Machine) to host Docker daemon in OS X, and always set $DOCKER_TLS_VERIFY, $DOCKER_HOST and $DOCKER_CERT_PATH env vars to specify the destination Docker client accesses to.
I think these variables can be alternative to TOML.