dump-env takes an .env.template file and some optional environmental variables to create a new .env file from these two sources. No external dependencies are used.
Why do we need such a tool? Well, this tool is very helpful when your CI is building docker (or other) images.
Previously we had some complex logic of encrypting and decrypting files, importing secret keys and so on.
Now we can just create secret variables for our CI, add some prefix to it, and use dump-env to make our life easier.
$ pip install dump-envThis quick demo will demonstrate the main and the only purpose of dump-env:
$ dump-env --template=.env.template --prefix='SECRET_ENV_' > .envThis command will:
- take
.env.template - parse its keys and values
- read all the variables from the environment starting with
SECRET_ENV_ - remove this prefix
- mix it all together, environment vars may override ones from the template
- sort keys in alphabetic order
- dump all the keys and values into the
.envfile
$ dump-env -t .env.template -p 'SECRET_ENV_' -p 'ANOTHER_SECRET_ENV_' > .envThis command will do pretty much the same thing as with one prefix. But, it will replace multiple prefixes. Further prefixes always replace previous ones if they are the same. For example:
$ export SECRET_TOKEN='very secret string'
$ export SECRET_ANSWER='13'
$ export ANOTHER_SECRET_ENV_ANSWER='42'
$ export ANOTHER_SECRET_ENV_VALUE='0'
$ dump-env -p SECRET_ -p ANOTHER_SECRET_ENV_
ANSWER=42
TOKEN=very secret string
VALUE=0In case you want to be sure that YOUR_VAR exists
in your environment when dumping, you can use --strict flag:
$ dump-env --strict YOUR_VAR -p YOUR_
Missing env vars: YOUR_VAROups! We forgot to create it! Now this will work:
$ export YOUR_VAR='abc'
$ dump-env --strict YOUR_VAR -p YOUR_
VAR=abcAny number of --strict flags can be provided.
No more forgotten template overrides or missing env vars!
You can use an env template as a source template by using the -s or --source argument. This will restrict any non-prefixed variables found in the environment to only those already defined in your template.
$ cat template.env
ANSWER=13
TOKEN=very secret string
VALUE=0$ export ANSWER='42'
$ dump-env --source=template.env
ANSWER=42
TOKEN=very secret string
VALUE=0You can still also use prefixes to add extra variables from the environment
$ export EXTRA_VAR='foo'
$ dump-env -s template.env -p EXTRA_
ANSWER=13
TOKEN=very secret string
VALUE=0
VAR=fooUsing the --strict-source flag has the same effect as defining a --strict flag for every variable defined in the source template.
$ export ANSWER='42'
$ dump-env -s template.env --strict-source
Missing env vars: TOKEN, VALUEIf you use dotenv-linter, you may want to disable quoted output:
$ dump-env -t .env.template -p SECRET_ --no-quote-values > .envBy default, dump-env quotes values with spaces and other special
characters to preserve compatibility with .env parsers.
You can expand ${VAR} references between values with the -i or --interpolate flag:
$ cat .env.template
DB_HOST=localhost
DB_URL=postgresql://${DB_HOST}:5432/mydb$ dump-env -t .env.template -p SECRET_ENV_ --interpolate
DB_HOST=localhost
DB_URL=postgresql://localhost:5432/mydbReferences are resolved after all sources are merged, so environment overrides are respected:
$ export SECRET_ENV_DB_HOST='db.internal'
$ dump-env -t .env.template -p SECRET_ENV_ --interpolate
DB_HOST=db.internal
DB_URL=postgresql://db.internal:5432/mydbValues are expanded once, in definition order. You need to define variables before referencing them.
A reference to an unknown variable is kept as a literal ${VAR}, and $$ produces a literal $.
$VAR and ${VAR} are equivalent - they both expand the variable VAR.
Braces are required when the text directly after the reference would otherwise be read as part
of the variable name:
${HOST}_SUFFIX expands HOST and appends _SUFFIX,
while $HOST_SUFFIX is a reference to a single variable named HOST_SUFFIX.
Templates need no quoting: ${VAR} is read from the file as-is.
For shell exports, the quoting picks who expands the reference:
$ export DB_URL="postgresql://${DB_HOST}:5432/mydb" # the shell expands it at export time
$ export DB_URL='postgresql://${DB_HOST}:5432/mydb' # dump-env expands it when it runsAdd --strict-interpolate to fail on undefined or malformed references:
$ export SECRET_ENV_APP_URL='https://${APP_DOMAIN}/api'
$ dump-env -p SECRET_ENV_ --interpolate --strict-interpolate
Unresolved references in: APP_URL ('APP_DOMAIN')Projects that use this tool in production:
You might also be interested in: