wip: debug sftp

README.md

@@ -117,4 +117,14 @@ If errors are encountered around `.so` files not found or incorrect architecture
 
 ```
 pip uninstall psutil && pip install --no-binary :all: psutil
-```
+```
+
+## Loading entity data 
+
+Run the following from the root of this repository:
+```
+cd data_processing/scripts/
+direnv allow
+```
+
+Make sure you have `direnv` and `sshpass` installed (these can be installed with a package manager such as homebrew).

data_processing/scripts/download_opencorporates.com.sh

@@ -0,0 +1,7 @@
+#!/bin/bash
+
+sshpass -p "${SFTP_PASSWORD}" sftp -q -P "${SFTP_PORT}" "${SFTP_USERNAME}@${SFTP_ENDPOINT}" <<EOF
+lcd .
+ls -l .
+bye
+EOF | grep -v "^sftp>" | awk '$1 ~ /^-/ {print $NF}'