Skip to content

Commit

Permalink
change index import
Browse files Browse the repository at this point in the history
* use pd.read_csv instead of _fwf (much faster)
* verified that Hirise EDR fix is not necessary anymore due to using csv
* add chunked reading for further speedup
* add progress bar

fixes #62
  • Loading branch information
michaelaye committed May 7, 2024
1 parent 85894c9 commit 60f4d62
Show file tree
Hide file tree
Showing 6 changed files with 405 additions and 126 deletions.
14 changes: 13 additions & 1 deletion notebooks/api/01_utils.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -762,9 +762,21 @@
],
"metadata": {
"kernelspec": {
"display_name": "plpy",
"display_name": "Python 3 (ipykernel)",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.9"
}
},
"nbformat": 4,
Expand Down
Loading

0 comments on commit 60f4d62

Please sign in to comment.