Skip to content

Commit

Permalink
Initital release
Browse files Browse the repository at this point in the history
  • Loading branch information
Ivan Begtin committed Dec 13, 2021
1 parent f9a6a7d commit 2571f0c
Show file tree
Hide file tree
Showing 16,436 changed files with 49,555 additions and 2 deletions.
The diff you're trying to view is too large. We only load the first 3000 changed files.
8 changes: 8 additions & 0 deletions .idea/.gitignore

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

11 changes: 11 additions & 0 deletions .idea/artefactrudata.iml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 6 additions & 0 deletions .idea/inspectionProfiles/Project_Default.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 6 additions & 0 deletions .idea/inspectionProfiles/profiles_settings.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 4 additions & 0 deletions .idea/misc.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

8 changes: 8 additions & 0 deletions .idea/modules.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 6 additions & 0 deletions .idea/vcs.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

50 changes: 48 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,2 +1,48 @@
# artefactrudata
Repository with datasets from Artefact project (guide to Russian museums)
# Artefact.app dataset and source code
##English



### Source code

All data collected using APIBackuper tool (https://github.com/ruarxive/apibackuper) using apibackuper.cfg
for each dataset.

To download/update any of datasets go to dataset dir "artefact-orgs" and use command **run**
`apibackuper run full` to extract full dataset from source. Original JSON files will be stored to the "storage/storage.zip" file.

Use command **export** to get dataset from stored data `apibackuper export jsonl data.jsonl` file data will
be stored as **data.jsonl**

To download files from original source use command **getfiles** with apibackuper tool
`apibackuper getfiles`. It will store all files to the "storage/files" directory.


### Datasets
Data from Artefact.app project of the Ministry of Culture of Russian federation.
Collected for educational and scientific purposes by Infoculture (https://infoculture.ru) team.

All data collected as JSON lines files (*.jsonl) extension.

Source API: https://artefact.app/public_api/

List of datasets ("data/" dir):
* collections - collections of art
* projects - art projects
* subjects - art
* orgs - organizations (museums)
* tags - tags
* places - places, locations

For all "subjects" and "orgs" images downloaded from "topImage" attribute with ".jpg" file extension added.

Not yet processed:
- labels
- persons
- images

### Licenses

Source code and packaged data licensed under CC0-1.0 License.
Original content licensed under following terms https://artefact.app/terms.html
All IP rights on images belongs to museums published these images on Artefact.app.
3 changes: 3 additions & 0 deletions data/.gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
*.zip filter=lfs diff=lfs merge=lfs -text
*.jsonl filter=lfs diff=lfs merge=lfs -text
*.jpg filter=lfs diff=lfs merge=lfs -text
3 changes: 3 additions & 0 deletions data/collections/data.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions data/orgs/data.jsonl
Git LFS file not shown
3 changes: 3 additions & 0 deletions data/orgs/files/58da16079177e1543287cbb2.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/58f8c26c621ace456c2cb3ed.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5908902ca1374a9b763dac78.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59099d40a1374a9b763daec0.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/590b19dfa1374a9b763db9e8.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/592bf9d95a93481c74b33bed.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59367a7e5a93481c74b34323.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5938f76c5a93481c74b345e1.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/595603c6c12a77bc10e42f95.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/595a41f6fee96fb72fdfeaee.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/596909fbecfdc82e2331d995.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/598c3f8068b2a63c77f59bd7.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59941586ac9f0fbd3198192e.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/599c2a4bac9f0fbd3198344f.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59bf768e92056ab434cbd5b7.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59bfcb3e92056ab434cbd7e9.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59d23519c799c4e5051c64dd.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59f3128c97d8bed4466cc4bf.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/59f7253297d8bed4466ccc4c.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5a130d5497d8bed4466d6c15.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5a252e2f97d8bed4466dad06.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5a3a41488a3161050f0e5ec7.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5a65d6ad61cf4a3d714d5cb5.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5a72e04d1895d53951ff3924.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5ab6097c82f2e91b68f981bf.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions data/orgs/files/5ad1d3f2049a22611561a3f1.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5ad47300ee71a876033a23d6.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5ad5c15cee71a876033a25dc.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5ad9d8b5274b067067f8a9b3.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5ae45344d364ab680a747578.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5ae7542f07d9c9283c6fe8a9.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5af09076ad3455de52aa4ec8.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5af579306963519136851e12.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5afb010a0fbd6cc30679057c.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5afc07670fbd6cc30679073c.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5afe55e58e67bf7e054188a2.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b06912a9850678a650e03ec.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b06b9d69850678a650e04e4.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b06bdf59850678a650e054d.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b0d0f74849b4e6912287ed7.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b0e84a5f0b2db0034a70d2b.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b1628c652447bb6673b08df.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b17cae873e8a9cb24132799.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b279d36cf03e33e146eea5b.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b2cac2cc21a0cb5277c5ce6.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b46eb8e6ef0099e36528f94.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b4db5a0792042ac46468386.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b5720939bc083e211f68109.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b63de853f56410a7fef4b4f.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b801b076be6d1cd6e3df06e.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b83bc766be6d1cd6e3df252.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b97a0d8d2de59fd1708ba4c.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5b9bb5ae443cd2471375c65b.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5ba82f47b14f9557b919b721.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bace64f18f8fd0d0df033d8.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bc984e9a14788117ce65396.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bcdb93d6b98bb6551414060.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bcde0a46b98bb6551414155.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bcf7e6e4fc22f725de4b649.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bd1ad858f4f607276c26cd5.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bdb0ea04fc22f725de4d799.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5be1b40c11aff34ad7f4dc88.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5be59ae411aff34ad7f4ec71.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bea964b7522784aede7418f.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bebe6ce91c0d6061a11f10c.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5bed8771fc83900b6e2f694a.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5beeb6daeb77d809a1d97780.jpg
3 changes: 3 additions & 0 deletions data/orgs/files/5c0a30cef4dff4497199ce90.jpg
Loading

0 comments on commit 2571f0c

Please sign in to comment.