-
Notifications
You must be signed in to change notification settings - Fork 0
Home
Havelovewilltravel is a project to automatically aggregate ConcertAnnouncements from gigfinder platforms such as Facebook, SongKick, BandsInTown and Setlist.fm. Artists and their references to these gigfinder platforms are maintained via Musicbrainz.
These platforms contain many ConcertAnnouncements, some of which are duplicated across the platforms. Havelovewilltravel does a best effort to automatically de-duplicate such ConcertAnnouncements into Concerts, which refer to the (multiple) ConcertAnnouncement(s).
Simultaneously, other information is also subjected to automatic best efforts to maintain data quality, i.e. venue/organisation information and location information.
However, despite these automatic data quality rules, some manual quality assurance is needed. The speed and quantity with which the information can be aggregated prohibits us from maintaining the data in spreadsheets. Therefore, we are developing a Data Management Tool for Concert Announcements.
"hlwtadmin" is a Python on Django web application that handles
- the automatic aggregation of concert announcements (via APIs and screenscraping),
- the automatic rule engine to improve data quality automatically, and
- a dashboard and tooling for manual Quality Assurance.
This tool is being developed by Tom and Quinten at Kunstenpunt, Belgium.
Data model
- Concert
- Artist
- ConcertAnnouncement
- Country
- Genre
- GigFinder
- GigFinderURL
- Location
- Organisation
- Organisation types model
- Venue
Relations
- Relation Concert - Artist
- Relation Concert - Organisation
- Relation Concert - Concert
- Relation Artist - Artist
- Relation Organisation - Organisation
- Relation Organisation - External Identifier
Semantics
- Organisation types semantics
- Concert - Organisation semantics
- Concert - Artist semantics
- Artist - Artist semantics
- Concert - Concert semantics
- Organisation - Organisation semantics
Merge functionalities
Automation
- Venue to Organisation
- Venue to Location
- Concert Announcement to Concert
- Delete concerts and ignore ConcertAnnouncements
- Delete concerts and delete ConcertAnnouncements
QA Lists and procedures
- Concerts without Organisations
- Concerts without Artists
- Organisations without Concerts
- Concerts with multiple organisations in different locations
- Organisations without latitude and longitude
- Organisations without genre
- Organisations without disambiguation
- Concerts without latitude and longitude
- Concerts without genre
- Concerts without titles
- Artists without genre
- Announcements wo/ concert
- Concerts wo/ announcements
- Venues wo/ organisation
- Organisations wo/ venues
- Organisations without locations
- Organisations without concerts
- Cities without countries
Batch operations
Development