ADF demo - UGA

Challenge

Goal: Describe how the following integration job may be accomplished using any Azure components (must include Azure Data Factory as at least part of the solution). Job steps:

1. Obtain json data from an external REST endpoint – lets assume the json structure returns as follows:

    {
      "name": "France",
      "capital": "Paris",
      "population": 67364357,
      "area": 551695,
      "currency": "Euro",
      "languages": [
        "French"
      ],
      "region": "Europe",
      "subregion": "Western Europe",
      "flag": "https://upload.wikimedia.org/wikipedia/commons/c/c3/Flag_of_France.svg"
    },
    {
      "name": "Germany",
      "capital": "Berlin",
      "population": 83240525,
      "area": 357022,
      "currency": "Euro",
      "languages": [
        "German"
      ],
      "region": "Europe",
      "subregion": "Western Europe",
      "flag": "https://upload.wikimedia.org/wikipedia/commons/b/ba/Flag_of_Germany.svg"
    },
    {
      "name": "United States",
      "capital": "Washington, D.C.",
      "population": 331893745,
      "area": 9833517,
      "currency": "USD",
      "languages": [
        "English"
      ],
      "region": "Americas",
      "subregion": "Northern America",
      "flag": "https://upload.wikimedia.org/wikipedia/commons/a/a4/Flag_of_the_United_States.svg"
    },
    {
      "name": "Belgium",
      "capital": "Brussels",
      "population": 11589623,
      "area": 30528,
      "currency": "Euro",
      "languages": [
        "Flemish",
        "French",
        "German"
      ],
      "region": "Europe",
      "subregion": "Western Europe",
      "flag": "https://upload.wikimedia.org/wikipedia/commons/6/65/Flag_of_Belgium.svg"
    }
  ]

2. Add todays date as an additional attribute to every object within the json
3. Join this data to an on-premises SQL server table on the ‘name’ attribute. Besides having a corresponding ‘name’ attribute within the on-premises table, the structure of this table is irrelevant.
4. The current data is encoding in UTF-8 but we want to make it available via ISO-8859-1.
5. Make the resulting data accessible to external users via a REST interface
6. In parallel, convert the resulting data to xml and save in blob storage.
7. In parallel, save the resulting data to an accessible Fabric workspace.

I don’t expect you to actually do this and produce a project. What I am looking for is your ability to understand what is being asked, to research available information to determine what Azure resources are useful at each step, what Azure Data Factory steps you might use, and to determine your ability to think logically. I don’t actually expect a correct answer, I just want to understand your train of thought. Therefore, show your work! The closer you can get to a workable (or partially workable) solution the better.