create_quickbase_spreadsheet.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Create Quickbase spreadsheet\n",
    "\n",
    "Quickbase is a database tool which is being used as part of the Collections Information inventory process.\n",
    "We want to load all the TEI records into Quickbase, without somebody having to copy/paste all the values manually.\n",
    "\n",
    "This is a [Jupyter notebook] (an interactive programming environment) that was written collaboratively to create a spreadsheet pre-populated with the TEI values.\n",
    "This spreadsheet can then be loaded into Quickbase to auto-populate the records.\n",
    "\n",
    "It's based on a draft list of fields here: <https://github.com/wellcomecollection/wellcome-collection-tei/blob/main/docs/export-for-quickbase/draft-table.MD>\n",
    "\n",
    "**Note to devs:** this code is designed to be readable for CI staff who are unfamiliar with Python, so I've tried to keep it simple, e.g. appending to a list rather than using list comprehensions.\n",
    "\n",
    "[Jupyter notebook]: https://jupyter.org"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# About the environment\n",
    "\n",
    "This is a Jupyter notebook, an interactive programming environment.\n",
    "It's divided into \"cells\", which can contain Markdown text (like this one) or code (like the one below).\n",
    "\n",
    "Each cell can be run repeatedly to get new results – when developers are writing code, we write it iteratively.\n",
    "Write something, try to see if it works, tweak it, try again, and so on.\n",
    "\n",
    "The code is written in a language called [Python] (named after [the comedy troupe], not the snake), which is a language designed to be easy to read.\n",
    "\n",
    "[Python]: https://www.python.org\n",
    "[the comedy troupe]: https://en.wikipedia.org/wiki/Monty_Python"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Hello world!\n",
      "Hello Cassidy, Tacey, Adrian, Yoshika!\n"
     ]
    }
   ],
   "source": [
    "print(\"Hello world!\")\n",
    "print(\"Hello Cassidy, Tacey, Adrian, Yoshika!\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# How we’ll write the script\n",
    "\n",
    "When we write scripts, we don’t write them all in one go; instead, we break the task down into smaller problems, and solve each of them in turn.\n",
    "\n",
    "We can break the problem of creating a spreadsheet down into three steps:\n",
    "\n",
    "1. Find all the TEI files in the repo\n",
    "2. Extract the fields we want\n",
    "3. Write those fields to a spreadsheet"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 1. Find all the TEI files in the repo\n",
    "\n",
    "This script is going to lean very heavily on *iteration*, a feature of programming languages where you ask them to do something repeatedly for everything in a collection.\n",
    "\n",
    "This is what iteration looks like in Python (called a *for loop*):\n",
    "\n",
    "```\n",
    "for element in collection:\n",
    "    do something with element\n",
    "```\n",
    "\n",
    "This is the code we wrote:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "./WMS_Arabic_65.xml\n",
      "./Malay/Wellcome_MS_Malay_10.xml\n",
      "./Malay/Wellcome_MS_Malay_8.xml\n",
      "./Malay/Wellcome_MS_Malay_9.xml\n",
      "./Malay/Wellcome_MS_Malay_7.xml\n",
      "./Malay/Wellcome_MS_Malay_6.xml\n",
      "./Malay/Wellcome_MS_Malay_4.xml\n",
      "./Malay/Wellcome_MS_Malay_5.xml\n",
      "./Malay/Wellcome_MS_Malay_1.xml\n",
      "./Malay/Wellcome_MS_Malay_2.xml\n",
      "./Malay/Wellcome_MS_Malay_3.xml\n",
      "./Karshuni/Karshuni_3.xml\n",
      "./Karshuni/Karshuni_2.xml\n",
      "./Karshuni/Karshuni_1.xml\n",
      "./Indic/Indic_Alpha_2075.xml\n",
      "./Indic/B_20_m.xml\n",
      "./Indic/E.11.v.xml\n",
      "./Indic/E.11.a.xml\n",
      "./Indic/Indic_Alpha_2101.xml\n",
      "./Indic/Indic_Alpha_2129.xml\n",
      "./Indic/Indic_Alpha_2128.xml\n",
      "./Indic/Indic_Alpha_2100.xml\n",
      "./Indic/Indic_Alpha_2114.xml\n",
      "./Indic/Indic_Alpha_91.xml\n",
      "./Indic/E.11.w.xml\n",
      "./Indic/Indic_Alpha_124.xml\n",
      "./Indic/B_20_l.xml\n",
      "./Indic/Indic_Alpha_2074.xml\n",
      "./Indic/Indic_Alpha_2076.xml\n",
      "./Indic/B_20_n.xml\n",
      "./Indic/Indic_Alpha_2089.xml\n",
      "./Indic/Indic_Alpha_1999.xml\n",
      "./Indic/E.11.u.xml\n",
      "./Indic/E.11.b.xml\n",
      "./Indic/P.81.I.xml\n",
      "./Indic/Indic_Alpha_2102.xml\n",
      "./Indic/Indic_Alpha_2103.xml\n",
      "./Indic/E.11.c.xml\n",
      "./Indic/Indic_Alpha_709.xml\n",
      "./Indic/E.11.t.xml\n",
      "./Indic/Indic_Alpha_1998.xml\n",
      "./Indic/Indic_Alpha_2088.xml\n",
      "./Indic/B_20_o.xml\n",
      "./Indic/Indic_Alpha_2077.xml\n",
      "./Indic/Indic_Alpha_2073.xml\n",
      "./Indic/Indic_Alpha_2067.xml\n",
      "./Indic/E.11.aa.xml\n",
      "./Indic/Indic_Alpha_2098.xml\n",
      "./Indic/Indic_Alpha_686.xml\n",
      "./Indic/E.11.g.xml\n",
      "./Indic/E.11.p.xml\n",
      "./Indic/E.11.e.A.xml\n",
      "./Indic/Indic_Alpha_2107.xml\n",
      "./Indic/Indic_Alpha_2113.xml\n",
      "./Indic/Indic_Alpha_2112.xml\n",
      "./Indic/Indic_Alpha_2106.xml\n",
      "./Indic/Indic_Alpha_68.xml\n",
      "./Indic/E.11.q.xml\n",
      "./Indic/E.11.f.xml\n",
      "./Indic/Indic_Alpha_687.xml\n",
      "./Indic/Indic_Alpha_2099.xml\n",
      "./Indic/Indic_Alpha_2066.xml\n",
      "./Indic/Indic_Alpha_2072.xml\n",
      "./Indic/Indic_Alpha_1221.xml\n",
      "./Indic/Indic_Alpha_2070.xml\n",
      "./Indic/B_19_l.xml\n",
      "./Indic/Indic_Alpha_685.xml\n",
      "./Indic/Indic_Beta_520.xml\n",
      "./Indic/E.11.d.xml\n",
      "./Indic/E.11.s.xml\n",
      "./Indic/E.11.e.B.xml\n",
      "./Indic/Indic_Alpha_2138.xml\n",
      "./Indic/Indic_Alpha_2110.xml\n",
      "./Indic/Indic_Alpha_2104.xml\n",
      "./Indic/Indic_Alpha_2105.xml\n",
      "./Indic/Indic_Alpha_2111.xml\n",
      "./Indic/Indic_Alpha_2139.xml\n",
      "./Indic/I.57.a.xml\n",
      "./Indic/E.11.r.xml\n",
      "./Indic/Indic_Alpha_80.xml\n",
      "./Indic/Indic_Beta_521.xml\n",
      "./Indic/Indic_Alpha_684.xml\n",
      "./Indic/Indic_Alpha_121.xml\n",
      "./Indic/Indic_Alpha_2071.xml\n",
      "./Indic/Indic_Alpha_2065.xml\n",
      "./Indic/Indic_Alpha_1222.xml\n",
      "./Indic/Indic_Alpha_378.xml\n",
      "./Indic/Indic_Alpha_2002.xml\n",
      "./Indic/Indic_Alpha_2016.xml\n",
      "./Indic/Indic_Alpha_387.xml\n",
      "./Indic/Indic_Alpha_393.xml\n",
      "./Indic/Indic_Beta_585.xml\n",
      "./Indic/G_27_b.xml\n",
      "./Indic/Indic_Alpha_146.xml\n",
      "./Indic/Indic_Alpha_2228.xml\n",
      "./Indic/MS_Indic_Gamma_351.xml\n",
      "./Indic/Indic_Alpha_18.xml\n",
      "./Indic/Indic_Alpha_556.xml\n",
      "./Indic/O.29.e.xml\n",
      "./Indic/O.29.d.xml\n",
      "./Indic/Indic_Alpha_557.xml\n",
      "./Indic/MS_Indic_Alpha_170_1-3.xml\n",
      "./Indic/E.11.dd.B.xml\n",
      "./Indic/O.24._.xml\n",
      "./Indic/Indic_Alpha_2229.xml\n",
      "./Indic/G_27_c.xml\n",
      "./Indic/Indic_Alpha_392.xml\n",
      "./Indic/Indic_Alpha_386.xml\n",
      "./Indic/Indic_Alpha_379.xml\n",
      "./Indic/Indic_Alpha_2003.xml\n",
      "./Indic/Indic_Alpha_2015.xml\n",
      "./Indic/Indic_Alpha_2001.xml\n",
      "./Indic/MS_Indic_Alpha 113.xml\n",
      "./Indic/Indic_Alpha_390.xml\n",
      "./Indic/Indic_Alpha_384.xml\n",
      "./Indic/Indic_Beta_2199.xml\n",
      "./Indic/Indic_Beta_2198.xml\n",
      "./Indic/E.11.dd.A.xml\n",
      "./Indic/Indic_Alpha_385.xml\n",
      "./Indic/Indic_Alpha_391.xml\n",
      "./Indic/Indic_Alpha_2000.xml\n",
      "./Indic/Indic_Alpha_2014.xml\n",
      "./Indic/Indic_Alpha_2010.xml\n",
      "./Indic/E.11.ff.xml\n",
      "./Indic/Indic_Alpha_2004.xml\n",
      "./Indic/Indic_Alpha_395.xml\n",
      "./Indic/Indic_Alpha_381.xml\n",
      "./Indic/G_27_d.xml\n",
      "./Indic/G_27_e.xml\n",
      "./Indic/Indic_Alpha_380.xml\n",
      "./Indic/Indic_Alpha_394.xml\n",
      "./Indic/Indic_Alpha_2005.xml\n",
      "./Indic/Indic_Beta_2200.xml\n",
      "./Indic/Indic_Alpha_2011.xml\n",
      "./Indic/Indic_Alpha_2007.xml\n",
      "./Indic/Indic_Alpha_369.xml\n",
      "./Indic/Indic_Alpha_2013.xml\n",
      "./Indic/Indic_Alpha_382.xml\n",
      "./Indic/Indic_Alpha_396.xml\n",
      "./Indic/Indic_Alpha_2239.xml\n",
      "./Indic/G_27_g.xml\n",
      "./Indic/B_20_bbb.xml\n",
      "./Indic/Indic_Gamma_508.xml\n",
      "./Indic/G.40.xml\n",
      "./Indic/G_27_f.xml\n",
      "./Indic/Indic_Alpha_2238.xml\n",
      "./Indic/Indic_Alpha_397.xml\n",
      "./Indic/Indic_Alpha_383.xml\n",
      "./Indic/Indic_Alpha_368.xml\n",
      "./Indic/Indic_Alpha_2012.xml\n",
      "./Indic/Indic_Alpha_2006.xml\n",
      "./Indic/P.81.II.xml\n",
      "./Indic/E.11.ee.xml\n",
      "./Indic/Indic_Alpha_403.xml\n",
      "./Indic/Indic_Alpha_371.xml\n",
      "./Indic/Indic_Alpha_2235.xml\n",
      "./Indic/G.65.xml\n",
      "./Indic/Indic_Gamma_277.xml\n",
      "./Indic/Indic_Beta_638.xml\n",
      "./Indic/Indic_Alpha_562.xml\n",
      "./Indic/Indic_Alpha_38.xml\n",
      "./Indic/Indic_Alpha_2234.xml\n",
      "./Indic/Indic_Alpha_370.xml\n",
      "./Indic/Indic_Alpha_402.xml\n",
      "./Indic/Indic_Alpha_372.xml\n",
      "./Indic/Indic_Alpha_2008.xml\n",
      "./Indic/Indic_Alpha_414.xml\n",
      "./Indic/Indic_Alpha_400.xml\n",
      "./Indic/Indic_Alpha_399.xml\n",
      "./Indic/Indic_Alpha_2236.xml\n",
      "./Indic/Indic_Alpha_2140.xml\n",
      "./Indic/Indic_Alpha_560.xml\n",
      "./Indic/Indic_Alpha_561.xml\n",
      "./Indic/Indic_Alpha_978.xml\n",
      "./Indic/Indic_Alpha_2237.xml\n",
      "./Indic/Indic_Alpha_398.xml\n",
      "./Indic/Indic_Alpha_401.xml\n",
      "./Indic/Indic_Alpha_373.xml\n",
      "./Indic/Indic_Alpha_2009.xml\n",
      "./Indic/Indic_Alpha_377.xml\n",
      "./Indic/Indic_Alpha_405.xml\n",
      "./Indic/Indic_Alpha_388.xml\n",
      "./Indic/Indic_Alpha_2233.xml\n",
      "./Indic/Indic_Alpha_2227.xml\n",
      "./Indic/Indic_Alpha_559.xml\n",
      "./Indic/Indic_Alpha_558.xml\n",
      "./Indic/O.29.b.A.xml\n",
      "./Indic/Indic_Alpha_2232.xml\n",
      "./Indic/Indic_Alpha_389.xml\n",
      "./Indic/Indic_Alpha_404.xml\n",
      "./Indic/Indic_Alpha_376.xml\n",
      "./Indic/Indic_Alpha_406.xml\n",
      "./Indic/Indic_Alpha_374.xml\n",
      "./Indic/E.11.kk.xml\n",
      "./Indic/Indic_Alpha_2230.xml\n",
      "./Indic/Indic_Beta_210.xml\n",
      "./Indic/Indic_Alpha_28.xml\n",
      "./Indic/O.29.b.B.xml\n",
      "./Indic/Indic_Beta_2183.xml\n",
      "./Indic/Indic_Beta_2197.xml\n",
      "./Indic/Indic_Alpha_2231.xml\n",
      "./Indic/Indic_Alpha_375.xml\n",
      "./Indic/E.11.bb.xml\n",
      "./Indic/Indic_Alpha_2068.xml\n",
      "./Indic/B_20_s.xml\n",
      "./Indic/Indic_Alpha_2083.xml\n",
      "./Indic/Indic_Alpha_2097.xml\n",
      "./Indic/Indic_Alpha_2242.xml\n",
      "./Indic/MS_Indic_Alpha_170_2.xml\n",
      "./Indic/O.24.b.xml\n",
      "./Indic/Indic_Alpha_689.xml\n",
      "./Indic/E.11.h.xml\n",
      "./Indic/Indic_Alpha_2134.xml\n",
      "./Indic/Indic_Alpha_2120.xml\n",
      "./Indic/Indic_Alpha_2108.xml\n",
      "./Indic/G.32.a.xml\n",
      "./Indic/Indic_Alpha_2109.xml\n",
      "./Indic/Indic_Alpha_2121.xml\n",
      "./Indic/Indic_Alpha_2135.xml\n",
      "./Indic/E.11.i.xml\n",
      "./Indic/Indic_Alpha_688.xml\n",
      "./Indic/O.24.c.xml\n",
      "./Indic/MS_Indic_Alpha_170_3.xml\n",
      "./Indic/Indic_Alpha_2243.xml\n",
      "./Indic/Indic_Alpha_2096.xml\n",
      "./Indic/Indic_Alpha_2082.xml\n",
      "./Indic/B_20_r.xml\n",
      "./Indic/Indic_Alpha_2069.xml\n",
      "./Indic/Indic_Alpha_2094.xml\n",
      "./Indic/B_20_p.xml\n",
      "./Indic/Indic_Alpha_2080.xml\n",
      "./Indic/MS_Indic_Alpha_170_1.xml\n",
      "./Indic/Indic_Alpha_2241.xml\n",
      "./Indic/O.24.a.xml\n",
      "./Indic/Indic_Alpha_932.xml\n",
      "./Indic/Indic_Alpha_2123.xml\n",
      "./Indic/Indic_Alpha_2137.xml\n",
      "./Indic/G.32.c.xml\n",
      "./Indic/G.32.b.xml\n",
      "./Indic/Indic_Alpha_2136.xml\n",
      "./Indic/Indic_Alpha_2122.xml\n",
      "./Indic/E.11.j.xml\n",
      "./Indic/Indic_Alpha_2240.xml\n",
      "./Indic/Indic_Alpha_2081.xml\n",
      "./Indic/B_20_q.xml\n",
      "./Indic/Indic_Alpha_2095.xml\n",
      "./Indic/Indic_Alpha_2091.xml\n",
      "./Indic/Indic_Alpha_2085.xml\n",
      "./Indic/Indic_Alpha_2244.xml\n",
      "./Indic/E.11.y.xml\n",
      "./Indic/Indic_Alpha_710.xml\n",
      "./Indic/E.11.n.xml\n",
      "./Indic/Indic_Alpha_2132.xml\n",
      "./Indic/G.32.f.xml\n",
      "./Indic/Indic_Alpha_2133.xml\n",
      "./Indic/Indic_Alpha_2127.xml\n",
      "./Indic/E.11.o.xml\n",
      "./Indic/Indic_Alpha_711.xml\n",
      "./Indic/E.11.x.xml\n",
      "./Indic/O.24.e.xml\n",
      "./Indic/B_20_fff.xml\n",
      "./Indic/Indic_Alpha_2245.xml\n",
      "./Indic/Indic_Alpha_2084.xml\n",
      "./Indic/Indic_Alpha_2090.xml\n",
      "./Indic/Indic_Alpha_2079.xml\n",
      "./Indic/E.11.cc.xml\n",
      "./Indic/Indic_Alpha_2086.xml\n",
      "./Indic/Indic_Alpha_2092.xml\n",
      "./Indic/Indic_Alpha_1996.xml\n",
      "./Indic/E.11.z.xml\n",
      "./Indic/E.11.m.xml\n",
      "./Indic/Indic_Alpha_2131.xml\n",
      "./Indic/Indic_Alpha_2125.xml\n",
      "./Indic/G.32.e.xml\n",
      "./Indic/G.32.d.xml\n",
      "./Indic/Indic_Alpha_2124.xml\n",
      "./Indic/Indic_Alpha_2130.xml\n",
      "./Indic/E.11.l.xml\n",
      "./Indic/Indic_Alpha_712.xml\n",
      "./Indic/Indic_Alpha_1997.xml\n",
      "./Indic/Indic_Alpha_2093.xml\n",
      "./Indic/Indic_Alpha_2087.xml\n",
      "./Indic/Indic_Alpha_2078.xml\n",
      "./Japanese/Japanese_79.xml\n",
      "./Japanese/Japanese_86.xml\n",
      "./Japanese/Japanese_52.xml\n",
      "./Japanese/Japanese_85.xml\n",
      "./Japanese/Japanese_94.xml\n",
      "./Japanese/Japanese_82.xml\n",
      "./Japanese/Japanese_27.xml\n",
      "./Japanese/Japanese _17.xml\n",
      "./Japanese/Japanese_116.xml\n",
      "./Japanese/Japanese_100.xml\n",
      "./Japanese/Japanese_125.xml\n",
      "./Japanese/Japanese_119.xml\n",
      "./Japanese/Japanese_28.xml\n",
      "./Japanese/Japanese_29.xml\n",
      "./Japanese/Japanese_16.xml\n",
      "./Japanese/Japanese_59.xml\n",
      "./Japanese/Japanese_58.xml\n",
      "./Japanese/Japanese_99.xml\n",
      "./Japanese/Japanese_98.xml\n",
      "./Japanese/Japanese_88.xml\n",
      "./Japanese/Japanese_63.xml\n",
      "./Japanese/Japanese_61.xml\n",
      "./Syriac/Syriac_1.xml\n",
      "./Syriac/Syriac_2.xml\n",
      "./Javanese/Javanese_3.xml\n",
      "./Javanese/Javanese_2.xml\n",
      "./Javanese/Javanese_1.xml\n",
      "./Javanese/Javanese_5.xml\n",
      "./Javanese/Javanese_4.xml\n",
      "./Javanese/Javanese_6.xml\n",
      "./Javanese/Javanese_7.xml\n",
      "./Javanese/Javanese_9.xml\n",
      "./Javanese/Javanese_10.xml\n",
      "./Javanese/Javanese_11.xml\n",
      "./Javanese/Javanese_8.xml\n",
      "./Tibetan/MS_Tibetan_134.xml\n",
      "./Tibetan/MS_Tibetan_133.xml\n",
      "./Greek/MS_289.xml\n",
      "./Greek/MS_498.xml\n",
      "./Greek/MS_MSL_52.xml\n",
      "./Greek/MS_4103.xml\n",
      "./Greek/MS_MSL_124.xml\n",
      "./Greek/MS_MSL_126.xml\n",
      "./Greek/MS_413.xml\n",
      "./Greek/MS_MSL_135.xml\n",
      "./Greek/MS_MSL_109.xml\n",
      "./Greek/MS_MSL_112.xml\n",
      "./Greek/MS_354.xml\n",
      "./Greek/MS_MSL_1.xml\n",
      "./Greek/MS_MSL_114.xml\n",
      "./Greek/MS_MSL_14.xml\n",
      "./Hebrew/Hebrew_A_11.xml\n",
      "./Hebrew/Hebrew_B_54.xml\n",
      "./Hebrew/Hebrew_B_40.xml\n",
      "./Hebrew/Hebrew_B_41.xml\n",
      "./Hebrew/Hebrew_B_55.xml\n",
      "./Hebrew/Hebrew_A_10.xml\n",
      "./Hebrew/Hebrew_A_12.xml\n",
      "./Hebrew/Hebrew_B_43.xml\n",
      "./Hebrew/Hebrew_B_57.xml\n",
      "./Hebrew/Hebrew_B_56.xml\n",
      "./Hebrew/Hebrew_B_42.xml\n",
      "./Hebrew/Hebrew_A_13.xml\n",
      "./Hebrew/Hebrew_A_17.xml\n",
      "./Hebrew/Hebrew_B_46.xml\n",
      "./Hebrew/Hebrew_B_52.xml\n",
      "./Hebrew/Hebrew_B_53.xml\n",
      "./Hebrew/Hebrew_B_47.xml\n",
      "./Hebrew/Hebrew_A_16.xml\n",
      "./Hebrew/Hebrew_A_14.xml\n",
      "./Hebrew/Hebrew_A_28.xml\n",
      "./Hebrew/Hebrew_B_51.xml\n",
      "./Hebrew/Hebrew_B_45.xml\n",
      "./Hebrew/Hebrew_A_9.xml\n",
      "./Hebrew/Hebrew_A_8.xml\n",
      "./Hebrew/Hebrew_B_44.xml\n",
      "./Hebrew/Hebrew_B_50.xml\n",
      "./Hebrew/Hebrew_A_29.xml\n",
      "./Hebrew/Hebrew_A_15.xml\n",
      "./Hebrew/Hebrew_B_37.xml\n",
      "./Hebrew/Hebrew_B_23.xml\n",
      "./Hebrew/Hebrew_B_22.xml\n",
      "./Hebrew/Hebrew_B_36.xml\n",
      "./Hebrew/Hebrew_B_20.xml\n",
      "./Hebrew/Hebrew_B_34.xml\n",
      "./Hebrew/Hebrew_B_35.xml\n",
      "./Hebrew/Hebrew_B_21.xml\n",
      "./Hebrew/Hebrew_B_19.xml\n",
      "./Hebrew/Hebrew_B_25.xml\n",
      "./Hebrew/Hebrew_B_31.xml\n",
      "./Hebrew/Hebrew_B_30.xml\n",
      "./Hebrew/Hebrew_B_24.xml\n",
      "./Hebrew/Hebrew_B_18.xml\n",
      "./Hebrew/Hebrew_B_32.xml\n",
      "./Hebrew/Hebrew_B_26.xml\n",
      "./Hebrew/Hebrew_B_8.xml\n",
      "./Hebrew/Hebrew_B_9.xml\n",
      "./Hebrew/Hebrew_B_27.xml\n",
      "./Hebrew/Hebrew_B_33.xml\n",
      "./Hebrew/Hebrew_B_16.xml\n",
      "./Hebrew/Hebrew_B_4.xml\n",
      "./Hebrew/Hebrew_B_5.xml\n",
      "./Hebrew/Hebrew_B_17.xml\n",
      "./Hebrew/Hebrew_B_15.xml\n",
      "./Hebrew/Hebrew_B_29.xml\n",
      "./Hebrew/Hebrew_B_7.xml\n",
      "./Hebrew/Hebrew_B_6.xml\n",
      "./Hebrew/Hebrew_B_28.xml\n",
      "./Hebrew/Hebrew_B_14.xml\n",
      "./Hebrew/Hebrew_B_38.xml\n",
      "./Hebrew/Hebrew_B_10.xml\n",
      "./Hebrew/Hebrew_B_2.xml\n",
      "./Hebrew/Hebrew_B_3.xml\n",
      "./Hebrew/Hebrew_B_11.xml\n",
      "./Hebrew/Hebrew_B_39.xml\n",
      "./Hebrew/Hebrew_B_13.xml\n",
      "./Hebrew/Hebrew_B_1.xml\n",
      "./Hebrew/Hebrew_B_12.xml\n",
      "./Hebrew/Hebrew_A_18.xml\n",
      "./Hebrew/Hebrew_A_24.xml\n",
      "./Hebrew/Hebrew_A_30.xml\n",
      "./Hebrew/Hebrew_B_49.xml\n",
      "./Hebrew/Hebrew_A_5.xml\n",
      "./Hebrew/Hebrew_A_4.xml\n",
      "./Hebrew/Hebrew_B_48.xml\n",
      "./Hebrew/Hebrew_A_31.xml\n",
      "./Hebrew/Hebrew_A_25.xml\n",
      "./Hebrew/Hebrew_A_19.xml\n",
      "./Hebrew/Hebrew_A_33.xml\n",
      "./Hebrew/Hebrew_A_27.xml\n",
      "./Hebrew/Hebrew_A_6.xml\n",
      "./Hebrew/Hebrew_A_7.xml\n",
      "./Hebrew/Hebrew_A_26.xml\n",
      "./Hebrew/Hebrew_A_32.xml\n",
      "./Hebrew/Hebrew_A_36.xml\n",
      "./Hebrew/Hebrew_A_22.xml\n",
      "./Hebrew/Hebrew_A_3.xml\n",
      "./Hebrew/Hebrew_A_2.xml\n",
      "./Hebrew/Hebrew_A_21.xml\n",
      "./Hebrew/Hebrew_A_35.xml\n",
      "./Hebrew/Hebrew_B_58.xml\n",
      "./Hebrew/Hebrew_A23.xml\n",
      "./Hebrew/Hebrew_A_1.xml\n",
      "./Hebrew/Hebrew_A_34.xml\n",
      "./Hebrew/Hebrew_A_20.xml\n",
      "./Spanish/MS.939.xml\n",
      "./Spanish/WMS_Amer.17.xml\n",
      "./Spanish/WMS_Amer.8.xml.xml\n",
      "./Spanish/WMS_Amer.16.xml\n",
      "./Spanish/WMS_Amer.14.xml\n",
      "./Spanish/MS.191.xml\n",
      "./Spanish/MS.963.xml\n",
      "./Spanish/WMS_Amer.12.xml\n",
      "./Spanish/WMS_Amer.9.xml.xml\n",
      "./Spanish/MS.171.xml\n",
      "./Spanish/MS.1330.xml\n",
      "./Spanish/WMS_Amer.10.xml.xml\n",
      "./Spanish/MS.99.xml\n",
      "./Spanish/WMS_Amer.20.xml\n",
      "./Spanish/WMS_Amer.27.xml.xml\n",
      "./Spanish/WMS_Amer.18.xml\n",
      "./Spanish/MS.759.xml\n",
      "./Spanish/MS.598.xml\n",
      "./Spanish/WMS_Amer.4.xml.xml\n",
      "./Spanish/WMS_Amer.19.xml\n",
      "./Spanish/WMS_Amer.11.xml.xml\n",
      "./Spanish/MS.363.xml\n",
      "./Spanish/WMS_Amer.6.xml.xml\n",
      "./Spanish/MS.1422.xml\n",
      "./Spanish/WMS_Amer.7.xml.xml\n",
      "./Tamil/Tamil_42.xml\n",
      "./Tamil/Tamil_30.xml\n",
      "./Tamil/Tamil_24.xml\n",
      "./Tamil/Tamil_18.xml\n",
      "./Tamil/Tamil_2.xml\n",
      "./Tamil/Tamil_3.xml\n",
      "./Tamil/Tamil_19.xml\n",
      "./Tamil/Tamil_25.xml\n",
      "./Tamil/Tamil_27.xml\n",
      "./Tamil/Tamil_33.xml\n",
      "./Tamil/Tamil_1.xml\n",
      "./Tamil/Tamil_32.xml\n",
      "./Tamil/Tamil_26.xml\n",
      "./Tamil/Tamil_22.xml\n",
      "./Tamil/Tamil_36.xml\n",
      "./Tamil/Tamil_4.xml\n",
      "./Tamil/Tamil_5.xml\n",
      "./Tamil/Tamil_37.xml\n",
      "./Tamil/Tamil_23.xml\n",
      "./Tamil/Tamil_35.xml\n",
      "./Tamil/Tamil_21.xml\n",
      "./Tamil/Tamil_7.xml\n",
      "./Tamil/Tamil_6.xml\n",
      "./Tamil/Tamil_20.xml\n",
      "./Tamil/Tamil_34.xml\n",
      "./Tamil/Tamil_11.xml\n",
      "./Tamil/Tamil_38.xml\n",
      "./Tamil/Tamil_10.xml\n",
      "./Tamil/Tamil_12.xml\n",
      "./Tamil/Tamil_8.xml\n",
      "./Tamil/Tamil_9.xml\n",
      "./Tamil/Tamil_13.xml\n",
      "./Tamil/Tamil_17.xml\n",
      "./Tamil/Tamil_28.xml\n",
      "./Tamil/Tamil_14.xml\n",
      "./Tamil/Tamil_15.xml\n",
      "./Tamil/Tamil_29.xml\n",
      "./Batak/Batak_330889.xml\n",
      "./Batak/_Batak_330894.xml\n",
      "./Batak/Batak_63570.xml\n",
      "./Batak/Batak_56330.xml\n",
      "./Batak/Batak_66486.xml\n",
      "./Batak/Batak_66485.xml\n",
      "./Batak/Batak_91624.xml\n",
      "./Batak/Batak_91548.xml\n",
      "./Batak/Batak_36863.xml\n",
      "./Batak/Batak_56303.xml\n",
      "./Batak/Batak_36801.xml\n",
      "./Batak/Batak_36960.xml\n",
      "./Batak/Batak_330890.xml\n",
      "./Egyptian/Egyptian_MS_5.xml\n",
      "./Egyptian/Egyptian_MS_4.xml\n",
      "./Egyptian/Egyptian_MS_6.xml\n",
      "./Egyptian/Egyptian_MS_7.xml\n",
      "./Egyptian/Egyptian_MS_3.xml\n",
      "./Egyptian/Egyptian_MS_2.xml\n",
      "./Egyptian/Egyptian_MS_1.xml\n",
      "./Egyptian/Egyptian_MS_8.xml\n",
      "./Arabic/WMS_Arabic_442.xml\n",
      "./Arabic/WMS_Arabic_456.xml\n",
      "./Arabic/WMS_Arabic_481.xml\n",
      "./Arabic/WMS_Arabic_495.xml\n",
      "./Arabic/WMS_Arabic_654.xml\n",
      "./Arabic/WMS_Arabic_668.xml\n",
      "./Arabic/WMS_Arabic_697.xml\n",
      "./Arabic/WMS_Arabic_734.xml\n",
      "./Arabic/WMS_Arabic_24.xml\n",
      "./Arabic/WMS_Arabic_18.xml\n",
      "./Arabic/WMS_Arabic_278.xml\n",
      "./Arabic/WMS_Arabic_286.xml\n",
      "./Arabic/WMS_Arabic_292.xml\n",
      "./Arabic/WMS_Arabic_31.xml\n",
      "./Arabic/MS_Arabic_3.xml\n",
      "./Arabic/WMS_Arabic_709.xml\n",
      "./Arabic/WMS_Arabic_735.xml\n",
      "./Arabic/WMS_Arabic_682.xml\n",
      "./Arabic/MS_Arabic_862.xml\n",
      "./Arabic/MS_Arabic_876.xml\n",
      "./Arabic/WMS_Arabic_480.xml\n",
      "./Arabic/WMS_Arabic_457.xml\n",
      "./Arabic/WMS_Arabic_443.xml\n",
      "./Arabic/WMS_Arabic_455.xml\n",
      "./Arabic/WMS_Arabic_441.xml\n",
      "./Arabic/WMS_Arabic_469.xml\n",
      "./Arabic/WMS_Arabic_482.xml\n",
      "./Arabic/MS_Arabic_860.xml\n",
      "./Arabic/WMS_Arabic_694.xml\n",
      "./Arabic/WMS_Arabic_680.xml\n",
      "./Arabic/WMS_Arabic_723.xml\n",
      "./Arabic/WMS_Arabic_521.xml\n",
      "./Arabic/WMS_Arabic_284.xml\n",
      "./Arabic/WMS_Arabic_290.xml\n",
      "./Arabic/WMS_Arabic_291.xml\n",
      "./Arabic/WMS_Arabic_508.xml\n",
      "./Arabic/WMS_Arabic_534.xml\n",
      "./Arabic/WMS_Arabic_252.xml\n",
      "./Arabic/WMS_Arabic_26.xml\n",
      "./Arabic/MS_Arabic_875.xml\n",
      "./Arabic/MS_Arabic_861.xml\n",
      "./Arabic/WMS_Arabic_483.xml\n",
      "./Arabic/WMS_Arabic_497.xml\n",
      "./Arabic/WMS_Arabic_468.xml\n",
      "./Arabic/WMS_Arabic_440.xml\n",
      "./Arabic/WMS_Arabic_454.xml\n",
      "./Arabic/WMS_Arabic_478.xml\n",
      "./Arabic/WMS_Arabic_450.xml\n",
      "./Arabic/WMS_Arabic_444.xml\n",
      "./Arabic/WMS_Arabic_487.xml\n",
      "./Arabic/MS_Arabic_865.xml\n",
      "./Arabic/MS_Arabic_871.xml\n",
      "./Arabic/WMS_Arabic_646.xml\n",
      "./Arabic/WMS_Arabic_691.xml\n",
      "./Arabic/WMS_Arabic_726.xml\n",
      "./Arabic/WMS_Arabic_22.xml\n",
      "./Arabic/WMS_Arabic_256.xml\n",
      "./Arabic/WMS_Arabic_530.xml\n",
      "./Arabic/WMS_Arabic_281.xml\n",
      "./Arabic/WMS_Arabic_257.xml\n",
      "./Arabic/WMS_Arabic_531.xml\n",
      "./Arabic/WMS_Arabic_733.xml\n",
      "./Arabic/WMS_Arabic_848.xml\n",
      "./Arabic/WMS_Arabic_690.xml\n",
      "./Arabic/WMS_Arabic_121.xml\n",
      "./Arabic/WMS_Arabic_653.xml\n",
      "./Arabic/MS_Arabic_858.xml\n",
      "./Arabic/MS_Arabic_870.xml\n",
      "./Arabic/MS_Arabic_864.xml\n",
      "./Arabic/WMS_Arabic_486.xml\n",
      "./Arabic/WMS_Arabic_445.xml\n",
      "./Arabic/WMS_Arabic_451.xml\n",
      "./Arabic/WMS_Arabic_479.xml\n",
      "./Arabic/WMS_Arabic_447.xml\n",
      "./Arabic/WMS_Arabic_453.xml\n",
      "./Arabic/WMS_Arabic_484.xml\n",
      "./Arabic/WMS_Arabic_8.xml\n",
      "./Arabic/WMS_Arabic_490.xml\n",
      "./Arabic/WMS_Arabic_679.xml\n",
      "./Arabic/WMS_Arabic_725.xml\n",
      "./Arabic/WMS_Arabic_35.xml\n",
      "./Arabic/WMS_Arabic_533.xml\n",
      "./Arabic/WMS_Arabic_527.xml\n",
      "./Arabic/WMS_Arabic_283.xml\n",
      "./Arabic/WMS_Arabic_297.xml\n",
      "./Arabic/WMS_Arabic_254.xml\n",
      "./Arabic/WMS_Arabic_20.xml\n",
      "./Arabic/WMS_Arabic_34.xml\n",
      "./Arabic/WMS_Arabic_724.xml\n",
      "./Arabic/WMS_Arabic_730.xml\n",
      "./Arabic/WMS_Arabic_693.xml\n",
      "./Arabic/MS_Arabic_867.xml\n",
      "./Arabic/WMS_Arabic_678.xml\n",
      "./Arabic/WMS_Arabic_485.xml\n",
      "./Arabic/WMS_Arabic_452.xml\n",
      "./Arabic/WMS_Arabic_446.xml\n",
      "./Arabic/WMS_Arabic_421.xml\n",
      "./Arabic/WMS_Arabic_347.xml\n",
      "./Arabic/WMS_Arabic_435.xml\n",
      "./Arabic/WMS_Arabic_409.xml\n",
      "./Arabic/WMS_Arabic_384.xml\n",
      "./Arabic/WMS_Arabic_637.xml\n",
      "./Arabic/WMS_Arabic_179.xml\n",
      "./Arabic/WMS_Arabic_84.xml\n",
      "./Arabic/WMS_Arabic_569.xml\n",
      "./Arabic/WMS_Arabic_583.xml\n",
      "./Arabic/WMS_Arabic_597.xml\n",
      "./Arabic/WMS_Arabic_781.xml\n",
      "./Arabic/WMS_Arabic_46.xml\n",
      "./Arabic/WMS_Arabic_742.xml\n",
      "./Arabic/WMS_Arabic_839.xml\n",
      "./Arabic/WMS_Arabic_178.xml\n",
      "./Arabic/WMS_Arabic_622.xml\n",
      "./Arabic/WMS_Arabic_385.xml\n",
      "./Arabic/WMS_Arabic_408.xml\n",
      "./Arabic/WMS_Arabic_434.xml\n",
      "./Arabic/WMS_Arabic_420.xml\n",
      "./Arabic/WMS_Arabic_436.xml\n",
      "./Arabic/WMS_Arabic_422.xml\n",
      "./Arabic/WMS_Arabic_813.xml\n",
      "./Arabic/WMS_Arabic_783.xml\n",
      "./Arabic/WMS_Arabic_797.xml\n",
      "./Arabic/WMS_Arabic_594.xml\n",
      "./Arabic/WMS_Arabic_580.xml\n",
      "./Arabic/WMS_Arabic_557.xml\n",
      "./Arabic/WMS_Arabic_806.xml\n",
      "./Arabic/WMS_Arabic_609.xml\n",
      "./Arabic/WMS_Arabic_147.xml\n",
      "./Arabic/WMS_Arabic_379.xml\n",
      "./Arabic/WMS_Arabic_423.xml\n",
      "./Arabic/WMS_Arabic_437.xml\n",
      "./Arabic/WMS_Arabic_351.xml\n",
      "./Arabic/WMS_Arabic_355.xml\n",
      "./Arabic/WMS_Arabic_433.xml\n",
      "./Arabic/WMS_Arabic_427.xml\n",
      "./Arabic/WMS_Arabic_382.xml\n",
      "./Arabic/MS_Arabic_812.xml\n",
      "./Arabic/WMS_Arabic_816.xml\n",
      "./Arabic/WMS_Arabic_82.xml\n",
      "./Arabic/WMS_Arabic_235.xml\n",
      "./Arabic/WMS_Arabic_585.xml\n",
      "./Arabic/WMS_Arabic_793.xml\n",
      "./Arabic/WMS_Arabic_68.xml\n",
      "./Arabic/WMS_Arabic_83.xml\n",
      "./Arabic/WMS_Arabic_817.xml\n",
      "./Arabic/WMS_Arabic_624.xml\n",
      "./Arabic/WMS_Arabic_630.xml\n",
      "./Arabic/WMS_Arabic_618.xml\n",
      "./Arabic/WMS_Arabic_383.xml\n",
      "./Arabic/WMS_Arabic_397.xml\n",
      "./Arabic/WMS_Arabic_426.xml\n",
      "./Arabic/WMS_Arabic_340.xml\n",
      "./Arabic/WMS_Arabic_432.xml\n",
      "./Arabic/WMS_Arabic_418.xml\n",
      "./Arabic/WMS_Arabic_424.xml\n",
      "./Arabic/WMS_Arabic_430.xml\n",
      "./Arabic/WMS_Arabic_632.xml\n",
      "./Arabic/WMS_Arabic_815.xml\n",
      "./Arabic/WMS_Arabic_183.xml\n",
      "./Arabic/WMS_Arabic_746.xml\n",
      "./Arabic/WMS_Arabic_81.xml\n",
      "./Arabic/WMS_Arabic_791.xml\n",
      "./Arabic/WMS_Arabic_578.xml\n",
      "./Arabic/WMS_Arabic_593.xml\n",
      "./Arabic/WMS_Arabic_587.xml\n",
      "./Arabic/WMS_Arabic_592.xml\n",
      "./Arabic/WMS_Arabic_80.xml\n",
      "./Arabic/WMS_Arabic_182.xml\n",
      "./Arabic/WMS_Arabic_633.xml\n",
      "./Arabic/MS_Arabic_804.xml\n",
      "./Arabic/WMS_Arabic_431.xml\n",
      "./Arabic/WMS_Arabic_425.xml\n",
      "./Arabic/WMS_Arabic_419.xml\n",
      "./Arabic/WMS_Arabic_372.xml\n",
      "./Arabic/WMS_Arabic_414.xml\n",
      "./Arabic/WMS_Arabic_428.xml\n",
      "./Arabic/WMS_Arabic_164.xml\n",
      "./Arabic/MS_Arabic_835.xml\n",
      "./Arabic/MS_Arabic_821.xml\n",
      "./Arabic/WMS_Arabic_831.xml\n",
      "./Arabic/WMS_Arabic_776.xml\n",
      "./Arabic/WMS_Arabic_99.xml\n",
      "./Arabic/WMS_Arabic_72.xml\n",
      "./Arabic/WMS_Arabic_66.xml\n",
      "./Arabic/WMS_Arabic_574.xml\n",
      "./Arabic/WMS_Arabic_560.xml\n",
      "./Arabic/WMS_Arabic_561.xml\n",
      "./Arabic/WMS_Arabic_788.xml\n",
      "./Arabic/WMS_Arabic_73.xml\n",
      "./Arabic/WMS_Arabic_777.xml\n",
      "./Arabic/WMS_Arabic_830.xml\n",
      "./Arabic/MS_Arabic_820.xml\n",
      "./Arabic/WMS_Arabic_617.xml\n",
      "./Arabic/WMS_Arabic_171.xml\n",
      "./Arabic/WMS_Arabic_165.xml\n",
      "./Arabic/WMS_Arabic_429.xml\n",
      "./Arabic/WMS_Arabic_373.xml\n",
      "./Arabic/WMS_Arabic_415.xml\n",
      "./Arabic/WMS_Arabic_401.xml\n",
      "./Arabic/WMS_Arabic_417.xml\n",
      "./Arabic/WMS_Arabic_371.xml\n",
      "./Arabic/WMS_Arabic_403.xml\n",
      "./Arabic/WMS_Arabic_359.xml\n",
      "./Arabic/MS_Arabic_163.xml\n",
      "./Arabic/WMS_Arabic_826.xml\n",
      "./Arabic/WMS_Arabic_65.xml\n",
      "./Arabic/WMS_Arabic_71.xml\n",
      "./Arabic/WMS_Arabic_577.xml\n",
      "./Arabic/WMS_Arabic_588.xml\n",
      "./Arabic/WMS_Arabic_238.xml\n",
      "./Arabic/WMS_Arabic_748.xml\n",
      "./Arabic/WMS_Arabic_628.xml\n",
      "./Arabic/WMS_Arabic_166.xml\n",
      "./Arabic/WMS_Arabic_402.xml\n",
      "./Arabic/WMS_Arabic_416.xml\n",
      "./Arabic/WMS_Arabic_348.xml\n",
      "./Arabic/WMS_Arabic_412.xml\n",
      "./Arabic/WMS_Arabic_406.xml\n",
      "./Arabic/WMS_Arabic_837.xml\n",
      "./Arabic/WMS_Arabic_823.xml\n",
      "./Arabic/WMS_Arabic_566.xml\n",
      "./Arabic/WMS_Arabic_598.xml\n",
      "./Arabic/WMS_Arabic_573.xml\n",
      "./Arabic/WMS_Arabic_201.xml\n",
      "./Arabic/WMS_Arabic_49.xml\n",
      "./Arabic/WMS_Arabic_771.xml\n",
      "./Arabic/WMS_Arabic_822.xml\n",
      "./Arabic/WMS_Arabic_836.xml\n",
      "./Arabic/WMS_Arabic_407.xml\n",
      "./Arabic/WMS_Arabic_361.xml\n",
      "./Arabic/WMS_Arabic_375.xml\n",
      "./Arabic/WMS_Arabic_413.xml\n",
      "./Arabic/WMS_Arabic_439.xml\n",
      "./Arabic/WMS_Arabic_405.xml\n",
      "./Arabic/WMS_Arabic_411.xml\n",
      "./Arabic/WMS_Arabic_377.xml\n",
      "./Arabic/WMS_Arabic_607.xml\n",
      "./Arabic/WMS_Arabic_161.xml\n",
      "./Arabic/WMS_Arabic_175.xml\n",
      "./Arabic/WMS_Arabic_808.xml\n",
      "./Arabic/WMS_Arabic_773.xml\n",
      "./Arabic/WMS_Arabic_798.xml\n",
      "./Arabic/WMS_Arabic_202.xml\n",
      "./Arabic/WMS_Arabic_558.xml\n",
      "./Arabic/WMS_Arabic_62.xml\n",
      "./Arabic/WMS_Arabic_809.xml\n",
      "./Arabic/WMS_Arabic_174.xml\n",
      "./Arabic/WMS_Arabic_606.xml\n",
      "./Arabic/WMS_Arabic_148.xml\n",
      "./Arabic/WMS_Arabic_410.xml\n",
      "./Arabic/WMS_Arabic_376.xml\n",
      "./Arabic/WMS_Arabic_404.xml\n",
      "./Arabic/WMS_Arabic_438.xml\n",
      "./Arabic/WMS_Arabic_305.xml\n",
      "./Arabic/WMS_Arabic_463.xml\n",
      "./Arabic/WMS_Arabic_477.xml\n",
      "./Arabic/WMS_Arabic_311.xml\n",
      "./Arabic/WMS_Arabic_107.xml\n",
      "./Arabic/WMS_Arabic_675.xml\n",
      "./Arabic/MS_Arabic_881.xml\n",
      "./Arabic/WMS_Arabic_729.xml\n",
      "./Arabic/WMS_Arabic_11.xml\n",
      "./Arabic/WMS_Arabic_503.xml\n",
      "./Arabic/WMS_Arabic_259.xml\n",
      "./Arabic/WMS_Arabic_258.xml\n",
      "./Arabic/WMS_Arabic_10.xml\n",
      "./Arabic/WMS_Arabic_728.xml\n",
      "./Arabic/WMS_Arabic_714.xml\n",
      "./Arabic/WMS_Arabic_853.xml\n",
      "./Arabic/WMS_Arabic_847.xml\n",
      "./Arabic/MS_Arabic_894.xml\n",
      "./Arabic/WMS_Arabic_660.xml\n",
      "./Arabic/WMS_Arabic_489.xml\n",
      "./Arabic/WMS_Arabic_476.xml\n",
      "./Arabic/WMS_Arabic_462.xml\n",
      "./Arabic/WMS_Arabic_474.xml\n",
      "./Arabic/WMS_Arabic_460.xml\n",
      "./Arabic/WMS_Arabic_448.xml\n",
      "./Arabic/MS_Arabic_869.xml\n",
      "./Arabic/WMS_Arabic_662.xml\n",
      "./Arabic/MS_Arabic_855.xml\n",
      "./Arabic/WMS_Arabic_689.xml\n",
      "./Arabic/MS_Arabic_882.xml\n",
      "./Arabic/WMS_Arabic_716.xml\n",
      "./Arabic/WMS_Arabic_12.xml\n",
      "./Arabic/WMS_Arabic_528.xml\n",
      "./Arabic/WMS_Arabic_298.xml\n",
      "./Arabic/WMS_Arabic_529.xml\n",
      "./Arabic/WMS_Arabic_515.xml\n",
      "./Arabic/WMS_Arabic_273.xml\n",
      "./Arabic/WMS_Arabic_267.xml\n",
      "./Arabic/WMS_Arabic_13.xml\n",
      "./Arabic/WMS_Arabic_844.xml\n",
      "./Arabic/MS_Arabic_883.xml\n",
      "./Arabic/MS_Arabic_868.xml\n",
      "./Arabic/WMS_Arabic_6.xml\n",
      "./Arabic/WMS_Arabic_449.xml\n",
      "./Arabic/WMS_Arabic_461.xml\n",
      "./Arabic/WMS_Arabic_475.xml\n",
      "./Arabic/WMS_Arabic_459.xml\n",
      "./Arabic/WMS_Arabic_471.xml\n",
      "./Arabic/WMS_Arabic_465.xml\n",
      "./Arabic/WMS_Arabic_2.xml\n",
      "./Arabic/WMS_Arabic_673.xml\n",
      "./Arabic/MS_Arabic_887.xml\n",
      "./Arabic/WMS_Arabic_698.xml\n",
      "./Arabic/WMS_Arabic_840.xml\n",
      "./Arabic/WMS_Arabic_17.xml\n",
      "./Arabic/WMS_Arabic_277.xml\n",
      "./Arabic/WMS_Arabic_511.xml\n",
      "./Arabic/WMS_Arabic_289.xml\n",
      "./Arabic/WMS_Arabic_16.xml\n",
      "./Arabic/WMS_Arabic_841.xml\n",
      "./Arabic/WMS_Arabic_699.xml\n",
      "./Arabic/MS_Arabic_886.xml\n",
      "./Arabic/WMS_Arabic_100.xml\n",
      "./Arabic/MS_Arabic_879.xml\n",
      "./Arabic/WMS_Arabic_464.xml\n",
      "./Arabic/WMS_Arabic_470.xml\n",
      "./Arabic/WMS_Arabic_458.xml\n",
      "./Arabic/WMS_Arabic_466.xml\n",
      "./Arabic/WMS_Arabic_472.xml\n",
      "./Arabic/WMS_Arabic_1.xml\n",
      "./Arabic/WMS_Arabic_102.xml\n",
      "./Arabic/WMS_Arabic_664.xml\n",
      "./Arabic/WMS_Arabic_116.xml\n",
      "./Arabic/MS_Arabic_890.xml\n",
      "./Arabic/WMS_Arabic_843.xml\n",
      "./Arabic/MS_Arabic_884.xml\n",
      "./Arabic/WMS_Arabic_738.xml\n",
      "./Arabic/WMS_Arabic_14.xml\n",
      "./Arabic/WMS_Arabic_512.xml\n",
      "./Arabic/WMS_Arabic_274.xml\n",
      "./Arabic/WMS_Arabic_260.xml\n",
      "./Arabic/WMS_Arabic_506.xml\n",
      "./Arabic/WMS_Arabic_507.xml\n",
      "./Arabic/WMS_Arabic_513.xml\n",
      "./Arabic/WMS_Arabic_249.xml\n",
      "./Arabic/WMS_Arabic_15.xml\n",
      "./Arabic/WMS_Arabic_29.xml\n",
      "./Arabic/WMS_Arabic_711.xml\n",
      "./Arabic/WMS_Arabic_739.xml\n",
      "./Arabic/WMS_Arabic_117.xml\n",
      "./Arabic/WMS_Arabic_659.xml\n",
      "./Arabic/WMS_Arabic_498.xml\n",
      "./Arabic/WMS_Arabic_473.xml\n",
      "./Arabic/WMS_Arabic_467.xml\n",
      "./Ethiopian/Ethiopian_7.xml\n",
      "./Ethiopian/Ethiopian_14.xml\n",
      "./Ethiopian/Ethiopian_15.xml\n",
      "./Ethiopian/Ethiopian_6.xml\n",
      "./Ethiopian/Ethiopian_4.xml\n",
      "./Ethiopian/Ethiopian_17.xml\n",
      "./Ethiopian/Ethiopian_16.xml\n",
      "./Ethiopian/Ethiopian_5.xml\n",
      "./Ethiopian/Ethiopian_1.xml\n",
      "./Ethiopian/Ethiopian_12.xml\n",
      "./Ethiopian/Ethiopian_13.xml\n",
      "./Ethiopian/Ethiopian_10.xml\n",
      "./Ethiopian/Ethiopian_3.xml\n",
      "./Ethiopian/Ethiopian_21.xml\n",
      "./Ethiopian/Ethiopian_20.xml\n",
      "./Ethiopian/Ethiopian_22.xml\n",
      "./Ethiopian/Ethiopian_23.xml\n",
      "./Ethiopian/Ethiopian_8.xml\n",
      "./Ethiopian/Ethiopian_27.xml\n",
      "./Ethiopian/Ethiopian_26.xml\n",
      "./Ethiopian/Ethiopian_9.xml\n",
      "./Ethiopian/Ethiopian_18.xml\n",
      "./Ethiopian/Ethiopian_24.xml\n",
      "./Ethiopian/Ethiopian_25.xml\n",
      "./Ethiopian/Ethiopian_19.xml\n"
     ]
    }
   ],
   "source": [
    "import os\n",
    "\n",
    "# . = current directory\n",
    "\n",
    "def find_tei_files(repo_path):\n",
    "    for dirpath, dirnames, filenames in os.walk(repo_path):\n",
    "        for f in filenames:\n",
    "            path = os.path.join(dirpath, f)\n",
    "\n",
    "            if not path.endswith('.xml'):\n",
    "                continue\n",
    "\n",
    "            if path.startswith('./Templates/'):\n",
    "                continue\n",
    "\n",
    "            if path.startswith('./docs/'):\n",
    "                continue\n",
    "\n",
    "            if path.startswith('./Arabic/Fihrist/'):\n",
    "                continue\n",
    "\n",
    "            yield path\n",
    "\n",
    "\n",
    "for path in find_tei_files('.'):\n",
    "    print(path)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notes on what we discussed:\n",
    "\n",
    "*   The `os` is a *module* (or *library* or *package*) of code that contains functions for working with operating systems (hence 'os').\n",
    "    Modules/libraries/packages are how developers can share their code with other developers, so everyone isn't starting from scratch.\n",
    "    \n",
    "    The `os.walk` function walks all the files in a directory tree.\n",
    "    \n",
    "    By using a module, we have something that will work on lots of operating systems, even though they behave differently.\n",
    "    e.g. folders are different on Windows and Mac, but this will handle that for us.\n",
    "\n",
    "*   We're constructing paths to all the files in the repo, then we're inspecting them to see if they're TEI files we're interested in.\n",
    "\n",
    "    The `continue` keyword tells Python to skip to the next iteration of the loop.\n",
    "    \n",
    "*   The `yield` keyword lets us use this function in another `for path in find_tei_files(…)` type loop – it says \"pass this path on the next step of the iteration\".\n",
    "\n",
    "*   The `.` is a special path that means \"the current directory\".\n",
    "    Because I'm working in the root of a TEI repository, it's running there."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 2. Extract the fields we want\n",
    "\n",
    "This script uses an XML-parsing library to extract certain fields, rather than trying to deal with XML strings by hand.\n",
    "We did some `string.startswith(…)` and `string.endswith(…)` in the previous step, but XML is far more complicated."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Charms and demonology. Though the term \"demonology\" is used in the manuscript itself, the creatures being described are known in Malay as \"hantu\", which differs from the Western conception of demons in that the term is commonly used to describe spirits and mythological creatures in general, both malicious and not. Though some may also be called demons or syaitan in the Islamic sense, not all hantu are necessarily demonic.\n"
     ]
    }
   ],
   "source": [
    "def cleanup_text(s):\n",
    "    lines = s.splitlines()\n",
    "    \n",
    "    trimmed_lines = [line.strip() for line in lines]\n",
    "    \n",
    "    return ' '.join(trimmed_lines)\n",
    "\n",
    "demons = '''Charms and demonology. Though the term \"demonology\" is used in the manuscript itself, the creatures being described are known in Malay as \"hantu\", \n",
    "                            which differs from the Western conception of demons in that the term is commonly used to describe spirits and mythological creatures in general, both\n",
    "                            malicious and not. Though some may also be called demons or syaitan in the Islamic sense, not all hantu are necessarily demonic.'''\n",
    "\n",
    "print(cleanup_text(demons))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [],
   "source": [
    "from xml.etree import ElementTree as ET\n",
    "\n",
    "def extract_tei_metadata_fields(tei_file_paths):\n",
    "    for path in tei_file_paths:\n",
    "        print(path)\n",
    "\n",
    "        root = ET.parse(path).getroot()\n",
    "\n",
    "        msContents = root.find('.//{http://www.tei-c.org/ns/1.0}msContents')\n",
    "\n",
    "        # msContents/summary\n",
    "\n",
    "        summary_tag = msContents.find('.//{http://www.tei-c.org/ns/1.0}summary')\n",
    "\n",
    "        if summary_tag is not None:\n",
    "            summary = cleanup_text(''.join(summary_tag.itertext()))\n",
    "        else:\n",
    "            summary = ''\n",
    "\n",
    "        # <idno type=\"msID\">\n",
    "\n",
    "        idno = root.find('.//{http://www.tei-c.org/ns/1.0}idno[@type=\"msID\"]').text\n",
    "\n",
    "        # <altIdentifier>\n",
    "\n",
    "        identifiers_sierra = []\n",
    "        identifiers_accession_number = []\n",
    "        identifiers_other = []\n",
    "\n",
    "        for identifier in root.findall('.//{http://www.tei-c.org/ns/1.0}altIdentifier'):\n",
    "            identifier_contents = identifier.find('.//{http://www.tei-c.org/ns/1.0}idno').text\n",
    "            \n",
    "            if not identifier_contents:\n",
    "                continue\n",
    "\n",
    "            if identifier.attrib.get('type') == 'Sierra':\n",
    "                identifiers_sierra.append(identifier_contents)\n",
    "\n",
    "            elif identifier.attrib.get('type') == 'accession':\n",
    "                identifiers_accession_number.append(identifier_contents)\n",
    "\n",
    "            else:\n",
    "                identifiers_other.append(identifier_contents)\n",
    "\n",
    "        # <textLang>\n",
    "\n",
    "        languages = []\n",
    "\n",
    "        for lang in msContents.findall('.//{http://www.tei-c.org/ns/1.0}textLang'):\n",
    "            if not lang.text:\n",
    "                continue\n",
    "            \n",
    "            if lang.text in languages:\n",
    "                continue\n",
    "\n",
    "            languages.append(lang.text)\n",
    "\n",
    "        yield {\n",
    "            'Title/s or Brief Description (245)': summary,\n",
    "            'Main Identifier': idno,\n",
    "            # MS1; MS2; MS3\n",
    "            'Alternative Identifiers (separate with semicolons)': '; '.join(identifiers_other),\n",
    "            'Accession Number': '; '.join(identifiers_accession_number),\n",
    "            'System No.': '; '.join(identifiers_sierra),\n",
    "            # Arabic; Hebrew; Hindi\n",
    "            'Language': '; '.join(languages),\n",
    "        }"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notes on our discussion:\n",
    "\n",
    "*   The `.find(…)` and `.findall(…)` methods are an XPATH-like syntax (I can't remember if this function supports full XPATH or a limited subset).\n",
    "    XPATH is a syntax for finding fields in HTML.\n",
    "    \n",
    "*   The curly braces are an XML *namespace*.\n",
    "    If you look at the top of a TEI file, this is in the `xmlns` attribute, e.g.:\n",
    "    \n",
    "    ```xml\n",
    "    <?xml version=\"1.0\" encoding=\"UTF-8\"?>\n",
    "    <?xml-model href=\"https://raw.githubusercontent.com/bodleian/consolidated-tei-schema/master/msdesc.rng\" type=\"application/xml\" schematypens=\"http://relaxng.org/ns/structure/1.0\"?>\n",
    "\n",
    "    <TEI xmlns=\"http://www.tei-c.org/ns/1.0\" xml:id=\"Hebrew_A_11\">\n",
    "      ...\n",
    "    ```\n",
    "    \n",
    "    So `{http://www.tei-c.org/ns/1.0}msContents` means:\n",
    "    \n",
    "    > look for an `<msContents>` tag in the `http://www.tei-c.org/ns/1.0` namespace\n",
    "    \n",
    "    This distinguishes it from an `<msContents>` tag in a different namespace, which might have a different meaning.\n",
    "\n",
    "*   Python (and other programming languages) will distinguish between the absence of a value and an empty value.\n",
    "    It treats these two scenarios as different:\n",
    "    \n",
    "    ```xml\n",
    "    # absence of a value\n",
    "    <summary/>\n",
    "    \n",
    "    # empty value\n",
    "    <summary></summary>\n",
    "    ```\n",
    "    \n",
    "    In the first case, if we ask for the text in a tag, we get the special value `None`, which tells us there's nothing in the tag.\n",
    "    \n",
    "    In the second case, if we ask for the text in a tag, we get the empty string `''`, which tells us there is text, but it's empty.\n",
    "    \n",
    "*   Initially we did `.text` to get the text in a tag, but that only finds the text immediately below the tag.\n",
    "    e.g.\n",
    "    \n",
    "    ```xml\n",
    "    <title>This was written by <persName>Ptolemy</persName></title>\n",
    "    ```\n",
    "    \n",
    "    If you do `.text`, you get `'This was written by '`, because `'Ptolemy'` is in a different tag.\n",
    "    \n",
    "    We looked in the docs and discovered we had to use `.itertext()` to include text from the child tags.\n",
    "\n",
    "*   Because of the way the XML is written, there's lots of extra whitespace in the text of the `<summary>` tags.\n",
    "    The `cleanup_text()` function removes it.\n",
    "\n",
    "*   We're generating *dict* values (short for *dictionary*).\n",
    "    These are key-value pairs, similar to JSON."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 3. Write those fields to a spreadsheet\n",
    "\n",
    "We can now combine the two iterators we've made and write another for loop that saves all the data to a spreadsheet:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {
    "collapsed": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "./WMS_Arabic_65.xml\n",
      "./Malay/Wellcome_MS_Malay_10.xml\n",
      "./Malay/Wellcome_MS_Malay_8.xml\n",
      "./Malay/Wellcome_MS_Malay_9.xml\n",
      "./Malay/Wellcome_MS_Malay_7.xml\n",
      "./Malay/Wellcome_MS_Malay_6.xml\n",
      "./Malay/Wellcome_MS_Malay_4.xml\n",
      "./Malay/Wellcome_MS_Malay_5.xml\n",
      "./Malay/Wellcome_MS_Malay_1.xml\n",
      "./Malay/Wellcome_MS_Malay_2.xml\n",
      "./Malay/Wellcome_MS_Malay_3.xml\n",
      "./Karshuni/Karshuni_3.xml\n",
      "./Karshuni/Karshuni_2.xml\n",
      "./Karshuni/Karshuni_1.xml\n",
      "./Indic/Indic_Alpha_2075.xml\n",
      "./Indic/B_20_m.xml\n",
      "./Indic/E.11.v.xml\n",
      "./Indic/E.11.a.xml\n",
      "./Indic/Indic_Alpha_2101.xml\n",
      "./Indic/Indic_Alpha_2129.xml\n",
      "./Indic/Indic_Alpha_2128.xml\n",
      "./Indic/Indic_Alpha_2100.xml\n",
      "./Indic/Indic_Alpha_2114.xml\n",
      "./Indic/Indic_Alpha_91.xml\n",
      "./Indic/E.11.w.xml\n",
      "./Indic/Indic_Alpha_124.xml\n",
      "./Indic/B_20_l.xml\n",
      "./Indic/Indic_Alpha_2074.xml\n",
      "./Indic/Indic_Alpha_2076.xml\n",
      "./Indic/B_20_n.xml\n",
      "./Indic/Indic_Alpha_2089.xml\n",
      "./Indic/Indic_Alpha_1999.xml\n",
      "./Indic/E.11.u.xml\n",
      "./Indic/E.11.b.xml\n",
      "./Indic/P.81.I.xml\n",
      "./Indic/Indic_Alpha_2102.xml\n",
      "./Indic/Indic_Alpha_2103.xml\n",
      "./Indic/E.11.c.xml\n",
      "./Indic/Indic_Alpha_709.xml\n",
      "./Indic/E.11.t.xml\n",
      "./Indic/Indic_Alpha_1998.xml\n",
      "./Indic/Indic_Alpha_2088.xml\n",
      "./Indic/B_20_o.xml\n",
      "./Indic/Indic_Alpha_2077.xml\n",
      "./Indic/Indic_Alpha_2073.xml\n",
      "./Indic/Indic_Alpha_2067.xml\n",
      "./Indic/E.11.aa.xml\n",
      "./Indic/Indic_Alpha_2098.xml\n",
      "./Indic/Indic_Alpha_686.xml\n",
      "./Indic/E.11.g.xml\n",
      "./Indic/E.11.p.xml\n",
      "./Indic/E.11.e.A.xml\n",
      "./Indic/Indic_Alpha_2107.xml\n",
      "./Indic/Indic_Alpha_2113.xml\n",
      "./Indic/Indic_Alpha_2112.xml\n",
      "./Indic/Indic_Alpha_2106.xml\n",
      "./Indic/Indic_Alpha_68.xml\n",
      "./Indic/E.11.q.xml\n",
      "./Indic/E.11.f.xml\n",
      "./Indic/Indic_Alpha_687.xml\n",
      "./Indic/Indic_Alpha_2099.xml\n",
      "./Indic/Indic_Alpha_2066.xml\n",
      "./Indic/Indic_Alpha_2072.xml\n",
      "./Indic/Indic_Alpha_1221.xml\n",
      "./Indic/Indic_Alpha_2070.xml\n",
      "./Indic/B_19_l.xml\n",
      "./Indic/Indic_Alpha_685.xml\n",
      "./Indic/Indic_Beta_520.xml\n",
      "./Indic/E.11.d.xml\n",
      "./Indic/E.11.s.xml\n",
      "./Indic/E.11.e.B.xml\n",
      "./Indic/Indic_Alpha_2138.xml\n",
      "./Indic/Indic_Alpha_2110.xml\n",
      "./Indic/Indic_Alpha_2104.xml\n",
      "./Indic/Indic_Alpha_2105.xml\n",
      "./Indic/Indic_Alpha_2111.xml\n",
      "./Indic/Indic_Alpha_2139.xml\n",
      "./Indic/I.57.a.xml\n",
      "./Indic/E.11.r.xml\n",
      "./Indic/Indic_Alpha_80.xml\n",
      "./Indic/Indic_Beta_521.xml\n",
      "./Indic/Indic_Alpha_684.xml\n",
      "./Indic/Indic_Alpha_121.xml\n",
      "./Indic/Indic_Alpha_2071.xml\n",
      "./Indic/Indic_Alpha_2065.xml\n",
      "./Indic/Indic_Alpha_1222.xml\n",
      "./Indic/Indic_Alpha_378.xml\n",
      "./Indic/Indic_Alpha_2002.xml\n",
      "./Indic/Indic_Alpha_2016.xml\n",
      "./Indic/Indic_Alpha_387.xml\n",
      "./Indic/Indic_Alpha_393.xml\n",
      "./Indic/Indic_Beta_585.xml\n",
      "./Indic/G_27_b.xml\n",
      "./Indic/Indic_Alpha_146.xml\n",
      "./Indic/Indic_Alpha_2228.xml\n",
      "./Indic/MS_Indic_Gamma_351.xml\n",
      "./Indic/Indic_Alpha_18.xml\n",
      "./Indic/Indic_Alpha_556.xml\n",
      "./Indic/O.29.e.xml\n",
      "./Indic/O.29.d.xml\n",
      "./Indic/Indic_Alpha_557.xml\n",
      "./Indic/MS_Indic_Alpha_170_1-3.xml\n",
      "./Indic/E.11.dd.B.xml\n",
      "./Indic/O.24._.xml\n",
      "./Indic/Indic_Alpha_2229.xml\n",
      "./Indic/G_27_c.xml\n",
      "./Indic/Indic_Alpha_392.xml\n",
      "./Indic/Indic_Alpha_386.xml\n",
      "./Indic/Indic_Alpha_379.xml\n",
      "./Indic/Indic_Alpha_2003.xml\n",
      "./Indic/Indic_Alpha_2015.xml\n",
      "./Indic/Indic_Alpha_2001.xml\n",
      "./Indic/MS_Indic_Alpha 113.xml\n",
      "./Indic/Indic_Alpha_390.xml\n",
      "./Indic/Indic_Alpha_384.xml\n",
      "./Indic/Indic_Beta_2199.xml\n",
      "./Indic/Indic_Beta_2198.xml\n",
      "./Indic/E.11.dd.A.xml\n",
      "./Indic/Indic_Alpha_385.xml\n",
      "./Indic/Indic_Alpha_391.xml\n",
      "./Indic/Indic_Alpha_2000.xml\n",
      "./Indic/Indic_Alpha_2014.xml\n",
      "./Indic/Indic_Alpha_2010.xml\n",
      "./Indic/E.11.ff.xml\n",
      "./Indic/Indic_Alpha_2004.xml\n",
      "./Indic/Indic_Alpha_395.xml\n",
      "./Indic/Indic_Alpha_381.xml\n",
      "./Indic/G_27_d.xml\n",
      "./Indic/G_27_e.xml\n",
      "./Indic/Indic_Alpha_380.xml\n",
      "./Indic/Indic_Alpha_394.xml\n",
      "./Indic/Indic_Alpha_2005.xml\n",
      "./Indic/Indic_Beta_2200.xml\n",
      "./Indic/Indic_Alpha_2011.xml\n",
      "./Indic/Indic_Alpha_2007.xml\n",
      "./Indic/Indic_Alpha_369.xml\n",
      "./Indic/Indic_Alpha_2013.xml\n",
      "./Indic/Indic_Alpha_382.xml\n",
      "./Indic/Indic_Alpha_396.xml\n",
      "./Indic/Indic_Alpha_2239.xml\n",
      "./Indic/G_27_g.xml\n",
      "./Indic/B_20_bbb.xml\n",
      "./Indic/Indic_Gamma_508.xml\n",
      "./Indic/G.40.xml\n",
      "./Indic/G_27_f.xml\n",
      "./Indic/Indic_Alpha_2238.xml\n",
      "./Indic/Indic_Alpha_397.xml\n",
      "./Indic/Indic_Alpha_383.xml\n",
      "./Indic/Indic_Alpha_368.xml\n",
      "./Indic/Indic_Alpha_2012.xml\n",
      "./Indic/Indic_Alpha_2006.xml\n",
      "./Indic/P.81.II.xml\n",
      "./Indic/E.11.ee.xml\n",
      "./Indic/Indic_Alpha_403.xml\n",
      "./Indic/Indic_Alpha_371.xml\n",
      "./Indic/Indic_Alpha_2235.xml\n",
      "./Indic/G.65.xml\n",
      "./Indic/Indic_Gamma_277.xml\n",
      "./Indic/Indic_Beta_638.xml\n",
      "./Indic/Indic_Alpha_562.xml\n",
      "./Indic/Indic_Alpha_38.xml\n",
      "./Indic/Indic_Alpha_2234.xml\n",
      "./Indic/Indic_Alpha_370.xml\n",
      "./Indic/Indic_Alpha_402.xml\n",
      "./Indic/Indic_Alpha_372.xml\n",
      "./Indic/Indic_Alpha_2008.xml\n",
      "./Indic/Indic_Alpha_414.xml\n",
      "./Indic/Indic_Alpha_400.xml\n",
      "./Indic/Indic_Alpha_399.xml\n",
      "./Indic/Indic_Alpha_2236.xml\n",
      "./Indic/Indic_Alpha_2140.xml\n",
      "./Indic/Indic_Alpha_560.xml\n",
      "./Indic/Indic_Alpha_561.xml\n",
      "./Indic/Indic_Alpha_978.xml\n",
      "./Indic/Indic_Alpha_2237.xml\n",
      "./Indic/Indic_Alpha_398.xml\n",
      "./Indic/Indic_Alpha_401.xml\n",
      "./Indic/Indic_Alpha_373.xml\n",
      "./Indic/Indic_Alpha_2009.xml\n",
      "./Indic/Indic_Alpha_377.xml\n",
      "./Indic/Indic_Alpha_405.xml\n",
      "./Indic/Indic_Alpha_388.xml\n",
      "./Indic/Indic_Alpha_2233.xml\n",
      "./Indic/Indic_Alpha_2227.xml\n",
      "./Indic/Indic_Alpha_559.xml\n",
      "./Indic/Indic_Alpha_558.xml\n",
      "./Indic/O.29.b.A.xml\n",
      "./Indic/Indic_Alpha_2232.xml\n",
      "./Indic/Indic_Alpha_389.xml\n",
      "./Indic/Indic_Alpha_404.xml\n",
      "./Indic/Indic_Alpha_376.xml\n",
      "./Indic/Indic_Alpha_406.xml\n",
      "./Indic/Indic_Alpha_374.xml\n",
      "./Indic/E.11.kk.xml\n",
      "./Indic/Indic_Alpha_2230.xml\n",
      "./Indic/Indic_Beta_210.xml\n",
      "./Indic/Indic_Alpha_28.xml\n",
      "./Indic/O.29.b.B.xml\n",
      "./Indic/Indic_Beta_2183.xml\n",
      "./Indic/Indic_Beta_2197.xml\n",
      "./Indic/Indic_Alpha_2231.xml\n",
      "./Indic/Indic_Alpha_375.xml\n",
      "./Indic/E.11.bb.xml\n",
      "./Indic/Indic_Alpha_2068.xml\n",
      "./Indic/B_20_s.xml\n",
      "./Indic/Indic_Alpha_2083.xml\n",
      "./Indic/Indic_Alpha_2097.xml\n",
      "./Indic/Indic_Alpha_2242.xml\n",
      "./Indic/MS_Indic_Alpha_170_2.xml\n",
      "./Indic/O.24.b.xml\n",
      "./Indic/Indic_Alpha_689.xml\n",
      "./Indic/E.11.h.xml\n",
      "./Indic/Indic_Alpha_2134.xml\n",
      "./Indic/Indic_Alpha_2120.xml\n",
      "./Indic/Indic_Alpha_2108.xml\n",
      "./Indic/G.32.a.xml\n",
      "./Indic/Indic_Alpha_2109.xml\n",
      "./Indic/Indic_Alpha_2121.xml\n",
      "./Indic/Indic_Alpha_2135.xml\n",
      "./Indic/E.11.i.xml\n",
      "./Indic/Indic_Alpha_688.xml\n",
      "./Indic/O.24.c.xml\n",
      "./Indic/MS_Indic_Alpha_170_3.xml\n",
      "./Indic/Indic_Alpha_2243.xml\n",
      "./Indic/Indic_Alpha_2096.xml\n",
      "./Indic/Indic_Alpha_2082.xml\n",
      "./Indic/B_20_r.xml\n",
      "./Indic/Indic_Alpha_2069.xml\n",
      "./Indic/Indic_Alpha_2094.xml\n",
      "./Indic/B_20_p.xml\n",
      "./Indic/Indic_Alpha_2080.xml\n",
      "./Indic/MS_Indic_Alpha_170_1.xml\n",
      "./Indic/Indic_Alpha_2241.xml\n",
      "./Indic/O.24.a.xml\n",
      "./Indic/Indic_Alpha_932.xml\n",
      "./Indic/Indic_Alpha_2123.xml\n",
      "./Indic/Indic_Alpha_2137.xml\n",
      "./Indic/G.32.c.xml\n",
      "./Indic/G.32.b.xml\n",
      "./Indic/Indic_Alpha_2136.xml\n",
      "./Indic/Indic_Alpha_2122.xml\n",
      "./Indic/E.11.j.xml\n",
      "./Indic/Indic_Alpha_2240.xml\n",
      "./Indic/Indic_Alpha_2081.xml\n",
      "./Indic/B_20_q.xml\n",
      "./Indic/Indic_Alpha_2095.xml\n",
      "./Indic/Indic_Alpha_2091.xml\n",
      "./Indic/Indic_Alpha_2085.xml\n",
      "./Indic/Indic_Alpha_2244.xml\n",
      "./Indic/E.11.y.xml\n",
      "./Indic/Indic_Alpha_710.xml\n",
      "./Indic/E.11.n.xml\n",
      "./Indic/Indic_Alpha_2132.xml\n",
      "./Indic/G.32.f.xml\n",
      "./Indic/Indic_Alpha_2133.xml\n",
      "./Indic/Indic_Alpha_2127.xml\n",
      "./Indic/E.11.o.xml\n",
      "./Indic/Indic_Alpha_711.xml\n",
      "./Indic/E.11.x.xml\n",
      "./Indic/O.24.e.xml\n",
      "./Indic/B_20_fff.xml\n",
      "./Indic/Indic_Alpha_2245.xml\n",
      "./Indic/Indic_Alpha_2084.xml\n",
      "./Indic/Indic_Alpha_2090.xml\n",
      "./Indic/Indic_Alpha_2079.xml\n",
      "./Indic/E.11.cc.xml\n",
      "./Indic/Indic_Alpha_2086.xml\n",
      "./Indic/Indic_Alpha_2092.xml\n",
      "./Indic/Indic_Alpha_1996.xml\n",
      "./Indic/E.11.z.xml\n",
      "./Indic/E.11.m.xml\n",
      "./Indic/Indic_Alpha_2131.xml\n",
      "./Indic/Indic_Alpha_2125.xml\n",
      "./Indic/G.32.e.xml\n",
      "./Indic/G.32.d.xml\n",
      "./Indic/Indic_Alpha_2124.xml\n",
      "./Indic/Indic_Alpha_2130.xml\n",
      "./Indic/E.11.l.xml\n",
      "./Indic/Indic_Alpha_712.xml\n",
      "./Indic/Indic_Alpha_1997.xml\n",
      "./Indic/Indic_Alpha_2093.xml\n",
      "./Indic/Indic_Alpha_2087.xml\n",
      "./Indic/Indic_Alpha_2078.xml\n",
      "./Japanese/Japanese_79.xml\n",
      "./Japanese/Japanese_86.xml\n",
      "./Japanese/Japanese_52.xml\n",
      "./Japanese/Japanese_85.xml\n",
      "./Japanese/Japanese_94.xml\n",
      "./Japanese/Japanese_82.xml\n",
      "./Japanese/Japanese_27.xml\n",
      "./Japanese/Japanese _17.xml\n",
      "./Japanese/Japanese_116.xml\n",
      "./Japanese/Japanese_100.xml\n",
      "./Japanese/Japanese_125.xml\n",
      "./Japanese/Japanese_119.xml\n",
      "./Japanese/Japanese_28.xml\n",
      "./Japanese/Japanese_29.xml\n",
      "./Japanese/Japanese_16.xml\n",
      "./Japanese/Japanese_59.xml\n",
      "./Japanese/Japanese_58.xml\n",
      "./Japanese/Japanese_99.xml\n",
      "./Japanese/Japanese_98.xml\n",
      "./Japanese/Japanese_88.xml\n",
      "./Japanese/Japanese_63.xml\n",
      "./Japanese/Japanese_61.xml\n",
      "./Syriac/Syriac_1.xml\n",
      "./Syriac/Syriac_2.xml\n",
      "./Javanese/Javanese_3.xml\n",
      "./Javanese/Javanese_2.xml\n",
      "./Javanese/Javanese_1.xml\n",
      "./Javanese/Javanese_5.xml\n",
      "./Javanese/Javanese_4.xml\n",
      "./Javanese/Javanese_6.xml\n",
      "./Javanese/Javanese_7.xml\n",
      "./Javanese/Javanese_9.xml\n",
      "./Javanese/Javanese_10.xml\n",
      "./Javanese/Javanese_11.xml\n",
      "./Javanese/Javanese_8.xml\n",
      "./Tibetan/MS_Tibetan_134.xml\n",
      "./Tibetan/MS_Tibetan_133.xml\n",
      "./Greek/MS_289.xml\n",
      "./Greek/MS_498.xml\n",
      "./Greek/MS_MSL_52.xml\n",
      "./Greek/MS_4103.xml\n",
      "./Greek/MS_MSL_124.xml\n",
      "./Greek/MS_MSL_126.xml\n",
      "./Greek/MS_413.xml\n",
      "./Greek/MS_MSL_135.xml\n",
      "./Greek/MS_MSL_109.xml\n",
      "./Greek/MS_MSL_112.xml\n",
      "./Greek/MS_354.xml\n",
      "./Greek/MS_MSL_1.xml\n",
      "./Greek/MS_MSL_114.xml\n",
      "./Greek/MS_MSL_14.xml\n",
      "./Hebrew/Hebrew_A_11.xml\n",
      "./Hebrew/Hebrew_B_54.xml\n",
      "./Hebrew/Hebrew_B_40.xml\n",
      "./Hebrew/Hebrew_B_41.xml\n",
      "./Hebrew/Hebrew_B_55.xml\n",
      "./Hebrew/Hebrew_A_10.xml\n",
      "./Hebrew/Hebrew_A_12.xml\n",
      "./Hebrew/Hebrew_B_43.xml\n",
      "./Hebrew/Hebrew_B_57.xml\n",
      "./Hebrew/Hebrew_B_56.xml\n",
      "./Hebrew/Hebrew_B_42.xml\n",
      "./Hebrew/Hebrew_A_13.xml\n",
      "./Hebrew/Hebrew_A_17.xml\n",
      "./Hebrew/Hebrew_B_46.xml\n",
      "./Hebrew/Hebrew_B_52.xml\n",
      "./Hebrew/Hebrew_B_53.xml\n",
      "./Hebrew/Hebrew_B_47.xml\n",
      "./Hebrew/Hebrew_A_16.xml\n",
      "./Hebrew/Hebrew_A_14.xml\n",
      "./Hebrew/Hebrew_A_28.xml\n",
      "./Hebrew/Hebrew_B_51.xml\n",
      "./Hebrew/Hebrew_B_45.xml\n",
      "./Hebrew/Hebrew_A_9.xml\n",
      "./Hebrew/Hebrew_A_8.xml\n",
      "./Hebrew/Hebrew_B_44.xml\n",
      "./Hebrew/Hebrew_B_50.xml\n",
      "./Hebrew/Hebrew_A_29.xml\n",
      "./Hebrew/Hebrew_A_15.xml\n",
      "./Hebrew/Hebrew_B_37.xml\n",
      "./Hebrew/Hebrew_B_23.xml\n",
      "./Hebrew/Hebrew_B_22.xml\n",
      "./Hebrew/Hebrew_B_36.xml\n",
      "./Hebrew/Hebrew_B_20.xml\n",
      "./Hebrew/Hebrew_B_34.xml\n",
      "./Hebrew/Hebrew_B_35.xml\n",
      "./Hebrew/Hebrew_B_21.xml\n",
      "./Hebrew/Hebrew_B_19.xml\n",
      "./Hebrew/Hebrew_B_25.xml\n",
      "./Hebrew/Hebrew_B_31.xml\n",
      "./Hebrew/Hebrew_B_30.xml\n",
      "./Hebrew/Hebrew_B_24.xml\n",
      "./Hebrew/Hebrew_B_18.xml\n",
      "./Hebrew/Hebrew_B_32.xml\n",
      "./Hebrew/Hebrew_B_26.xml\n",
      "./Hebrew/Hebrew_B_8.xml\n",
      "./Hebrew/Hebrew_B_9.xml\n",
      "./Hebrew/Hebrew_B_27.xml\n",
      "./Hebrew/Hebrew_B_33.xml\n",
      "./Hebrew/Hebrew_B_16.xml\n",
      "./Hebrew/Hebrew_B_4.xml\n",
      "./Hebrew/Hebrew_B_5.xml\n",
      "./Hebrew/Hebrew_B_17.xml\n",
      "./Hebrew/Hebrew_B_15.xml\n",
      "./Hebrew/Hebrew_B_29.xml\n",
      "./Hebrew/Hebrew_B_7.xml\n",
      "./Hebrew/Hebrew_B_6.xml\n",
      "./Hebrew/Hebrew_B_28.xml\n",
      "./Hebrew/Hebrew_B_14.xml\n",
      "./Hebrew/Hebrew_B_38.xml\n",
      "./Hebrew/Hebrew_B_10.xml\n",
      "./Hebrew/Hebrew_B_2.xml\n",
      "./Hebrew/Hebrew_B_3.xml\n",
      "./Hebrew/Hebrew_B_11.xml\n",
      "./Hebrew/Hebrew_B_39.xml\n",
      "./Hebrew/Hebrew_B_13.xml\n",
      "./Hebrew/Hebrew_B_1.xml\n",
      "./Hebrew/Hebrew_B_12.xml\n",
      "./Hebrew/Hebrew_A_18.xml\n",
      "./Hebrew/Hebrew_A_24.xml\n",
      "./Hebrew/Hebrew_A_30.xml\n",
      "./Hebrew/Hebrew_B_49.xml\n",
      "./Hebrew/Hebrew_A_5.xml\n",
      "./Hebrew/Hebrew_A_4.xml\n",
      "./Hebrew/Hebrew_B_48.xml\n",
      "./Hebrew/Hebrew_A_31.xml\n",
      "./Hebrew/Hebrew_A_25.xml\n",
      "./Hebrew/Hebrew_A_19.xml\n",
      "./Hebrew/Hebrew_A_33.xml\n",
      "./Hebrew/Hebrew_A_27.xml\n",
      "./Hebrew/Hebrew_A_6.xml\n",
      "./Hebrew/Hebrew_A_7.xml\n",
      "./Hebrew/Hebrew_A_26.xml\n",
      "./Hebrew/Hebrew_A_32.xml\n",
      "./Hebrew/Hebrew_A_36.xml\n",
      "./Hebrew/Hebrew_A_22.xml\n",
      "./Hebrew/Hebrew_A_3.xml\n",
      "./Hebrew/Hebrew_A_2.xml\n",
      "./Hebrew/Hebrew_A_21.xml\n",
      "./Hebrew/Hebrew_A_35.xml\n",
      "./Hebrew/Hebrew_B_58.xml\n",
      "./Hebrew/Hebrew_A23.xml\n",
      "./Hebrew/Hebrew_A_1.xml\n",
      "./Hebrew/Hebrew_A_34.xml\n",
      "./Hebrew/Hebrew_A_20.xml\n",
      "./Spanish/MS.939.xml\n",
      "./Spanish/WMS_Amer.17.xml\n",
      "./Spanish/WMS_Amer.8.xml.xml\n",
      "./Spanish/WMS_Amer.16.xml\n",
      "./Spanish/WMS_Amer.14.xml\n",
      "./Spanish/MS.191.xml\n",
      "./Spanish/MS.963.xml\n",
      "./Spanish/WMS_Amer.12.xml\n",
      "./Spanish/WMS_Amer.9.xml.xml\n",
      "./Spanish/MS.171.xml\n",
      "./Spanish/MS.1330.xml\n",
      "./Spanish/WMS_Amer.10.xml.xml\n",
      "./Spanish/MS.99.xml\n",
      "./Spanish/WMS_Amer.20.xml\n",
      "./Spanish/WMS_Amer.27.xml.xml\n",
      "./Spanish/WMS_Amer.18.xml\n",
      "./Spanish/MS.759.xml\n",
      "./Spanish/MS.598.xml\n",
      "./Spanish/WMS_Amer.4.xml.xml\n",
      "./Spanish/WMS_Amer.19.xml\n",
      "./Spanish/WMS_Amer.11.xml.xml\n",
      "./Spanish/MS.363.xml\n",
      "./Spanish/WMS_Amer.6.xml.xml\n",
      "./Spanish/MS.1422.xml\n",
      "./Spanish/WMS_Amer.7.xml.xml\n",
      "./Tamil/Tamil_42.xml\n",
      "./Tamil/Tamil_30.xml\n",
      "./Tamil/Tamil_24.xml\n",
      "./Tamil/Tamil_18.xml\n",
      "./Tamil/Tamil_2.xml\n",
      "./Tamil/Tamil_3.xml\n",
      "./Tamil/Tamil_19.xml\n",
      "./Tamil/Tamil_25.xml\n",
      "./Tamil/Tamil_27.xml\n",
      "./Tamil/Tamil_33.xml\n",
      "./Tamil/Tamil_1.xml\n",
      "./Tamil/Tamil_32.xml\n",
      "./Tamil/Tamil_26.xml\n",
      "./Tamil/Tamil_22.xml\n",
      "./Tamil/Tamil_36.xml\n",
      "./Tamil/Tamil_4.xml\n",
      "./Tamil/Tamil_5.xml\n",
      "./Tamil/Tamil_37.xml\n",
      "./Tamil/Tamil_23.xml\n",
      "./Tamil/Tamil_35.xml\n",
      "./Tamil/Tamil_21.xml\n",
      "./Tamil/Tamil_7.xml\n",
      "./Tamil/Tamil_6.xml\n",
      "./Tamil/Tamil_20.xml\n",
      "./Tamil/Tamil_34.xml\n",
      "./Tamil/Tamil_11.xml\n",
      "./Tamil/Tamil_38.xml\n",
      "./Tamil/Tamil_10.xml\n",
      "./Tamil/Tamil_12.xml\n",
      "./Tamil/Tamil_8.xml\n",
      "./Tamil/Tamil_9.xml\n",
      "./Tamil/Tamil_13.xml\n",
      "./Tamil/Tamil_17.xml\n",
      "./Tamil/Tamil_28.xml\n",
      "./Tamil/Tamil_14.xml\n",
      "./Tamil/Tamil_15.xml\n",
      "./Tamil/Tamil_29.xml\n",
      "./Batak/Batak_330889.xml\n",
      "./Batak/_Batak_330894.xml\n",
      "./Batak/Batak_63570.xml\n",
      "./Batak/Batak_56330.xml\n",
      "./Batak/Batak_66486.xml\n",
      "./Batak/Batak_66485.xml\n",
      "./Batak/Batak_91624.xml\n",
      "./Batak/Batak_91548.xml\n",
      "./Batak/Batak_36863.xml\n",
      "./Batak/Batak_56303.xml\n",
      "./Batak/Batak_36801.xml\n",
      "./Batak/Batak_36960.xml\n",
      "./Batak/Batak_330890.xml\n",
      "./Egyptian/Egyptian_MS_5.xml\n",
      "./Egyptian/Egyptian_MS_4.xml\n",
      "./Egyptian/Egyptian_MS_6.xml\n",
      "./Egyptian/Egyptian_MS_7.xml\n",
      "./Egyptian/Egyptian_MS_3.xml\n",
      "./Egyptian/Egyptian_MS_2.xml\n",
      "./Egyptian/Egyptian_MS_1.xml\n",
      "./Egyptian/Egyptian_MS_8.xml\n",
      "./Arabic/WMS_Arabic_442.xml\n",
      "./Arabic/WMS_Arabic_456.xml\n",
      "./Arabic/WMS_Arabic_481.xml\n",
      "./Arabic/WMS_Arabic_495.xml\n",
      "./Arabic/WMS_Arabic_654.xml\n",
      "./Arabic/WMS_Arabic_668.xml\n",
      "./Arabic/WMS_Arabic_697.xml\n",
      "./Arabic/WMS_Arabic_734.xml\n",
      "./Arabic/WMS_Arabic_24.xml\n",
      "./Arabic/WMS_Arabic_18.xml\n",
      "./Arabic/WMS_Arabic_278.xml\n",
      "./Arabic/WMS_Arabic_286.xml\n",
      "./Arabic/WMS_Arabic_292.xml\n",
      "./Arabic/WMS_Arabic_31.xml\n",
      "./Arabic/MS_Arabic_3.xml\n",
      "./Arabic/WMS_Arabic_709.xml\n",
      "./Arabic/WMS_Arabic_735.xml\n",
      "./Arabic/WMS_Arabic_682.xml\n",
      "./Arabic/MS_Arabic_862.xml\n",
      "./Arabic/MS_Arabic_876.xml\n",
      "./Arabic/WMS_Arabic_480.xml\n",
      "./Arabic/WMS_Arabic_457.xml\n",
      "./Arabic/WMS_Arabic_443.xml\n",
      "./Arabic/WMS_Arabic_455.xml\n",
      "./Arabic/WMS_Arabic_441.xml\n",
      "./Arabic/WMS_Arabic_469.xml\n",
      "./Arabic/WMS_Arabic_482.xml\n",
      "./Arabic/MS_Arabic_860.xml\n",
      "./Arabic/WMS_Arabic_694.xml\n",
      "./Arabic/WMS_Arabic_680.xml\n",
      "./Arabic/WMS_Arabic_723.xml\n",
      "./Arabic/WMS_Arabic_521.xml\n",
      "./Arabic/WMS_Arabic_284.xml\n",
      "./Arabic/WMS_Arabic_290.xml\n",
      "./Arabic/WMS_Arabic_291.xml\n",
      "./Arabic/WMS_Arabic_508.xml\n",
      "./Arabic/WMS_Arabic_534.xml\n",
      "./Arabic/WMS_Arabic_252.xml\n",
      "./Arabic/WMS_Arabic_26.xml\n",
      "./Arabic/MS_Arabic_875.xml\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "./Arabic/MS_Arabic_861.xml\n",
      "./Arabic/WMS_Arabic_483.xml\n",
      "./Arabic/WMS_Arabic_497.xml\n",
      "./Arabic/WMS_Arabic_468.xml\n",
      "./Arabic/WMS_Arabic_440.xml\n",
      "./Arabic/WMS_Arabic_454.xml\n",
      "./Arabic/WMS_Arabic_478.xml\n",
      "./Arabic/WMS_Arabic_450.xml\n",
      "./Arabic/WMS_Arabic_444.xml\n",
      "./Arabic/WMS_Arabic_487.xml\n",
      "./Arabic/MS_Arabic_865.xml\n",
      "./Arabic/MS_Arabic_871.xml\n",
      "./Arabic/WMS_Arabic_646.xml\n",
      "./Arabic/WMS_Arabic_691.xml\n",
      "./Arabic/WMS_Arabic_726.xml\n",
      "./Arabic/WMS_Arabic_22.xml\n",
      "./Arabic/WMS_Arabic_256.xml\n",
      "./Arabic/WMS_Arabic_530.xml\n",
      "./Arabic/WMS_Arabic_281.xml\n",
      "./Arabic/WMS_Arabic_257.xml\n",
      "./Arabic/WMS_Arabic_531.xml\n",
      "./Arabic/WMS_Arabic_733.xml\n",
      "./Arabic/WMS_Arabic_848.xml\n",
      "./Arabic/WMS_Arabic_690.xml\n",
      "./Arabic/WMS_Arabic_121.xml\n",
      "./Arabic/WMS_Arabic_653.xml\n",
      "./Arabic/MS_Arabic_858.xml\n",
      "./Arabic/MS_Arabic_870.xml\n",
      "./Arabic/MS_Arabic_864.xml\n",
      "./Arabic/WMS_Arabic_486.xml\n",
      "./Arabic/WMS_Arabic_445.xml\n",
      "./Arabic/WMS_Arabic_451.xml\n",
      "./Arabic/WMS_Arabic_479.xml\n",
      "./Arabic/WMS_Arabic_447.xml\n",
      "./Arabic/WMS_Arabic_453.xml\n",
      "./Arabic/WMS_Arabic_484.xml\n",
      "./Arabic/WMS_Arabic_8.xml\n",
      "./Arabic/WMS_Arabic_490.xml\n",
      "./Arabic/WMS_Arabic_679.xml\n",
      "./Arabic/WMS_Arabic_725.xml\n",
      "./Arabic/WMS_Arabic_35.xml\n",
      "./Arabic/WMS_Arabic_533.xml\n",
      "./Arabic/WMS_Arabic_527.xml\n",
      "./Arabic/WMS_Arabic_283.xml\n",
      "./Arabic/WMS_Arabic_297.xml\n",
      "./Arabic/WMS_Arabic_254.xml\n",
      "./Arabic/WMS_Arabic_20.xml\n",
      "./Arabic/WMS_Arabic_34.xml\n",
      "./Arabic/WMS_Arabic_724.xml\n",
      "./Arabic/WMS_Arabic_730.xml\n",
      "./Arabic/WMS_Arabic_693.xml\n",
      "./Arabic/MS_Arabic_867.xml\n",
      "./Arabic/WMS_Arabic_678.xml\n",
      "./Arabic/WMS_Arabic_485.xml\n",
      "./Arabic/WMS_Arabic_452.xml\n",
      "./Arabic/WMS_Arabic_446.xml\n",
      "./Arabic/WMS_Arabic_421.xml\n",
      "./Arabic/WMS_Arabic_347.xml\n",
      "./Arabic/WMS_Arabic_435.xml\n",
      "./Arabic/WMS_Arabic_409.xml\n",
      "./Arabic/WMS_Arabic_384.xml\n",
      "./Arabic/WMS_Arabic_637.xml\n",
      "./Arabic/WMS_Arabic_179.xml\n",
      "./Arabic/WMS_Arabic_84.xml\n",
      "./Arabic/WMS_Arabic_569.xml\n",
      "./Arabic/WMS_Arabic_583.xml\n",
      "./Arabic/WMS_Arabic_597.xml\n",
      "./Arabic/WMS_Arabic_781.xml\n",
      "./Arabic/WMS_Arabic_46.xml\n",
      "./Arabic/WMS_Arabic_742.xml\n",
      "./Arabic/WMS_Arabic_839.xml\n",
      "./Arabic/WMS_Arabic_178.xml\n",
      "./Arabic/WMS_Arabic_622.xml\n",
      "./Arabic/WMS_Arabic_385.xml\n",
      "./Arabic/WMS_Arabic_408.xml\n",
      "./Arabic/WMS_Arabic_434.xml\n",
      "./Arabic/WMS_Arabic_420.xml\n",
      "./Arabic/WMS_Arabic_436.xml\n",
      "./Arabic/WMS_Arabic_422.xml\n",
      "./Arabic/WMS_Arabic_813.xml\n",
      "./Arabic/WMS_Arabic_783.xml\n",
      "./Arabic/WMS_Arabic_797.xml\n",
      "./Arabic/WMS_Arabic_594.xml\n",
      "./Arabic/WMS_Arabic_580.xml\n",
      "./Arabic/WMS_Arabic_557.xml\n",
      "./Arabic/WMS_Arabic_806.xml\n",
      "./Arabic/WMS_Arabic_609.xml\n",
      "./Arabic/WMS_Arabic_147.xml\n",
      "./Arabic/WMS_Arabic_379.xml\n",
      "./Arabic/WMS_Arabic_423.xml\n",
      "./Arabic/WMS_Arabic_437.xml\n",
      "./Arabic/WMS_Arabic_351.xml\n",
      "./Arabic/WMS_Arabic_355.xml\n",
      "./Arabic/WMS_Arabic_433.xml\n",
      "./Arabic/WMS_Arabic_427.xml\n",
      "./Arabic/WMS_Arabic_382.xml\n",
      "./Arabic/MS_Arabic_812.xml\n",
      "./Arabic/WMS_Arabic_816.xml\n",
      "./Arabic/WMS_Arabic_82.xml\n",
      "./Arabic/WMS_Arabic_235.xml\n",
      "./Arabic/WMS_Arabic_585.xml\n",
      "./Arabic/WMS_Arabic_793.xml\n",
      "./Arabic/WMS_Arabic_68.xml\n",
      "./Arabic/WMS_Arabic_83.xml\n",
      "./Arabic/WMS_Arabic_817.xml\n",
      "./Arabic/WMS_Arabic_624.xml\n",
      "./Arabic/WMS_Arabic_630.xml\n",
      "./Arabic/WMS_Arabic_618.xml\n",
      "./Arabic/WMS_Arabic_383.xml\n",
      "./Arabic/WMS_Arabic_397.xml\n",
      "./Arabic/WMS_Arabic_426.xml\n",
      "./Arabic/WMS_Arabic_340.xml\n",
      "./Arabic/WMS_Arabic_432.xml\n",
      "./Arabic/WMS_Arabic_418.xml\n",
      "./Arabic/WMS_Arabic_424.xml\n",
      "./Arabic/WMS_Arabic_430.xml\n",
      "./Arabic/WMS_Arabic_632.xml\n",
      "./Arabic/WMS_Arabic_815.xml\n",
      "./Arabic/WMS_Arabic_183.xml\n",
      "./Arabic/WMS_Arabic_746.xml\n",
      "./Arabic/WMS_Arabic_81.xml\n",
      "./Arabic/WMS_Arabic_791.xml\n",
      "./Arabic/WMS_Arabic_578.xml\n",
      "./Arabic/WMS_Arabic_593.xml\n",
      "./Arabic/WMS_Arabic_587.xml\n",
      "./Arabic/WMS_Arabic_592.xml\n",
      "./Arabic/WMS_Arabic_80.xml\n",
      "./Arabic/WMS_Arabic_182.xml\n",
      "./Arabic/WMS_Arabic_633.xml\n",
      "./Arabic/MS_Arabic_804.xml\n",
      "./Arabic/WMS_Arabic_431.xml\n",
      "./Arabic/WMS_Arabic_425.xml\n",
      "./Arabic/WMS_Arabic_419.xml\n",
      "./Arabic/WMS_Arabic_372.xml\n",
      "./Arabic/WMS_Arabic_414.xml\n",
      "./Arabic/WMS_Arabic_428.xml\n",
      "./Arabic/WMS_Arabic_164.xml\n",
      "./Arabic/MS_Arabic_835.xml\n",
      "./Arabic/MS_Arabic_821.xml\n",
      "./Arabic/WMS_Arabic_831.xml\n",
      "./Arabic/WMS_Arabic_776.xml\n",
      "./Arabic/WMS_Arabic_99.xml\n",
      "./Arabic/WMS_Arabic_72.xml\n",
      "./Arabic/WMS_Arabic_66.xml\n",
      "./Arabic/WMS_Arabic_574.xml\n",
      "./Arabic/WMS_Arabic_560.xml\n",
      "./Arabic/WMS_Arabic_561.xml\n",
      "./Arabic/WMS_Arabic_788.xml\n",
      "./Arabic/WMS_Arabic_73.xml\n",
      "./Arabic/WMS_Arabic_777.xml\n",
      "./Arabic/WMS_Arabic_830.xml\n",
      "./Arabic/MS_Arabic_820.xml\n",
      "./Arabic/WMS_Arabic_617.xml\n",
      "./Arabic/WMS_Arabic_171.xml\n",
      "./Arabic/WMS_Arabic_165.xml\n",
      "./Arabic/WMS_Arabic_429.xml\n",
      "./Arabic/WMS_Arabic_373.xml\n",
      "./Arabic/WMS_Arabic_415.xml\n",
      "./Arabic/WMS_Arabic_401.xml\n",
      "./Arabic/WMS_Arabic_417.xml\n",
      "./Arabic/WMS_Arabic_371.xml\n",
      "./Arabic/WMS_Arabic_403.xml\n",
      "./Arabic/WMS_Arabic_359.xml\n",
      "./Arabic/MS_Arabic_163.xml\n",
      "./Arabic/WMS_Arabic_826.xml\n",
      "./Arabic/WMS_Arabic_65.xml\n",
      "./Arabic/WMS_Arabic_71.xml\n",
      "./Arabic/WMS_Arabic_577.xml\n",
      "./Arabic/WMS_Arabic_588.xml\n",
      "./Arabic/WMS_Arabic_238.xml\n",
      "./Arabic/WMS_Arabic_748.xml\n",
      "./Arabic/WMS_Arabic_628.xml\n",
      "./Arabic/WMS_Arabic_166.xml\n",
      "./Arabic/WMS_Arabic_402.xml\n",
      "./Arabic/WMS_Arabic_416.xml\n",
      "./Arabic/WMS_Arabic_348.xml\n",
      "./Arabic/WMS_Arabic_412.xml\n",
      "./Arabic/WMS_Arabic_406.xml\n",
      "./Arabic/WMS_Arabic_837.xml\n",
      "./Arabic/WMS_Arabic_823.xml\n",
      "./Arabic/WMS_Arabic_566.xml\n",
      "./Arabic/WMS_Arabic_598.xml\n",
      "./Arabic/WMS_Arabic_573.xml\n",
      "./Arabic/WMS_Arabic_201.xml\n",
      "./Arabic/WMS_Arabic_49.xml\n",
      "./Arabic/WMS_Arabic_771.xml\n",
      "./Arabic/WMS_Arabic_822.xml\n",
      "./Arabic/WMS_Arabic_836.xml\n",
      "./Arabic/WMS_Arabic_407.xml\n",
      "./Arabic/WMS_Arabic_361.xml\n",
      "./Arabic/WMS_Arabic_375.xml\n",
      "./Arabic/WMS_Arabic_413.xml\n",
      "./Arabic/WMS_Arabic_439.xml\n",
      "./Arabic/WMS_Arabic_405.xml\n",
      "./Arabic/WMS_Arabic_411.xml\n",
      "./Arabic/WMS_Arabic_377.xml\n",
      "./Arabic/WMS_Arabic_607.xml\n",
      "./Arabic/WMS_Arabic_161.xml\n",
      "./Arabic/WMS_Arabic_175.xml\n",
      "./Arabic/WMS_Arabic_808.xml\n",
      "./Arabic/WMS_Arabic_773.xml\n",
      "./Arabic/WMS_Arabic_798.xml\n",
      "./Arabic/WMS_Arabic_202.xml\n",
      "./Arabic/WMS_Arabic_558.xml\n",
      "./Arabic/WMS_Arabic_62.xml\n",
      "./Arabic/WMS_Arabic_809.xml\n",
      "./Arabic/WMS_Arabic_174.xml\n",
      "./Arabic/WMS_Arabic_606.xml\n",
      "./Arabic/WMS_Arabic_148.xml\n",
      "./Arabic/WMS_Arabic_410.xml\n",
      "./Arabic/WMS_Arabic_376.xml\n",
      "./Arabic/WMS_Arabic_404.xml\n",
      "./Arabic/WMS_Arabic_438.xml\n",
      "./Arabic/WMS_Arabic_305.xml\n",
      "./Arabic/WMS_Arabic_463.xml\n",
      "./Arabic/WMS_Arabic_477.xml\n",
      "./Arabic/WMS_Arabic_311.xml\n",
      "./Arabic/WMS_Arabic_107.xml\n",
      "./Arabic/WMS_Arabic_675.xml\n",
      "./Arabic/MS_Arabic_881.xml\n",
      "./Arabic/WMS_Arabic_729.xml\n",
      "./Arabic/WMS_Arabic_11.xml\n",
      "./Arabic/WMS_Arabic_503.xml\n",
      "./Arabic/WMS_Arabic_259.xml\n",
      "./Arabic/WMS_Arabic_258.xml\n",
      "./Arabic/WMS_Arabic_10.xml\n",
      "./Arabic/WMS_Arabic_728.xml\n",
      "./Arabic/WMS_Arabic_714.xml\n",
      "./Arabic/WMS_Arabic_853.xml\n",
      "./Arabic/WMS_Arabic_847.xml\n",
      "./Arabic/MS_Arabic_894.xml\n",
      "./Arabic/WMS_Arabic_660.xml\n",
      "./Arabic/WMS_Arabic_489.xml\n",
      "./Arabic/WMS_Arabic_476.xml\n",
      "./Arabic/WMS_Arabic_462.xml\n",
      "./Arabic/WMS_Arabic_474.xml\n",
      "./Arabic/WMS_Arabic_460.xml\n",
      "./Arabic/WMS_Arabic_448.xml\n",
      "./Arabic/MS_Arabic_869.xml\n",
      "./Arabic/WMS_Arabic_662.xml\n",
      "./Arabic/MS_Arabic_855.xml\n",
      "./Arabic/WMS_Arabic_689.xml\n",
      "./Arabic/MS_Arabic_882.xml\n",
      "./Arabic/WMS_Arabic_716.xml\n",
      "./Arabic/WMS_Arabic_12.xml\n",
      "./Arabic/WMS_Arabic_528.xml\n",
      "./Arabic/WMS_Arabic_298.xml\n",
      "./Arabic/WMS_Arabic_529.xml\n",
      "./Arabic/WMS_Arabic_515.xml\n",
      "./Arabic/WMS_Arabic_273.xml\n",
      "./Arabic/WMS_Arabic_267.xml\n",
      "./Arabic/WMS_Arabic_13.xml\n",
      "./Arabic/WMS_Arabic_844.xml\n",
      "./Arabic/MS_Arabic_883.xml\n",
      "./Arabic/MS_Arabic_868.xml\n",
      "./Arabic/WMS_Arabic_6.xml\n",
      "./Arabic/WMS_Arabic_449.xml\n",
      "./Arabic/WMS_Arabic_461.xml\n",
      "./Arabic/WMS_Arabic_475.xml\n",
      "./Arabic/WMS_Arabic_459.xml\n",
      "./Arabic/WMS_Arabic_471.xml\n",
      "./Arabic/WMS_Arabic_465.xml\n",
      "./Arabic/WMS_Arabic_2.xml\n",
      "./Arabic/WMS_Arabic_673.xml\n",
      "./Arabic/MS_Arabic_887.xml\n",
      "./Arabic/WMS_Arabic_698.xml\n",
      "./Arabic/WMS_Arabic_840.xml\n",
      "./Arabic/WMS_Arabic_17.xml\n",
      "./Arabic/WMS_Arabic_277.xml\n",
      "./Arabic/WMS_Arabic_511.xml\n",
      "./Arabic/WMS_Arabic_289.xml\n",
      "./Arabic/WMS_Arabic_16.xml\n",
      "./Arabic/WMS_Arabic_841.xml\n",
      "./Arabic/WMS_Arabic_699.xml\n",
      "./Arabic/MS_Arabic_886.xml\n",
      "./Arabic/WMS_Arabic_100.xml\n",
      "./Arabic/MS_Arabic_879.xml\n",
      "./Arabic/WMS_Arabic_464.xml\n",
      "./Arabic/WMS_Arabic_470.xml\n",
      "./Arabic/WMS_Arabic_458.xml\n",
      "./Arabic/WMS_Arabic_466.xml\n",
      "./Arabic/WMS_Arabic_472.xml\n",
      "./Arabic/WMS_Arabic_1.xml\n",
      "./Arabic/WMS_Arabic_102.xml\n",
      "./Arabic/WMS_Arabic_664.xml\n",
      "./Arabic/WMS_Arabic_116.xml\n",
      "./Arabic/MS_Arabic_890.xml\n",
      "./Arabic/WMS_Arabic_843.xml\n",
      "./Arabic/MS_Arabic_884.xml\n",
      "./Arabic/WMS_Arabic_738.xml\n",
      "./Arabic/WMS_Arabic_14.xml\n",
      "./Arabic/WMS_Arabic_512.xml\n",
      "./Arabic/WMS_Arabic_274.xml\n",
      "./Arabic/WMS_Arabic_260.xml\n",
      "./Arabic/WMS_Arabic_506.xml\n",
      "./Arabic/WMS_Arabic_507.xml\n",
      "./Arabic/WMS_Arabic_513.xml\n",
      "./Arabic/WMS_Arabic_249.xml\n",
      "./Arabic/WMS_Arabic_15.xml\n",
      "./Arabic/WMS_Arabic_29.xml\n",
      "./Arabic/WMS_Arabic_711.xml\n",
      "./Arabic/WMS_Arabic_739.xml\n",
      "./Arabic/WMS_Arabic_117.xml\n",
      "./Arabic/WMS_Arabic_659.xml\n",
      "./Arabic/WMS_Arabic_498.xml\n",
      "./Arabic/WMS_Arabic_473.xml\n",
      "./Arabic/WMS_Arabic_467.xml\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "./Ethiopian/Ethiopian_7.xml\n",
      "./Ethiopian/Ethiopian_14.xml\n",
      "./Ethiopian/Ethiopian_15.xml\n",
      "./Ethiopian/Ethiopian_6.xml\n",
      "./Ethiopian/Ethiopian_4.xml\n",
      "./Ethiopian/Ethiopian_17.xml\n",
      "./Ethiopian/Ethiopian_16.xml\n",
      "./Ethiopian/Ethiopian_5.xml\n",
      "./Ethiopian/Ethiopian_1.xml\n",
      "./Ethiopian/Ethiopian_12.xml\n",
      "./Ethiopian/Ethiopian_13.xml\n",
      "./Ethiopian/Ethiopian_10.xml\n",
      "./Ethiopian/Ethiopian_3.xml\n",
      "./Ethiopian/Ethiopian_21.xml\n",
      "./Ethiopian/Ethiopian_20.xml\n",
      "./Ethiopian/Ethiopian_22.xml\n",
      "./Ethiopian/Ethiopian_23.xml\n",
      "./Ethiopian/Ethiopian_8.xml\n",
      "./Ethiopian/Ethiopian_27.xml\n",
      "./Ethiopian/Ethiopian_26.xml\n",
      "./Ethiopian/Ethiopian_9.xml\n",
      "./Ethiopian/Ethiopian_18.xml\n",
      "./Ethiopian/Ethiopian_24.xml\n",
      "./Ethiopian/Ethiopian_25.xml\n",
      "./Ethiopian/Ethiopian_19.xml\n"
     ]
    }
   ],
   "source": [
    "import csv\n",
    "\n",
    "with open('quickbase_spreadsheet.csv', 'w') as outfile:\n",
    "    writer = csv.DictWriter(\n",
    "        outfile,\n",
    "        fieldnames=[\n",
    "            'Title/s or Brief Description (245)',\n",
    "            'Main Identifier',\n",
    "            'Alternative Identifiers (separate with semicolons)',\n",
    "            'Accession Number',\n",
    "            'System No.',\n",
    "            'Language',\n",
    "        ]\n",
    "    )\n",
    "    \n",
    "    writer.writeheader()\n",
    "    \n",
    "    tei_file_paths = find_tei_files('.')\n",
    "\n",
    "    for row in extract_tei_metadata_fields(tei_file_paths):\n",
    "        writer.writerow(row)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notes from our discussion:\n",
    "    \n",
    "*   The `'w'` mode tells Python that we want to *write* to this file.\n",
    "\n",
    "    When we're programming, we have to be explicit about how we want to open a file (read, write, append, etc.).\n",
    "    This avoids certain classes of bugs where, e.g. you open a file to read some data, then accidentally overwrite what's already there.\n",
    "\n",
    "*   Although a CSV spreadsheet seems conceptually simple (just put commas between the fields), it gets more complicated when you consider edge cases, e.g. what if there's a comma in one of the values?\n",
    "    Using the `csv` module means we don't have to think about that; somebody else has written that code for us.\n",
    "\n",
    "*   The `DictWriter` class allows us to use dictionaries to write rows in the spreadsheet.\n",
    "    This ensures each value will be written in the right column.\n",
    "    \n",
    "*   We have to explicitly ask for column headers (`writer.writeheader()`).\n",
    "\n",
    "    This doesn't happen automatically because sometimes you're writing code to add new rows to an existing spreadsheet, and it would be awkward if your code kept auto-inserting column headers."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Experimental region\n",
    "\n",
    "This is where we tried some stuff before putting it in the final script.\n",
    "\n",
    "This is another thing developers often do: we'll build a \"mini-program\" away from the main code where we can test something in isolation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<Element '{http://www.tei-c.org/ns/1.0}msContents' at 0x111f97040>\n",
      "it's empty!\n",
      "<Element '{http://www.tei-c.org/ns/1.0}summary' at 0x111f97680>\n",
      "Biblical fragment\n"
     ]
    }
   ],
   "source": [
    "root = ET.parse('Hebrew/Hebrew_B_41.xml').getroot()\n",
    "\n",
    "msContents = root.find('.//{http://www.tei-c.org/ns/1.0}msContents')\n",
    "\n",
    "print(msContents)\n",
    "\n",
    "summary_tag = msContents.find('.//{http://www.tei-c.org/ns/1.0}summary')\n",
    "\n",
    "if summary_tag:\n",
    "    print(\"it's not empty!\")\n",
    "    summary = ''.join(summary_tag.itertext())\n",
    "else:\n",
    "    print(\"it's empty!\")\n",
    "    summary = ''\n",
    "\n",
    "print(summary_tag)\n",
    "print(''.join(summary_tag.itertext()))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.9"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}