Split test data into smaller sets

[Stephen-Gates]

GoodTables only returns a limited number of errors so the test data will need to be split into smaller sets.

Consider naming standard for test types:

• type and format
• constraints
  • required
  • unique
  • minimum, maximum
  • minLength, maxLength
  • pattern
  • emun
    -missing values
• primary and foreign keys, duplicates
  -structural errors
  • Undeclared header: if you do not specify in a machine readable way whether or not your CSV has a header row
  • Ragged rows: if every row in the file doesn't have the same number of columns
  • Blank rows: if there are any blank rows
  • Stray/Unclosed quote: if there are any unclosed quotes in the file
  • Whitespace: if there is any whitespace between commas and double quotes around fields
  • Empty column name: if all the columns don't have a name
  • Duplicate column name: if all the column names aren't unique

[Stephen-Gates]

Splitting data into smaller sets may not be needed for automated testing as processing limits can be set in the script.