Pre - European CAT 2019

Fixed Test 15801 which tests that all appropriate attributes of a DocumentEntry can be updated.

Fixed #264 Folder.lastUpdateTime must be second resolution. Updated Registry simulator and tests.

Updated MU/RMU/RMD simulator code to reflect current usage of UnresolvedReferenceException.

Some bugs that are not going to get fixed before the event:

RMD now allows empty SubmissionSet to remain - test 30001 needs the additional flexibility - #457

Error reporting for MU/RMU/RMD was updated in 2018 - parts of this are still pending in the code - #456

Updates since Cleveland

UniqueId no longer required to be OID.

Small fixes to codes.xml

MU - existing DocumentEntry not present in Registry is not an UnresolvedReferenceException.

In Registry simulator - add check that SubmissionSet is not referenced as target of an Association.

XdsMetadataUpdateError changed to UnresolvedRefernceException in test 40000b.

Three of Lynn's Connectathon data submissions are PnR instead of Register transactions.

Fix blank UI when starting with an invalid External Cache. NOTE: Java container restart is required to fix the FHIR support server initialization on startup.

Fix registry test/section 12002/add_to_folder, respectively, to work with the No-PIF mode orchestration option.

No Patient Identity Feed option in conformance tool

The ability to use the Conformance Tool without the V2 Patient Identity Feed has been fixed. In the prior release the Conformance Tool always sent the V2 Patient Identity Feed even when it was not wanted.

ADT listener bug fix

AdtSender.getStringFromBufferedReader() was hanging when the transmission of the message is completed. As the socket remains open, it appears that BuffererdReader continues to read from the socket, and getting something back, as the null condition is not reached. Added a test to see if the file MLLP separator is reached and break the loop there.

Winter Toolkit Release

This release supports Pre-Connectathon testing for the North American 2019 event. Detail updates are listed below.

Delete the current contents of your External Cache when installing this update to ensure updates flow from WAR file to External Cache
as needed. Specifically codes.xml and datasets have updates. Several simulator types have updates which are incompatable with previous simulator state files
maintained in the External Cache. Without deleting the old simdb directory the simulator system will not operate.

Simulator state file simtype.txt is no longer used. This file was occasionally being deleted which prevented some simulator from loading.

Added tests for Metadata Update, RMU, RMD.

Add Registry simulator support for RMU and Repository support for RMD.

Added support for FindDocumentsByReferenceId query to Registry simulator

Updates to MHD tests.

Updates to codes.xml for 2019.

Documentation for testing TLS 1.2 at North American Connectathon can be found at https://github.com/usnistgov/iheos-toolkit2/wiki/TLS-Configuration-for-TLS-1.2. This includes
instructions for Pre-Connectathon testing.

Conformance tool now supports testing of Registry actor which does not accept a V2 Patient Identity feed transaction. Allows operator to manually insert Patient Identities and
skips the sending of V2 PIF messages when needed. This also applies when testing against Responding Gateway simulator. Operation is documented in Conformance tool display.

Fix Windows file path %5c issue for this particular test: Update cross platform file paths using Java Paths class.

Throw separate runtime exception for Null testInstance attributes.

Add separate Webui-test for manual Conformance test SUT selection via Test Context.

Fix webui-tests.

Fix Conformance Tool SUT selection (replaces commit 64fb289).

Fix bug in XdsTestServiceManager#buildResult introduced through commit a98e4be.

Fix bug introduced in LogRepository#logIn method through commit b969c8c.

Fix logIn method that eventually makes call to getLogDir which unnecessary empty log folder.

Recipient actor orch: Clear loading message.

Clean up Rep orchestration button.

Clean up Reg orchestration: Remove hidden field.

Fix Issue #442 Popupmessage on SimConfig save.

Fix NPE in SamlSelector.

Fix Issue # 437: update XUA user names.

Fix XUA problems: Update Xuausername as applicable and fix validation.

Restore lost Repository conformance tests.

Remove unnecessary special character in comment.

Fix Issue #439 Unresponsive Orchestration Test bar.

Fix test collection code.

Remove unnecessary XdsDocAdmin-Initialize test.

Add ReposAcceptanceTest-1113: Has PnR tests with existing Registry UUID.

Fix SimLog link in interaction diagram.

Fix PnR transaction request processing that contains existing Registry.

Fix Issue #436 Block SimId-part endpoint update on Sim reconfigure.

Add ReposAcceptanceTest-1112.

Add ReposAcceptanceTest-1111.

Fix Issue# 436: Lost Repository Simulator's Registry endpoint on Toolkit startup.

Introduce ISR Conformance Actor and tests.

Fix Issue #435: Display Loading message when displaying Conformance Tool Overview/Menu.

Working version of DocAdmin MU Validation by a Stored Query section.

Introduced new test configuration file ConfTest.properties which allows per-test control of Conformance tool when necessary. See source for test XdsDocAdminTest-1111 for example.

Fix SimReference actor/transaction type.

Add XdsDocAdmin Actor to the Conformance Test Tool.

Rename DocumentSource supporting sim name.

Working version of Folder and Document Entry tests in "Test 1113".

Fix Issue# 431: Display entire ObjectRef UUID value in Inspector tree.

Fallback to Event if Null date.

Fix validation plugin logging. Add new DocSrc test "1113".

Increase Listener_Port_Range (+5) because It-tests exhausted PIF thread.

Add runToolkitDocker.sh Docker script and supporting maven build profile.

Call Reset in Validate method.

Add test "XdsDocSrcSubmissionTest-1112". Fix duplicate logging.

Add XFRM_RPLC case.

Fix Issue# 429 Reg Test 11995 Eval Section Checks for RPLC instead of XFRM_RPLC (Non cherry-pickable).

Issue #426 Part 2: Error "GazelleSts site is not configured" in Tool Site Selection area.

Test progress indicator: Make test status evaluation logic consistent with TestDisplay#display.

Clarify Null actorCode usage.

Document ConfTestsTabs.xml.

Remove unnecessary profile and option attributes.

Add XdsAssertion validation plugin API.

Summer 2018

Added ability for client software to use a separate trust store file. If the trust store file does not exist, revert to using the existing key store file

Added a toolkit property: CLIENT_SSL_PROTOCOLS. This works in tandem with the existing CLIENT_CIPHER_SUITES property to allow the administrator to set these. If the administrator does not set either of these properties, the system uses default JRE behavior.

Modified the set of test images used to test an XDS-I Imaging Document Source

Cleanup test step names for Imaging Document Source tests. We had previously renumbered the test cases, but the steps inside did not reflect the new names.

Added reporting of bad testplan.xml files to UI.

Fix Issue #427 Add Metadata Update Inspector Action to Contents view
Add conformance actor test count safety check: When entering an actor's test page, test count is checked to make sure the response test collection size matches the requested test collection size.
TLS indicator needs a tweak #425
Fix QuickScanLog TestOverviewDTO Run status. (Part 2 is on another branch d31b6ab.)
Fix NPE on TestStep/Transaction/Endpoint
Fix SUT on test session change event
Fix menu access. See Fixme on Test Context bug.
Fix section attribute
Fix diagram loading after performance update part 2
Discover new issue: Profile/option tab is sticky
Implement test log lazy loading [Conformance Actor Page].
Add QuickScanLogAttribute
Add showPopupMessage method to automatically provide tabName in the title bar of the dialog box. When there are multiple tabs of the same type, tab index is displayed to identify source tab.
Fix webui-tests jetty logging. Works with 'WebUI-Tests' maven build profile.
Use overloaded Util#parse_xml with supportDtd=false
Overload Util#parse_xml to accept Boolean supportDtd. Null implies unspecified value, or default behavior. True/false will set the property if it is supported by the XMLInputFactory.
Reduce roundtrips to fetch known TestInstances for a given actor/option.
Discuss with Bill and change JDK version maven build property to 1.8.
Fix Conformance Actor page loading message.
Fix Issue #391: Conformance actor access through URL method seems to be broken
Fix Toolkit GUI initialization (duplicate event handlers). Fix tool loading by URL method. Check required parameters for the SimConfig Tool.
Fix #421 Access SimConfig tool through URL
Use new token style URL for SimConfig tool
Prune conformance test tabs

MU tests

Adds new Metadata Update test and some Metadata Update extensions to Inspector. Also faster load of summaries into conformance tool. Have not tested all features. For select testing.

TLS upgrade

Added ability for client software to use a separate trust store file. If the trust store file does not exist, revert to using the existing key store file

Added a toolkit property: CLIENT_SSL_PROTOCOLS. This works in tandem with the existing CLIENT_CIPHER_SUITES property to allow the administrator to set these. If the administrator does not set either of these properties, the system uses default JRE behavior.

Modified the set of test images used to test an XDS-I Imaging Document Source

Cleanup test step names for Imaging Document Source tests. We had previously renumbered the test cases, but the steps inside did not reflect the new names.

Detect missing defaultTestSession in multi user mode

Added start-up check. If in multi-user mode then the property defaultTestSession must be set.

Summer CAS

Radiology focused:

Repaired Imaging Document Source simulator. When responding to RAD-69 requests, it did not include the repositoryUniqueId

Refactored tests for Imaging Document Source and Imaging Document Consumer. Metadata for both actors are now in alignment with codes.xml that was released January 2018

Strengthened testing of metadata for RAD-68 submission by Imaging Document Source actor. Tests are now looking for specific metadata values that are linked to values in DICOM image headers.

Updated RAD-55 tests for Imaging Document Source to support HTTPS. Prior versions only supported HTTP. All tests for Imaging Document Source should now function with both HTTP and HTTPS.

Renumbered tests for Initiating Imaging Gateway and Responding Imaging Gateway actors so that functions are grouped in the test sequence.

General:

Update home page to integrate with wiki upgrades.

Eliminate type problems surrounding TestSession in test documentation generator

Control whether internal TestKit is used through property Ignore_internal_testkit.

When in multi-user mode, peer TestSession not filtered our of Conformance Tool TestSession selector.

When logs are opened from the Simulators tool, current test session is inadvertently changed.

Add TLS label to test and section in Conformance tool UI.

Client test details results are initially closed but can
be opened with a click. Before, all details were shown always - overwhelming when simulator contained many messages.

Catalina.out log cleanup - many System.out.println messages changed to log.info so control through log4j possible.

Added initial version of plugin support - ability to install client validators (really a search of a simulator's input
Message list). These validators are written in Groovy Script and installed in a TestKit in a new plugin directory.
Updated the MHD Document Source tests to use validators loaded through this plugin mechanism. A big part of this work
Was adding a Groovy class loader which is controlled by Toolkit.

Updated configuration for NIST public server.

Testkit/environment reindexing remembers tests from prior environment.

Added support for expiration of TestSessions. This is needed to enable management of public servers. By default a
Test Session expires 30 days after last activity where activity is defined as a generating a new Test Log or Simulator Log.
For now the actual deletion is manual. New display added to Toolkit configuration page that displays all Test Sessions and their "age".

Affinity domain configuration (environment codes.xml file) is now downloadable from the UI. The link is sensitive to the current environment selection.

Added a FixedReturn simulator type. This simulator accepts a local file path as a parameter. When a message is received this file is read and its contents is returned as the response.

Fixed duplicate message display in simulator logs.

Add hide/view control for interaction sequence diagram and make it hidden by default.

Added XcpdTransaction to FixedReply simulator.

Propagate SAML security header to these internal transactions: rg/xcq to reg/sq; rg/xcr to rep/ret; ig/igq to rg/xcq; ig/igr to rg/xcr; rep/pnr to reg/r.b. All but the first needs additional testing.