Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add directml support #1153

Merged
merged 7 commits into from
Jul 22, 2024
Merged

feat: add directml support #1153

merged 7 commits into from
Jul 22, 2024

Conversation

thewh1teagle
Copy link
Contributor

@thewh1teagle thewh1teagle commented Jul 20, 2024 •
edited
Loading

Add support for directml execution provider
Improved version of #154

Also compared whisper medium execution time on CPU vs DirectML (amd ryzten 5 4500u, 20s audio duration)

CPU: 00:01:08.41
GPU: 00:00:37.21

The only issue in the bindings is that I had to copy the onnxruntime.dll file into the executable folder from build/_deps/onnxruntime-src/native/x64

In addition it doesn't utilize the full resources of the GPU. only 5%. Not sure how can we make it uses more.

csukuangfj
csukuangfj requested changes Jul 20, 2024
View reviewed changes
cmake/onnxruntime-win-x64-directml.cmake Outdated
# for static libraries, we use onnxruntime_lib_files directly below
include_directories(${onnxruntime_SOURCE_DIR}/build/native/include)

file(GLOB onnxruntime_lib_files "${onnxruntime_SOURCE_DIR}/runtimes/win-x64/native/*.lib")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please also glob *.dll

I suggest that you use

file(GLOB onnxruntime_lib_files "${onnxruntime_SOURCE_DIR}/runtimes/win-x64/native/onnxruntime.*")

@csukuangfj
Copy link
Collaborator

After unpacking the nuget package, I get

-rw-r--r-- 1 root root  12M Feb 25  2023 runtimes/win-arm64/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-arm64/native/onnxruntime.lib
-rw-r--r-- 1 root root 8.9M Feb 25  2023 runtimes/win-arm/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-arm/native/onnxruntime.lib
-rw-r--r-- 1 root root  11M Feb 25  2023 runtimes/win-x64/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-x64/native/onnxruntime.lib
-rw-r--r-- 1 root root 9.6M Feb 25  2023 runtimes/win-x86/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-x86/native/onnxruntime.lib

So the nuget package contains the shared library of onnxruntime.

The only issue in the bindings is that I had to copy the onnxruntime.dll file into the executable folder from build/_deps/onnxruntime-src/native/x64

After fixing the code review comment, I think you should fix this problem.

csukuangfj
csukuangfj reviewed Jul 20, 2024
View reviewed changes
cmake/onnxruntime-win-x64-directml.cmake Outdated
message(FATAL_ERROR "This file is for Windows x64 only. Given: ${CMAKE_VS_PLATFORM_NAME}")
endif()

if(BUILD_SHARED_LIBS)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it only for share libraries?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure. How can I find out? Should I omit that error statement?

@thewh1teagle
Copy link
Contributor Author

After fixing the code review comment, I think you should fix this problem.

Not sure what's changed, but suddenly it doesn't work with directml

PS C:\Users\User\Documents\code\sherpa-rs2> $start = Get-Date; cargo run --features "directml" --example transcribe ; $elapsed = (Get-Date) - $start; Write-Output "Elapsed time: $elapsed"
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.25s
     Running `target\debug\examples\transcribe.exe`
C:\Users\User\Documents\code\sherpa-rs2\target\debug\build\sherpa-rs-sys-1fd886a7cbe68e85\out\sherpa-onnx\sherpa-onnx\c-api\c-api.cc:convertConfig:427 OfflineRecognizerConfig(feat_config=FeatureExtractorConfig(sampling_rate=16000, feature_dim=512, low_freq=20, high_freq=-400, dither=0), model_config=OfflineModelConfig(transducer=OfflineTransducerModelConfig(encoder_filename="", decoder_filename="", joiner_filename=""), paraformer=OfflineParaformerModelConfig(model=""), nemo_ctc=OfflineNemoEncDecCtcModelConfig(model=""), whisper=OfflineWhisperModelConfig(encoder="sherpa-onnx-whisper-tiny/tiny-encoder.onnx", decoder="sherpa-onnx-whisper-tiny/tiny-decoder.onnx", language="en", task="transcribe", tail_paddings=-1), tdnn=OfflineTdnnModelConfig(model=""), zipformer_ctc=OfflineZipformerCtcModelConfig(model=""), wenet_ctc=OfflineWenetCtcModelConfig(model=""), sense_voice=OfflineSenseVoiceModelConfig(model="", language="", use_itn=False), telespeech_ctc="", tokens="sherpa-onnx-whisper-tiny/tiny-tokens.txt", num_threads=2, debug=True, provider="directml", model_type="", modeling_unit="cjkchar", bpe_vocab=""), lm_config=OfflineLMConfig(model="", scale=1), ctc_fst_decoder_config=OfflineCtcFstDecoderConfig(graph="", max_active=3000), decoding_method="greedy_search", max_active_paths=4, hotwords_file="", hotwords_score=1.5, blank_penalty=0, rule_fsts="", rule_fars="")
C:\Users\User\Documents\code\sherpa-rs2\target\debug\build\sherpa-rs-sys-1fd886a7cbe68e85\out\sherpa-onnx\sherpa-onnx\csrc\offline-whisper-model.cc:InitEncoder:243 ---encoder---
n_audio_head=6
sot_prev=50361
blank_id=220
n_text_layer=4
version=1
model_type=whisper-tiny
maintainer=k2-fsa
sot_lm=50360
n_mels=80
no_timestamps=50363
all_language_tokens=50317,50296,50261,50276,50337,50260,50271,50279,50298,50319,50301,50272,50268,50352,50333,50322,50330,50347,50341,50303,50320,50267,50314,50344,50331,50321,50273,50350,50305,50357,50355,50286,50353,50309,50262,50270,50292,50312,50289,50325,50274,50285,50328,50284,50287,50311,50315,50283,50345,50346,50332,50338,50313,50354,50299,50295,50297,50281,50349,50327,50335,50306,50282,50326,50342,50351,50259,50348,50269,50264,50304,50291,50334,50275,50280,50340,50288,50310,50316,50323,50336,50324,50265,50308,50294,50356,50277,50302,50293,50278,50329,50343,50318,50290,50263,50266,50300,50339,50307
n_audio_layer=4
n_audio_state=384
n_audio_ctx=1500
n_vocab=51865
n_text_ctx=448
n_text_state=384
n_text_head=6
sot_sequence=50258,50259,50359
all_language_codes=sq,ml,de,hi,uz,zh,nl,he,sk,gl,lv,ar,tr,haw,gu,si,be,bo,tk,sr,mr,pt,mn,sa,tg,pa,sv,as,sl,su,ba,hu,ln,br,es,ca,bg,hy,th,yo,it,da,oc,ro,ta,is,bs,cs,lb,my,sd,fo,ne,ha,te,mi,cy,el,mg,af,yi,kn,ms,so,nn,tt,en,tl,pl,ko,az,hr,am,id,uk,ps,no,eu,kk,km,lo,sn,fr,mk,la,jw,fi,bn,lt,vi,ka,mt,sw,ur,ru,ja,fa,ht,et
sot=50258
sot_index=0
eot=50257
is_multilingual=1
no_speech=50362
non_speech_tokens=1,2,7,8,9,10,14,25,26,27,28,29,31,58,59,60,61,62,63,90,91,92,93,359,503,522,542,873,893,902,918,922,931,1350,1853,1982,2460,2627,3246,3253,3268,3536,3846,3961,4183,4667,6585,6647,7273,9061,9383,10428,10929,11938,12033,12331,12562,13793,14157,14635,15265,15618,16553,16604,18362,18956,20075,21675,22520,26130,26161,26435,28279,29464,31650,32302,32470,36865,42863,47425,49870,50254
transcribe=50359
translate=50358


2024-07-20 22:12:00.9327135 [E:onnxruntime:, sequential_executor.cc:494 onnxruntime::ExecuteKernel] Non-zero status code returned while running Gelu node. Name:'Gelu' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2340)\onnxruntime.dll!00007FFD1794E70A: (caller: 00007FFD1794DC5B) Exception(3) tid(3554) 80070057 The parameter is incorrect.

C:\Users\User\Documents\code\sherpa-rs2\target\debug\build\sherpa-rs-sys-1fd886a7cbe68e85\out\sherpa-onnx\sherpa-onnx/csrc/offline-recognizer-whisper-impl.h:DecodeStream:176

Caught exception:

Non-zero status code returned while running Gelu node. Name:'Gelu' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2340)\onnxruntime.dll!00007FFD1794E70A: (caller: 00007FFD1794DC5B) Exception(3) tid(3554) 80070057 The parameter is incorrect.


Return an empty result. Number of input frames: 2000, Current tail paddings: 1000. If you see a lot of such exceptions, please consider using a larger --whisper-tail-paddings
WhisperRecognizerResult { text: "" }
Elapsed time: 00:00:03.4868930

@csukuangfj
Copy link
Collaborator

please try a new wav.

1 similar comment
@csukuangfj
Copy link
Collaborator

please try a new wav.

@thewh1teagle
Copy link
Contributor Author

thewh1teagle commented Jul 20, 2024 •
edited
Loading

please try a new wav.

Didn't helped. maybe the model doesn't support DirectML? I was pretty sure it already worked but maybe I didn't noticed the error from the first place

Full log from onnx:

log.txt 
.\build\bin\Release\offline-stt-c-api.exe : C:\Users\User\Documents\code\sherpa-onnx3\sherpa-onnx\c-api\c-api.cc:convertConfig:427 OfflineRecognizerConfig(feat_config=FeatureExtractorConfig(sampling_rate=16000, feature_dim=512, low_freq=20, high_freq=-400, dither=0), 
model_config=OfflineModelConfig(transducer=OfflineTransducerModelConfig(encoder_filename="", decoder_filename="", joiner_filename=""), paraformer=OfflineParaformerModelConfig(model=""), nemo_ctc=OfflineNemoEncDecCtcModelConfig(model=""), 
whisper=OfflineWhisperModelConfig(encoder="sherpa-onnx-whisper-tiny/tiny-encoder.onnx", decoder="sherpa-onnx-whisper-tiny/tiny-decoder.onnx", language="en", task="transcribe", tail_paddings=-1), tdnn=OfflineTdnnModelConfig(model=""), 
zipformer_ctc=OfflineZipformerCtcModelConfig(model=""), wenet_ctc=OfflineWenetCtcModelConfig(model=""), sense_voice=OfflineSenseVoiceModelConfig(model="", language="", use_itn=False), telespeech_ctc="", tokens="sherpa-onnx-whisper-tiny/tiny-tokens.txt", num_threads=1, debug=True, 
provider="directml", model_type="", modeling_unit="cjkchar", bpe_vocab=""), lm_config=OfflineLMConfig(model="", scale=1), ctc_fst_decoder_config=OfflineCtcFstDecoderConfig(graph="", max_active=3000), decoding_method="greedy_search", max_active_paths=4, hotwords_file="", 
hotwords_score=1.5, blank_penalty=0, rule_fsts="", rule_fars="")
At line:1 char:40
+ ... ig Release ; .\build\bin\Release\offline-stt-c-api.exe > log.txt 2>&1
+                  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (C:\Users\User\D..., rule_fars=""):String) [], RemoteException
    + FullyQualifiedErrorId : NativeCommandError
 
2024-07-21 02:55:50.7205367 [I:onnxruntime:, inference_session.cc:268 onnxruntime::InferenceSession::ConstructorCommon::<lambda_0543c53ae9d023817c0083d39c393691>::operator ()] Flush-to-zero and denormal-as-zero are off
2024-07-21 02:55:50.7212791 [I:onnxruntime:, inference_session.cc:276 onnxruntime::InferenceSession::ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true
2024-07-21 02:55:50.7218291 [I:onnxruntime:, inference_session.cc:294 onnxruntime::InferenceSession::ConstructorCommon] Dynamic block base set to 0
2024-07-21 02:55:50.7677286 [I:onnxruntime:, inference_session.cc:1233 onnxruntime::InferenceSession::Initialize] Initializing session.
2024-07-21 02:55:50.7681219 [I:onnxruntime:, inference_session.cc:1270 onnxruntime::InferenceSession::Initialize] Adding default CPU execution provider.
2024-07-21 02:55:50.7773898 [I:onnxruntime:, constant_sharing.cc:208 onnxruntime::ConstantSharing::ApplyImpl] Total shared scalar initializer count: 134
2024-07-21 02:55:50.7910690 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.0/attn/Reshape_1_output_0
2024-07-21 02:55:50.7916196 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.0/attn/Reshape_output_0
2024-07-21 02:55:50.7920636 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.0/attn/Reshape_2_output_0
2024-07-21 02:55:50.7923881 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.1/attn/Reshape_1_output_0
2024-07-21 02:55:50.7927959 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.1/attn/Reshape_output_0
2024-07-21 02:55:50.7931690 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.1/attn/Reshape_2_output_0
2024-07-21 02:55:50.7935720 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.2/attn/Reshape_1_output_0
2024-07-21 02:55:50.7939315 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.2/attn/Reshape_output_0
2024-07-21 02:55:50.7964739 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.2/attn/Reshape_2_output_0
2024-07-21 02:55:50.7971752 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.3/attn/Reshape_1_output_0
2024-07-21 02:55:50.7979608 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.3/attn/Reshape_output_0
2024-07-21 02:55:50.7984450 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /audioEncoder/blocks.3/attn/Reshape_2_output_0
2024-07-21 02:55:50.7985919 [I:onnxruntime:, reshape_fusion.cc:53 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 12
2024-07-21 02:55:50.8027180 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_5_7_1'. It is no longer used by any node.
2024-07-21 02:55:50.8033031 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_1_7_0'. It is no longer used by any node.
2024-07-21 02:55:50.8085443 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_5_out0'. It is no longer used by any node.
2024-07-21 02:55:50.8089107 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_out0'. It is no longer used by any node.
2024-07-21 02:55:50.8092190 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_1_out0'. It is no longer used by any node.
2024-07-21 02:55:50.8094645 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_3_out0'. It is no longer used by any node.
2024-07-21 02:55:50.8097434 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_7_out0'. It is no longer used by any node.
2024-07-21 02:55:50.8110151 [I:onnxruntime:, constant_sharing.cc:208 onnxruntime::ConstantSharing::ApplyImpl] Total shared scalar initializer count: 0
2024-07-21 02:55:50.8129192 [I:onnxruntime:, reshape_fusion.cc:53 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 0
2024-07-21 02:55:50.8262853 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_7_1_0'. It is no longer used by any node.
2024-07-21 02:55:50.8266537 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_6_1_0'. It is no longer used by any node.
2024-07-21 02:55:50.8270116 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_8_1_0'. It is no longer used by any node.
2024-07-21 02:55:50.8324551 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_3_1_0'. It is no longer used by any node.
2024-07-21 02:55:50.8327961 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_2_1_0'. It is no longer used by any node.
2024-07-21 02:55:50.8574152 [V:onnxruntime:, session_state.cc:1116 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Node placements
2024-07-21 02:55:50.8590324 [V:onnxruntime:, session_state.cc:1122 onnxruntime::VerifyEachNodeIsAssignedToAnEp]  Node(s) placed on [DmlExecutionProvider]. Number of nodes: 159
2024-07-21 02:55:50.8607656 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Conv (/audioEncoder/conv1/Conv)
2024-07-21 02:55:50.8626977 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Conv (/audioEncoder/conv2/Conv)
2024-07-21 02:55:50.8629340 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/Transpose)
2024-07-21 02:55:50.8646721 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/Shape)
2024-07-21 02:55:50.8664027 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/audioEncoder/Slice)
2024-07-21 02:55:50.8671243 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/Add_2)
2024-07-21 02:55:50.8674451 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/attn/query/MatMul)
2024-07-21 02:55:50.8678156 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/attn/query/Add)
2024-07-21 02:55:50.8680606 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/attn/key/MatMul)
2024-07-21 02:55:50.8683888 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/attn/value/MatMul)
2024-07-21 02:55:50.8685724 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/attn/value/Add)
2024-07-21 02:55:50.8687377 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.0/attn/Shape)
2024-07-21 02:55:50.8688809 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.0/attn/Reshape)
2024-07-21 02:55:50.8690445 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.0/attn/Transpose)
2024-07-21 02:55:50.8692060 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.0/attn/Mul)
2024-07-21 02:55:50.8693565 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.0/attn/Reshape_1)
2024-07-21 02:55:50.8695555 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.0/attn/Transpose_1)
2024-07-21 02:55:50.8699068 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.0/attn/Mul_1)
2024-07-21 02:55:50.8706652 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.0/attn/Reshape_2)
2024-07-21 02:55:50.8715578 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.0/attn/Transpose_2)
2024-07-21 02:55:50.8741348 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/attn/MatMul)
2024-07-21 02:55:50.8812887 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/audioEncoder/blocks.0/attn/Softmax)
2024-07-21 02:55:50.8820157 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/attn/MatMul_1)
2024-07-21 02:55:50.8825890 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.0/attn/Transpose_3)
2024-07-21 02:55:50.8841580 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.0/attn/Shape_7)
2024-07-21 02:55:50.8907993 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.0/attn/Reshape_3)
2024-07-21 02:55:50.8910166 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/attn/out/MatMul)
2024-07-21 02:55:50.8912623 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/attn/out/Add)
2024-07-21 02:55:50.8917343 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/Add)
2024-07-21 02:55:50.8920286 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/mlp/mlp.0/MatMul)
2024-07-21 02:55:50.8922950 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/mlp/mlp.0/Add)
2024-07-21 02:55:50.8959278 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.0/mlp/mlp.2/MatMul)
2024-07-21 02:55:50.8972578 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/mlp/mlp.2/Add)
2024-07-21 02:55:50.8982695 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.0/Add_1)
2024-07-21 02:55:50.8986137 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/attn/query/MatMul)
2024-07-21 02:55:50.8995868 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/attn/query/Add)
2024-07-21 02:55:50.9008015 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/attn/key/MatMul)
2024-07-21 02:55:50.9026241 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/attn/value/MatMul)
2024-07-21 02:55:50.9034375 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/attn/value/Add)
2024-07-21 02:55:50.9060893 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.1/attn/Shape)
2024-07-21 02:55:50.9063003 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.1/attn/Reshape)
2024-07-21 02:55:50.9064416 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.1/attn/Transpose)
2024-07-21 02:55:50.9065812 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.1/attn/Mul)
2024-07-21 02:55:50.9067130 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.1/attn/Reshape_1)
2024-07-21 02:55:50.9068445 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.1/attn/Transpose_1)
2024-07-21 02:55:50.9069961 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.1/attn/Mul_1)
2024-07-21 02:55:50.9071492 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.1/attn/Reshape_2)
2024-07-21 02:55:50.9073328 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.1/attn/Transpose_2)
2024-07-21 02:55:50.9075094 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/attn/MatMul)
2024-07-21 02:55:50.9076624 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/audioEncoder/blocks.1/attn/Softmax)
2024-07-21 02:55:50.9078010 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/attn/MatMul_1)
2024-07-21 02:55:50.9079359 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.1/attn/Transpose_3)
2024-07-21 02:55:50.9080961 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.1/attn/Shape_7)
2024-07-21 02:55:50.9082512 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.1/attn/Reshape_3)
2024-07-21 02:55:50.9085773 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/attn/out/MatMul)
2024-07-21 02:55:50.9160473 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/attn/out/Add)
2024-07-21 02:55:50.9172406 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/Add)
2024-07-21 02:55:50.9203871 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/mlp/mlp.0/MatMul)
2024-07-21 02:55:50.9214533 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/mlp/mlp.0/Add)
2024-07-21 02:55:50.9220988 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.1/mlp/mlp.2/MatMul)
2024-07-21 02:55:50.9228388 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/mlp/mlp.2/Add)
2024-07-21 02:55:50.9232907 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.1/Add_1)
2024-07-21 02:55:50.9237702 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/attn/query/MatMul)
2024-07-21 02:55:50.9243272 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/attn/query/Add)
2024-07-21 02:55:50.9249366 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/attn/key/MatMul)
2024-07-21 02:55:50.9255854 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/attn/value/MatMul)
2024-07-21 02:55:50.9262250 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/attn/value/Add)
2024-07-21 02:55:50.9265516 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.2/attn/Shape)
2024-07-21 02:55:50.9268185 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.2/attn/Reshape)
2024-07-21 02:55:50.9272357 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.2/attn/Transpose)
2024-07-21 02:55:50.9274360 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.2/attn/Mul)
2024-07-21 02:55:50.9284032 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.2/attn/Reshape_1)
2024-07-21 02:55:50.9293364 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.2/attn/Transpose_1)
2024-07-21 02:55:50.9297645 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.2/attn/Mul_1)
2024-07-21 02:55:50.9309223 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.2/attn/Reshape_2)
2024-07-21 02:55:50.9319405 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.2/attn/Transpose_2)
2024-07-21 02:55:50.9325930 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/attn/MatMul)
2024-07-21 02:55:50.9329776 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/audioEncoder/blocks.2/attn/Softmax)
2024-07-21 02:55:50.9333518 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/attn/MatMul_1)
2024-07-21 02:55:50.9348142 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.2/attn/Transpose_3)
2024-07-21 02:55:50.9350356 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.2/attn/Shape_7)
2024-07-21 02:55:50.9388649 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.2/attn/Reshape_3)
2024-07-21 02:55:50.9390740 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/attn/out/MatMul)
2024-07-21 02:55:50.9401866 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/attn/out/Add)
2024-07-21 02:55:50.9404871 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/Add)
2024-07-21 02:55:50.9415829 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/mlp/mlp.0/MatMul)
2024-07-21 02:55:50.9417705 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/mlp/mlp.0/Add)
2024-07-21 02:55:50.9484695 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.2/mlp/mlp.2/MatMul)
2024-07-21 02:55:50.9493682 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/mlp/mlp.2/Add)
2024-07-21 02:55:50.9497795 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.2/Add_1)
2024-07-21 02:55:50.9506390 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/attn/query/MatMul)
2024-07-21 02:55:50.9509479 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/attn/query/Add)
2024-07-21 02:55:50.9511542 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/attn/key/MatMul)
2024-07-21 02:55:50.9516606 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/attn/value/MatMul)
2024-07-21 02:55:50.9524563 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/attn/value/Add)
2024-07-21 02:55:50.9529084 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.3/attn/Shape)
2024-07-21 02:55:50.9533301 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.3/attn/Reshape)
2024-07-21 02:55:50.9545313 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.3/attn/Transpose)
2024-07-21 02:55:50.9553234 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.3/attn/Mul)
2024-07-21 02:55:50.9560532 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.3/attn/Reshape_1)
2024-07-21 02:55:50.9572910 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.3/attn/Transpose_1)
2024-07-21 02:55:50.9584079 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/audioEncoder/blocks.3/attn/Mul_1)
2024-07-21 02:55:50.9589984 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.3/attn/Reshape_2)
2024-07-21 02:55:50.9596965 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.3/attn/Transpose_2)
2024-07-21 02:55:50.9602615 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/attn/MatMul)
2024-07-21 02:55:50.9605168 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/audioEncoder/blocks.3/attn/Softmax)
2024-07-21 02:55:50.9618511 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/attn/MatMul_1)
2024-07-21 02:55:50.9631313 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/audioEncoder/blocks.3/attn/Transpose_3)
2024-07-21 02:55:50.9636224 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/audioEncoder/blocks.3/attn/Shape_7)
2024-07-21 02:55:50.9639747 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/audioEncoder/blocks.3/attn/Reshape_3)
2024-07-21 02:55:50.9654484 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/attn/out/MatMul)
2024-07-21 02:55:50.9658015 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/attn/out/Add)
2024-07-21 02:55:50.9661922 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/Add)
2024-07-21 02:55:50.9668933 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/mlp/mlp.0/MatMul)
2024-07-21 02:55:50.9676864 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/mlp/mlp.0/Add)
2024-07-21 02:55:50.9698296 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/audioEncoder/blocks.3/mlp/mlp.2/MatMul)
2024-07-21 02:55:50.9708780 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/mlp/mlp.2/Add)
2024-07-21 02:55:50.9717219 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/audioEncoder/blocks.3/Add_1)
2024-07-21 02:55:50.9721818 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key/MatMul)
2024-07-21 02:55:50.9727137 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value/MatMul)
2024-07-21 02:55:50.9728681 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value/Add)
2024-07-21 02:55:50.9734194 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key_1/MatMul)
2024-07-21 02:55:50.9736445 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value_1/MatMul)
2024-07-21 02:55:50.9738772 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value_1/Add)
2024-07-21 02:55:50.9741461 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key_2/MatMul)
2024-07-21 02:55:50.9744438 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value_2/MatMul)
2024-07-21 02:55:50.9746793 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value_2/Add)
2024-07-21 02:55:50.9749023 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key_3/MatMul)
2024-07-21 02:55:50.9752139 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value_3/MatMul)
2024-07-21 02:55:50.9753213 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value_3/Add)
2024-07-21 02:55:50.9754279 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze)
2024-07-21 02:55:50.9755150 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_1)
2024-07-21 02:55:50.9756037 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_2)
2024-07-21 02:55:50.9756982 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_3)
2024-07-21 02:55:50.9757906 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat)
2024-07-21 02:55:50.9758763 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_4)
2024-07-21 02:55:50.9759809 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_5)
2024-07-21 02:55:50.9760803 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_6)
2024-07-21 02:55:50.9761701 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_7)
2024-07-21 02:55:50.9762828 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_1)
2024-07-21 02:55:50.9771503 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu)
2024-07-21 02:55:50.9808071 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_8)
2024-07-21 02:55:50.9823761 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_9)
2024-07-21 02:55:50.9827017 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_10)
2024-07-21 02:55:50.9834696 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_11)
2024-07-21 02:55:50.9839059 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_12)
2024-07-21 02:55:50.9846104 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization)
2024-07-21 02:55:50.9849596 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_13)
2024-07-21 02:55:50.9853358 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_14)
2024-07-21 02:55:50.9859075 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_15)
2024-07-21 02:55:50.9864168 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_16)
2024-07-21 02:55:50.9868667 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_17)
2024-07-21 02:55:50.9875115 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_18)
2024-07-21 02:55:50.9877642 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_19)
2024-07-21 02:55:50.9883795 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_20)
2024-07-21 02:55:50.9888170 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy)
2024-07-21 02:55:50.9900881 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_21)
2024-07-21 02:55:50.9908558 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_22)
2024-07-21 02:55:50.9921967 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_23)
2024-07-21 02:55:50.9923588 [V:onnxruntime:, session_state.cc:1122 onnxruntime::VerifyEachNodeIsAssignedToAnEp]  Node(s) placed on [CPUExecutionProvider]. Number of nodes: 31
2024-07-21 02:55:50.9939749 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/audioEncoder/Gather)
2024-07-21 02:55:50.9974239 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/audioEncoder/Unsqueeze)
2024-07-21 02:55:50.9983024 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/audioEncoder/blocks.0/attn/Gather)
2024-07-21 02:55:50.9988223 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/audioEncoder/blocks.0/attn/Div)
2024-07-21 02:55:50.9991467 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/audioEncoder/blocks.0/attn/Cast_2)
2024-07-21 02:55:50.9993390 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/audioEncoder/blocks.0/attn/Pow)
2024-07-21 02:55:50.9998242 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/audioEncoder/blocks.0/attn/Slice)
2024-07-21 02:55:51.0005772 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/audioEncoder/blocks.0/attn/Concat_3)
2024-07-21 02:55:51.0009286 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/audioEncoder/blocks.1/attn/Gather)
2024-07-21 02:55:51.0014422 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/audioEncoder/blocks.1/attn/Div)
2024-07-21 02:55:51.0023184 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/audioEncoder/blocks.1/attn/Cast_2)
2024-07-21 02:55:51.0030406 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/audioEncoder/blocks.1/attn/Pow)
2024-07-21 02:55:51.0032886 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/audioEncoder/blocks.1/attn/Slice)
2024-07-21 02:55:51.0048299 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/audioEncoder/blocks.1/attn/Concat_3)
2024-07-21 02:55:51.0060322 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/audioEncoder/blocks.2/attn/Gather)
2024-07-21 02:55:51.0067322 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/audioEncoder/blocks.2/attn/Div)
2024-07-21 02:55:51.0068954 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/audioEncoder/blocks.2/attn/Cast_2)
2024-07-21 02:55:51.0347159 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/audioEncoder/blocks.2/attn/Pow)
2024-07-21 02:55:51.0361468 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/audioEncoder/blocks.2/attn/Slice)
2024-07-21 02:55:51.0382009 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/audioEncoder/blocks.2/attn/Concat_3)
2024-07-21 02:55:51.0386555 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/audioEncoder/blocks.3/attn/Gather)
2024-07-21 02:55:51.0411421 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/audioEncoder/blocks.3/attn/Div)
2024-07-21 02:55:51.0416888 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/audioEncoder/blocks.3/attn/Cast_2)
2024-07-21 02:55:51.0422604 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/audioEncoder/blocks.3/attn/Pow)
2024-07-21 02:55:51.0426563 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/audioEncoder/blocks.3/attn/Slice)
2024-07-21 02:55:51.0433097 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/audioEncoder/blocks.3/attn/Concat_3)
2024-07-21 02:55:51.0438388 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather)
2024-07-21 02:55:51.0447013 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_1)
2024-07-21 02:55:51.0526893 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_3)
2024-07-21 02:55:51.0533980 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_5)
2024-07-21 02:55:51.0558691 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_7)
2024-07-21 02:55:51.0565724 [W:onnxruntime:, session_state.cc:1136 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related 
ops to CPU to improve perf.
2024-07-21 02:55:51.0600266 [V:onnxruntime:, session_state.cc:133 onnxruntime::SessionState::CreateGraphInfo] SaveMLValueNameIndexMapping
2024-07-21 02:55:51.0615576 [V:onnxruntime:, session_state.cc:179 onnxruntime::SessionState::CreateGraphInfo] Done saving OrtValue mappings.
2024-07-21 02:55:51.0650230 [I:onnxruntime:, allocation_planner.cc:2413 onnxruntime::IGraphPartitioner::CreateGraphPartitioner] Use DeviceBasedPartition as default
2024-07-21 02:55:51.0729556 [I:onnxruntime:, session_state_utils.cc:199 onnxruntime::session_state_utils::SaveInitializedTensors] Saving initialized tensors.
2024-07-21 02:55:51.2583927 [I:onnxruntime:, session_state_utils.cc:342 onnxruntime::session_state_utils::SaveInitializedTensors] Done saving initialized tensors
2024-07-21 02:55:51.2598618 [I:onnxruntime:, inference_session.cc:1521 onnxruntime::InferenceSession::Initialize] Session successfully initialized.
C:\Users\User\Documents\code\sherpa-onnx3\sherpa-onnx\csrc\offline-whisper-model.cc:InitEncoder:243 ---encoder---
n_audio_head=6
sot_prev=50361
blank_id=220
n_text_layer=4
version=1
model_type=whisper-tiny
maintainer=k2-fsa
sot_lm=50360
n_mels=80
no_timestamps=50363
all_language_tokens=50317,50296,50261,50276,50337,50260,50271,50279,50298,50319,50301,50272,50268,50352,50333,50322,50330,50347,50341,50303,50320,50267,50314,50344,50331,50321,50273,50350,50305,50357,50355,50286,50353,50309,50262,50270,50292,50312,50289,50325,50274,50285,50328,50284,
50287,50311,50315,50283,50345,50346,50332,50338,50313,50354,50299,50295,50297,50281,50349,50327,50335,50306,50282,50326,50342,50351,50259,50348,50269,50264,50304,50291,50334,50275,50280,50340,50288,50310,50316,50323,50336,50324,50265,50308,50294,50356,50277,50302,50293,50278,50329,50
343,50318,50290,50263,50266,50300,50339,50307
n_audio_layer=4
n_audio_state=384
n_audio_ctx=1500
n_vocab=51865
n_text_ctx=448
n_text_state=384
n_text_head=6
sot_sequence=50258,50259,50359
all_language_codes=sq,ml,de,hi,uz,zh,nl,he,sk,gl,lv,ar,tr,haw,gu,si,be,bo,tk,sr,mr,pt,mn,sa,tg,pa,sv,as,sl,su,ba,hu,ln,br,es,ca,bg,hy,th,yo,it,da,oc,ro,ta,is,bs,cs,lb,my,sd,fo,ne,ha,te,mi,cy,el,mg,af,yi,kn,ms,so,nn,tt,en,tl,pl,ko,az,hr,am,id,uk,ps,no,eu,kk,km,lo,sn,fr,mk,la,jw,fi,bn,
lt,vi,ka,mt,sw,ur,ru,ja,fa,ht,et
sot=50258
sot_index=0
eot=50257
is_multilingual=1
no_speech=50362
non_speech_tokens=1,2,7,8,9,10,14,25,26,27,28,29,31,58,59,60,61,62,63,90,91,92,93,359,503,522,542,873,893,902,918,922,931,1350,1853,1982,2460,2627,3246,3253,3268,3536,3846,3961,4183,4667,6585,6647,7273,9061,9383,10428,10929,11938,12033,12331,12562,13793,14157,14635,15265,15618,16553,
16604,18362,18956,20075,21675,22520,26130,26161,26435,28279,29464,31650,32302,32470,36865,42863,47425,49870,50254
transcribe=50359
translate=50358


2024-07-21 02:55:51.9298967 [I:onnxruntime:, inference_session.cc:276 onnxruntime::InferenceSession::ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true
2024-07-21 02:55:51.9302344 [I:onnxruntime:, inference_session.cc:294 onnxruntime::InferenceSession::ConstructorCommon] Dynamic block base set to 0
2024-07-21 02:55:52.0642587 [I:onnxruntime:, inference_session.cc:1233 onnxruntime::InferenceSession::Initialize] Initializing session.
2024-07-21 02:55:52.0645408 [I:onnxruntime:, inference_session.cc:1270 onnxruntime::InferenceSession::Initialize] Adding default CPU execution provider.
2024-07-21 02:55:52.1034010 [I:onnxruntime:, constant_sharing.cc:208 onnxruntime::ConstantSharing::ApplyImpl] Total shared scalar initializer count: 747
2024-07-21 02:55:52.1935632 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_141_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1943403 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_81_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1949032 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_2_7_0'. It is no longer used by any node.
2024-07-21 02:55:52.1957203 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_11_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1961098 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_21_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1963505 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_48_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1965337 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_71_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1971963 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_59_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1974803 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_108_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1977153 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_131_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1979741 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_119_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1982333 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_168_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1984853 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_191_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1987828 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_179_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1991320 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_201_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1994859 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_239_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.1998083 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer '/Shape_228_output_0'. It is no longer used by any node.
2024-07-21 02:55:52.2038209 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_71_output_0
2024-07-21 02:55:52.2042896 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_51_output_0
2024-07-21 02:55:52.2046640 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_31_output_0
2024-07-21 02:55:52.2052152 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_11_output_0
2024-07-21 02:55:52.2054164 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_7_output_0
2024-07-21 02:55:52.2056644 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_6_output_0
2024-07-21 02:55:52.2059390 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_8_output_0
2024-07-21 02:55:52.2062140 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_10_output_0
2024-07-21 02:55:52.2063790 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_12_output_0
2024-07-21 02:55:52.2066221 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_27_output_0
2024-07-21 02:55:52.2068082 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_26_output_0
2024-07-21 02:55:52.2070402 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_28_output_0
2024-07-21 02:55:52.2072230 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_30_output_0
2024-07-21 02:55:52.2074602 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_32_output_0
2024-07-21 02:55:52.2077145 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_47_output_0
2024-07-21 02:55:52.2079468 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_46_output_0
2024-07-21 02:55:52.2081903 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_48_output_0
2024-07-21 02:55:52.2083997 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_50_output_0
2024-07-21 02:55:52.2086330 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_52_output_0
2024-07-21 02:55:52.2090725 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_67_output_0
2024-07-21 02:55:52.2094660 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_66_output_0
2024-07-21 02:55:52.2098769 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_68_output_0
2024-07-21 02:55:52.2100994 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_70_output_0
2024-07-21 02:55:52.2103074 [I:onnxruntime:, reshape_fusion.cc:49 onnxruntime::ReshapeFusion::ApplyImpl] Fused reshape node: /Reshape_72_output_0
2024-07-21 02:55:52.2105667 [I:onnxruntime:, reshape_fusion.cc:53 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 24
2024-07-21 02:55:52.2290582 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_6_7_1'. It is no longer used by any node.
2024-07-21 02:55:52.2506976 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_5_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2512053 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_13_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2519785 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2525572 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_1_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2529071 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_11_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2531597 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_3_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2534319 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_7_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2537596 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Gather_token_9_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2540033 [I:onnxruntime:, graph.cc:3556 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing NodeArg 'Transpose_out0'. It is no longer used by any node.
2024-07-21 02:55:52.2737147 [I:onnxruntime:, constant_sharing.cc:208 onnxruntime::ConstantSharing::ApplyImpl] Total shared scalar initializer count: 0
2024-07-21 02:55:52.2786184 [I:onnxruntime:, reshape_fusion.cc:53 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 0
2024-07-21 02:55:52.2814386 [I:onnxruntime:, constant_sharing.cc:208 onnxruntime::ConstantSharing::ApplyImpl] Total shared scalar initializer count: 0
2024-07-21 02:55:52.2893558 [I:onnxruntime:, reshape_fusion.cc:53 onnxruntime::ReshapeFusion::ApplyImpl] Total fused reshape node count: 0
2024-07-21 02:55:52.3377000 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_7_1_0'. It is no longer used by any node.
2024-07-21 02:55:52.3380424 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_5_1_0'. It is no longer used by any node.
2024-07-21 02:55:52.3382886 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_12_1_0'. It is no longer used by any node.
2024-07-21 02:55:52.3543902 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_8_1_0'. It is no longer used by any node.
2024-07-21 02:55:52.3547381 [I:onnxruntime:, graph.cc:3493 onnxruntime::Graph::CleanUnusedInitializersAndNodeArgs] Removing initializer 'ortshared_11_1_0'. It is no longer used by any node.
2024-07-21 02:55:52.5432327 [V:onnxruntime:, session_state.cc:1116 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Node placements
2024-07-21 02:55:52.5434605 [V:onnxruntime:, session_state.cc:1122 onnxruntime::VerifyEachNodeIsAssignedToAnEp]  Node(s) placed on [DmlExecutionProvider]. Number of nodes: 631
2024-07-21 02:55:52.5437162 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/token_embedding/Gather)
2024-07-21 02:55:52.5443686 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape)
2024-07-21 02:55:52.5445620 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice)
2024-07-21 02:55:52.5447045 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_1)
2024-07-21 02:55:52.5449307 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_5)
2024-07-21 02:55:52.5451495 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_1)
2024-07-21 02:55:52.5453343 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_8)
2024-07-21 02:55:52.5454997 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_2)
2024-07-21 02:55:52.5457289 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_9)
2024-07-21 02:55:52.5459622 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_10)
2024-07-21 02:55:52.5461054 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query/MatMul)
2024-07-21 02:55:52.5462348 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query/Add)
2024-07-21 02:55:52.5463526 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key/MatMul)
2024-07-21 02:55:52.5465980 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value/MatMul)
2024-07-21 02:55:52.5467512 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value/Add)
2024-07-21 02:55:52.5469527 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_3)
2024-07-21 02:55:52.5471561 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_3)
2024-07-21 02:55:52.5473343 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_4)
2024-07-21 02:55:52.5475244 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand)
2024-07-21 02:55:52.5477240 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range)
2024-07-21 02:55:52.5478914 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_1)
2024-07-21 02:55:52.5480623 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_4)
2024-07-21 02:55:52.5482286 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_2)
2024-07-21 02:55:52.5484202 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape)
2024-07-21 02:55:52.5485685 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_1)
2024-07-21 02:55:52.5487404 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_4)
2024-07-21 02:55:52.5489442 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_5)
2024-07-21 02:55:52.5492153 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_8)
2024-07-21 02:55:52.5494174 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_1)
2024-07-21 02:55:52.5495651 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_6)
2024-07-21 02:55:52.5496983 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_2)
2024-07-21 02:55:52.5498224 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_7)
2024-07-21 02:55:52.5500406 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_3)
2024-07-21 02:55:52.5503328 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_8)
2024-07-21 02:55:52.5505939 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat)
2024-07-21 02:55:52.5507630 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_12)
2024-07-21 02:55:52.5510641 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_2)
2024-07-21 02:55:52.5512276 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND)
2024-07-21 02:55:52.5514878 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_13)
2024-07-21 02:55:52.5517224 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_6)
2024-07-21 02:55:52.5519532 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_14)
2024-07-21 02:55:52.5521483 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_4)
2024-07-21 02:55:52.5523938 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_3)
2024-07-21 02:55:52.5526645 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_4)
2024-07-21 02:55:52.5529489 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_7)
2024-07-21 02:55:52.5531730 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_5)
2024-07-21 02:55:52.5533901 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_3)
2024-07-21 02:55:52.5536221 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_4)
2024-07-21 02:55:52.5538545 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_6)
2024-07-21 02:55:52.5540854 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_7)
2024-07-21 02:55:52.5542775 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_18)
2024-07-21 02:55:52.5545170 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_5)
2024-07-21 02:55:52.5547246 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_11)
2024-07-21 02:55:52.5549190 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_6)
2024-07-21 02:55:52.5551041 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_12)
2024-07-21 02:55:52.5553820 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_7)
2024-07-21 02:55:52.5555915 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_13)
2024-07-21 02:55:52.5557547 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_2)
2024-07-21 02:55:52.5559843 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_22)
2024-07-21 02:55:52.5561603 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_5)
2024-07-21 02:55:52.5563267 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_1)
2024-07-21 02:55:52.5565355 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_23)
2024-07-21 02:55:52.5568002 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_6)
2024-07-21 02:55:52.5571697 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose)
2024-07-21 02:55:52.5573877 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_6)
2024-07-21 02:55:52.5575849 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_7)
2024-07-21 02:55:52.5577689 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_1)
2024-07-21 02:55:52.5579258 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_7)
2024-07-21 02:55:52.5580642 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_8)
2024-07-21 02:55:52.5582348 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_2)
2024-07-21 02:55:52.5584756 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul)
2024-07-21 02:55:52.5586556 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_9)
2024-07-21 02:55:52.5588276 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_10)
2024-07-21 02:55:52.5589955 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_8)
2024-07-21 02:55:52.5591638 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax)
2024-07-21 02:55:52.5593420 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_1)
2024-07-21 02:55:52.5595166 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_3)
2024-07-21 02:55:52.5596833 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_30)
2024-07-21 02:55:52.5598590 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_9)
2024-07-21 02:55:52.5600187 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out/MatMul)
2024-07-21 02:55:52.5601910 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out/Add)
2024-07-21 02:55:52.5603621 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_9)
2024-07-21 02:55:52.5605361 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_1/MatMul)
2024-07-21 02:55:52.5606718 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_1/Add)
2024-07-21 02:55:52.5607739 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_31)
2024-07-21 02:55:52.5610225 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_10)
2024-07-21 02:55:52.5611735 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_4)
2024-07-21 02:55:52.5613800 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_8)
2024-07-21 02:55:52.5615757 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_11)
2024-07-21 02:55:52.5617983 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_5)
2024-07-21 02:55:52.5620140 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_9)
2024-07-21 02:55:52.5622482 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_12)
2024-07-21 02:55:52.5624754 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_6)
2024-07-21 02:55:52.5641811 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_2)
2024-07-21 02:55:52.5644764 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_1)
2024-07-21 02:55:52.5665041 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_3)
2024-07-21 02:55:52.5670148 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_7)
2024-07-21 02:55:52.5672318 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_38)
2024-07-21 02:55:52.5674423 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_13)
2024-07-21 02:55:52.5676326 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_1/MatMul)
2024-07-21 02:55:52.5678620 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_1/Add)
2024-07-21 02:55:52.5679998 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_10)
2024-07-21 02:55:52.5681252 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.0/MatMul)
2024-07-21 02:55:52.5682600 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.0/Add)
2024-07-21 02:55:52.5684565 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.2/MatMul)
2024-07-21 02:55:52.5686588 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.2/Add)
2024-07-21 02:55:52.5688047 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_11)
2024-07-21 02:55:52.5689762 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_8)
2024-07-21 02:55:52.5691553 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_6)
2024-07-21 02:55:52.5693000 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_7)
2024-07-21 02:55:52.5694813 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_14)
2024-07-21 02:55:52.5696194 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_8)
2024-07-21 02:55:52.5698371 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_14)
2024-07-21 02:55:52.5699882 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_15)
2024-07-21 02:55:52.5701759 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_13)
2024-07-21 02:55:52.5703169 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_14)
2024-07-21 02:55:52.5704878 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_15)
2024-07-21 02:55:52.5706635 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_44)
2024-07-21 02:55:52.5708432 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_9)
2024-07-21 02:55:52.5710136 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_30)
2024-07-21 02:55:52.5711934 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_10)
2024-07-21 02:55:52.5713744 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_31)
2024-07-21 02:55:52.5715908 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_11)
2024-07-21 02:55:52.5718223 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_32)
2024-07-21 02:55:52.5721211 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_12)
2024-07-21 02:55:52.5724058 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_33)
2024-07-21 02:55:52.5727077 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_12)
2024-07-21 02:55:52.5730739 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_49)
2024-07-21 02:55:52.5733764 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_16)
2024-07-21 02:55:52.5735667 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_2)
2024-07-21 02:55:52.5738174 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_13)
2024-07-21 02:55:52.5742236 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_9)
2024-07-21 02:55:52.5745347 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_10)
2024-07-21 02:55:52.5748526 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_17)
2024-07-21 02:55:52.5750629 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_11)
2024-07-21 02:55:52.5754222 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_17)
2024-07-21 02:55:52.5757244 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_18)
2024-07-21 02:55:52.5758732 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_17)
2024-07-21 02:55:52.5759969 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_18)
2024-07-21 02:55:52.5761201 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_19)
2024-07-21 02:55:52.5762477 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_55)
2024-07-21 02:55:52.5763794 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_14)
2024-07-21 02:55:52.5765118 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_36)
2024-07-21 02:55:52.5766459 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_15)
2024-07-21 02:55:52.5767789 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_37)
2024-07-21 02:55:52.5769111 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_16)
2024-07-21 02:55:52.5771699 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_38)
2024-07-21 02:55:52.5773265 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_17)
2024-07-21 02:55:52.5776560 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_39)
2024-07-21 02:55:52.5781113 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_14)
2024-07-21 02:55:52.5782705 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_60)
2024-07-21 02:55:52.5784054 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_19)
2024-07-21 02:55:52.5785311 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_3)
2024-07-21 02:55:52.5786615 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_47)
2024-07-21 02:55:52.5787828 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_19)
2024-07-21 02:55:52.5791078 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_50)
2024-07-21 02:55:52.5797641 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_20)
2024-07-21 02:55:52.5801098 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_51)
2024-07-21 02:55:52.5803655 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_52)
2024-07-21 02:55:52.5807379 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_2/MatMul)
2024-07-21 02:55:52.5825043 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_2/Add)
2024-07-21 02:55:52.5827417 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key_1/MatMul)
2024-07-21 02:55:52.5829067 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value_1/MatMul)
2024-07-21 02:55:52.5830951 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value_1/Add)
2024-07-21 02:55:52.5832611 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_63)
2024-07-21 02:55:52.5834555 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_21)
2024-07-21 02:55:52.5836541 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_64)
2024-07-21 02:55:52.5837838 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_18)
2024-07-21 02:55:52.5839491 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_12)
2024-07-21 02:55:52.5841556 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_13)
2024-07-21 02:55:52.5842928 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_22)
2024-07-21 02:55:52.5844735 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_14)
2024-07-21 02:55:52.5847131 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_20)
2024-07-21 02:55:52.5849360 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_21)
2024-07-21 02:55:52.5851563 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_22)
2024-07-21 02:55:52.5854455 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_23)
2024-07-21 02:55:52.5856562 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_68)
2024-07-21 02:55:52.5858411 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_19)
2024-07-21 02:55:52.5860305 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_44)
2024-07-21 02:55:52.5862527 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_20)
2024-07-21 02:55:52.5864699 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_45)
2024-07-21 02:55:52.5866894 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_21)
2024-07-21 02:55:52.5869389 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_46)
2024-07-21 02:55:52.5871307 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_16)
2024-07-21 02:55:52.5873452 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_72)
2024-07-21 02:55:52.5875277 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_22)
2024-07-21 02:55:52.5876581 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_4)
2024-07-21 02:55:52.5879798 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_73)
2024-07-21 02:55:52.5881879 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_24)
2024-07-21 02:55:52.5884861 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_74)
2024-07-21 02:55:52.5886640 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_22)
2024-07-21 02:55:52.5888479 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_15)
2024-07-21 02:55:52.5890622 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_16)
2024-07-21 02:55:52.5893073 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_25)
2024-07-21 02:55:52.5895687 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_17)
2024-07-21 02:55:52.5896924 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_23)
2024-07-21 02:55:52.5898389 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_24)
2024-07-21 02:55:52.5901105 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_24)
2024-07-21 02:55:52.5903600 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_25)
2024-07-21 02:55:52.5906240 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_78)
2024-07-21 02:55:52.5907723 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_23)
2024-07-21 02:55:52.5909769 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_49)
2024-07-21 02:55:52.5912590 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_24)
2024-07-21 02:55:52.5915905 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_50)
2024-07-21 02:55:52.5917394 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_25)
2024-07-21 02:55:52.5918612 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_51)
2024-07-21 02:55:52.5919947 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_18)
2024-07-21 02:55:52.5921235 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_82)
2024-07-21 02:55:52.5922467 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_25)
2024-07-21 02:55:52.5923799 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_5)
2024-07-21 02:55:52.5925056 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_83)
2024-07-21 02:55:52.5926264 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_26)
2024-07-21 02:55:52.5927416 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_8)
2024-07-21 02:55:52.5928725 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_24)
2024-07-21 02:55:52.5929905 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_27)
2024-07-21 02:55:52.5931198 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_9)
2024-07-21 02:55:52.5932528 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_25)
2024-07-21 02:55:52.5933669 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_28)
2024-07-21 02:55:52.5934700 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_10)
2024-07-21 02:55:52.5935865 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_4)
2024-07-21 02:55:52.5936909 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_27)
2024-07-21 02:55:52.5942198 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_28)
2024-07-21 02:55:52.5947591 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_26)
2024-07-21 02:55:52.5949577 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_2)
2024-07-21 02:55:52.5956586 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_5)
2024-07-21 02:55:52.5958300 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_11)
2024-07-21 02:55:52.5964498 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_90)
2024-07-21 02:55:52.5968802 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_29)
2024-07-21 02:55:52.5971137 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_2/MatMul)
2024-07-21 02:55:52.5973551 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_2/Add)
2024-07-21 02:55:52.5977453 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_27)
2024-07-21 02:55:52.5979251 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_3/MatMul)
2024-07-21 02:55:52.5981779 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_3/Add)
2024-07-21 02:55:52.5984667 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_91)
2024-07-21 02:55:52.5986786 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_30)
2024-07-21 02:55:52.5989027 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_12)
2024-07-21 02:55:52.5991950 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_26)
2024-07-21 02:55:52.5993488 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_31)
2024-07-21 02:55:52.5995822 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_13)
2024-07-21 02:55:52.5998747 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_27)
2024-07-21 02:55:52.6001036 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_32)
2024-07-21 02:55:52.6003811 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_14)
2024-07-21 02:55:52.6006208 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_6)
2024-07-21 02:55:52.6008926 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_3)
2024-07-21 02:55:52.6011075 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_7)
2024-07-21 02:55:52.6013193 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_15)
2024-07-21 02:55:52.6015379 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_98)
2024-07-21 02:55:52.6017750 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_33)
2024-07-21 02:55:52.6019756 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_3/MatMul)
2024-07-21 02:55:52.6022261 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_3/Add)
2024-07-21 02:55:52.6024782 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_28)
2024-07-21 02:55:52.6026757 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.0_1/MatMul)
2024-07-21 02:55:52.6029201 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.0_1/Add)
2024-07-21 02:55:52.6030826 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.2_1/MatMul)
2024-07-21 02:55:52.6033169 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.2_1/Add)
2024-07-21 02:55:52.6035608 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_29)
2024-07-21 02:55:52.6037632 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_26)
2024-07-21 02:55:52.6039985 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_18)
2024-07-21 02:55:52.6041964 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_19)
2024-07-21 02:55:52.6043921 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_32)
2024-07-21 02:55:52.6045388 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_20)
2024-07-21 02:55:52.6047187 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_34)
2024-07-21 02:55:52.6048986 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_35)
2024-07-21 02:55:52.6050986 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_31)
2024-07-21 02:55:52.6053630 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_32)
2024-07-21 02:55:52.6055208 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_33)
2024-07-21 02:55:52.6058407 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_104)
2024-07-21 02:55:52.6061303 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_27)
2024-07-21 02:55:52.6063982 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_68)
2024-07-21 02:55:52.6065599 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_28)
2024-07-21 02:55:52.6067287 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_69)
2024-07-21 02:55:52.6069090 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_29)
2024-07-21 02:55:52.6070383 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_70)
2024-07-21 02:55:52.6071633 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_30)
2024-07-21 02:55:52.6072869 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_71)
2024-07-21 02:55:52.6074187 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_28)
2024-07-21 02:55:52.6075398 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_109)
2024-07-21 02:55:52.6076794 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_36)
2024-07-21 02:55:52.6078073 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_6)
2024-07-21 02:55:52.6079335 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_31)
2024-07-21 02:55:52.6081363 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_21)
2024-07-21 02:55:52.6083565 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_22)
2024-07-21 02:55:52.6085443 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_35)
2024-07-21 02:55:52.6087412 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_23)
2024-07-21 02:55:52.6089339 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_37)
2024-07-21 02:55:52.6091597 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_38)
2024-07-21 02:55:52.6092956 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_35)
2024-07-21 02:55:52.6094177 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_36)
2024-07-21 02:55:52.6095320 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_37)
2024-07-21 02:55:52.6096459 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_115)
2024-07-21 02:55:52.6097746 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_32)
2024-07-21 02:55:52.6098974 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_74)
2024-07-21 02:55:52.6100206 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_33)
2024-07-21 02:55:52.6101487 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_75)
2024-07-21 02:55:52.6102754 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_34)
2024-07-21 02:55:52.6105287 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_76)
2024-07-21 02:55:52.6107663 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_35)
2024-07-21 02:55:52.6114006 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_77)
2024-07-21 02:55:52.6118344 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_30)
2024-07-21 02:55:52.6121662 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_120)
2024-07-21 02:55:52.6123861 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_39)
2024-07-21 02:55:52.6125678 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_7)
2024-07-21 02:55:52.6131310 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_89)
2024-07-21 02:55:52.6137585 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_37)
2024-07-21 02:55:52.6139407 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_92)
2024-07-21 02:55:52.6140987 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_38)
2024-07-21 02:55:52.6144055 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_93)
2024-07-21 02:55:52.6149088 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_94)
2024-07-21 02:55:52.6150537 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_4/MatMul)
2024-07-21 02:55:52.6160023 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_4/Add)
2024-07-21 02:55:52.6162126 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key_2/MatMul)
2024-07-21 02:55:52.6164230 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value_2/MatMul)
2024-07-21 02:55:52.6165807 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value_2/Add)
2024-07-21 02:55:52.6168004 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_123)
2024-07-21 02:55:52.6169476 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_39)
2024-07-21 02:55:52.6170757 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_124)
2024-07-21 02:55:52.6171923 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_36)
2024-07-21 02:55:52.6174181 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_24)
2024-07-21 02:55:52.6175754 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_25)
2024-07-21 02:55:52.6177559 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_40)
2024-07-21 02:55:52.6179694 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_26)
2024-07-21 02:55:52.6181187 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_40)
2024-07-21 02:55:52.6182477 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_41)
2024-07-21 02:55:52.6185052 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_40)
2024-07-21 02:55:52.6186439 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_41)
2024-07-21 02:55:52.6194349 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_128)
2024-07-21 02:55:52.6197152 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_37)
2024-07-21 02:55:52.6200505 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_82)
2024-07-21 02:55:52.6203563 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_38)
2024-07-21 02:55:52.6209218 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_83)
2024-07-21 02:55:52.6217810 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_39)
2024-07-21 02:55:52.6233926 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_84)
2024-07-21 02:55:52.6238703 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_32)
2024-07-21 02:55:52.6240231 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_132)
2024-07-21 02:55:52.6241640 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_42)
2024-07-21 02:55:52.6243073 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_8)
2024-07-21 02:55:52.6249476 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_133)
2024-07-21 02:55:52.6261603 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_42)
2024-07-21 02:55:52.6269170 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_134)
2024-07-21 02:55:52.6270730 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_40)
2024-07-21 02:55:52.6272881 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_27)
2024-07-21 02:55:52.6274026 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_28)
2024-07-21 02:55:52.6285776 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_43)
2024-07-21 02:55:52.6295676 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_29)
2024-07-21 02:55:52.6298030 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_43)
2024-07-21 02:55:52.6299384 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_44)
2024-07-21 02:55:52.6301385 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_42)
2024-07-21 02:55:52.6317267 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_43)
2024-07-21 02:55:52.6321684 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_138)
2024-07-21 02:55:52.6325879 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_41)
2024-07-21 02:55:52.6339074 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_87)
2024-07-21 02:55:52.6343840 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_42)
2024-07-21 02:55:52.6346118 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_88)
2024-07-21 02:55:52.6353184 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_43)
2024-07-21 02:55:52.6354654 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_89)
2024-07-21 02:55:52.6356035 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_34)
2024-07-21 02:55:52.6360336 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_142)
2024-07-21 02:55:52.6363787 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_45)
2024-07-21 02:55:52.6367545 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_9)
2024-07-21 02:55:52.6371514 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_143)
2024-07-21 02:55:52.6374656 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_46)
2024-07-21 02:55:52.6376077 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_16)
2024-07-21 02:55:52.6382854 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_42)
2024-07-21 02:55:52.6388523 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_47)
2024-07-21 02:55:52.6391696 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_17)
2024-07-21 02:55:52.6393223 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_43)
2024-07-21 02:55:52.6395475 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_48)
2024-07-21 02:55:52.6397384 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_18)
2024-07-21 02:55:52.6401587 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_8)
2024-07-21 02:55:52.6403983 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_45)
2024-07-21 02:55:52.6406447 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_46)
2024-07-21 02:55:52.6408306 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_44)
2024-07-21 02:55:52.6410209 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_4)
2024-07-21 02:55:52.6412381 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_9)
2024-07-21 02:55:52.6416547 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_19)
2024-07-21 02:55:52.6420840 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_150)
2024-07-21 02:55:52.6425478 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_49)
2024-07-21 02:55:52.6427015 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_4/MatMul)
2024-07-21 02:55:52.6434589 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_4/Add)
2024-07-21 02:55:52.6438128 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_45)
2024-07-21 02:55:52.6456375 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_5/MatMul)
2024-07-21 02:55:52.6463279 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_5/Add)
2024-07-21 02:55:52.6493208 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_151)
2024-07-21 02:55:52.6502350 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_50)
2024-07-21 02:55:52.6508047 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_20)
2024-07-21 02:55:52.6509502 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_44)
2024-07-21 02:55:52.6510686 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_51)
2024-07-21 02:55:52.6512436 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_21)
2024-07-21 02:55:52.6516472 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_45)
2024-07-21 02:55:52.6519365 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_52)
2024-07-21 02:55:52.6520970 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_22)
2024-07-21 02:55:52.6523032 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_10)
2024-07-21 02:55:52.6525313 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_5)
2024-07-21 02:55:52.6527237 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_11)
2024-07-21 02:55:52.6528743 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_23)
2024-07-21 02:55:52.6533870 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_158)
2024-07-21 02:55:52.6535868 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_53)
2024-07-21 02:55:52.6540902 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_5/MatMul)
2024-07-21 02:55:52.6545543 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_5/Add)
2024-07-21 02:55:52.6550261 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_46)
2024-07-21 02:55:52.6554872 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.0_2/MatMul)
2024-07-21 02:55:52.6556297 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.0_2/Add)
2024-07-21 02:55:52.6558882 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.2_2/MatMul)
2024-07-21 02:55:52.6560472 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.2_2/Add)
2024-07-21 02:55:52.6561784 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_47)
2024-07-21 02:55:52.6563090 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_44)
2024-07-21 02:55:52.6564554 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_30)
2024-07-21 02:55:52.6566195 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_31)
2024-07-21 02:55:52.6567482 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_50)
2024-07-21 02:55:52.6568829 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_32)
2024-07-21 02:55:52.6570129 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_54)
2024-07-21 02:55:52.6571412 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_55)
2024-07-21 02:55:52.6573007 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_49)
2024-07-21 02:55:52.6574144 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_50)
2024-07-21 02:55:52.6575485 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_51)
2024-07-21 02:55:52.6576716 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_164)
2024-07-21 02:55:52.6578041 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_45)
2024-07-21 02:55:52.6579309 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_106)
2024-07-21 02:55:52.6586276 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_46)
2024-07-21 02:55:52.6592094 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_107)
2024-07-21 02:55:52.6596718 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_47)
2024-07-21 02:55:52.6604098 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_108)
2024-07-21 02:55:52.6615561 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_48)
2024-07-21 02:55:52.6617248 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_109)
2024-07-21 02:55:52.6619101 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_44)
2024-07-21 02:55:52.6620521 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_169)
2024-07-21 02:55:52.6624884 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_56)
2024-07-21 02:55:52.6640778 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_10)
2024-07-21 02:55:52.6642952 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_49)
2024-07-21 02:55:52.6649924 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_33)
2024-07-21 02:55:52.6653884 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_34)
2024-07-21 02:55:52.6659197 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_53)
2024-07-21 02:55:52.6660999 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_35)
2024-07-21 02:55:52.6667091 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_57)
2024-07-21 02:55:52.6668691 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_58)
2024-07-21 02:55:52.6670457 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_53)
2024-07-21 02:55:52.6684668 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_54)
2024-07-21 02:55:52.6691036 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_55)
2024-07-21 02:55:52.6695279 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_175)
2024-07-21 02:55:52.6696899 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_50)
2024-07-21 02:55:52.6698324 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_112)
2024-07-21 02:55:52.6701225 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_51)
2024-07-21 02:55:52.6702646 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_113)
2024-07-21 02:55:52.6704089 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_52)
2024-07-21 02:55:52.6705407 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_114)
2024-07-21 02:55:52.6706865 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_53)
2024-07-21 02:55:52.6708174 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_115)
2024-07-21 02:55:52.6709553 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_46)
2024-07-21 02:55:52.6711180 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_180)
2024-07-21 02:55:52.6713628 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_59)
2024-07-21 02:55:52.6715435 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_11)
2024-07-21 02:55:52.6716689 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_131)
2024-07-21 02:55:52.6719307 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_55)
2024-07-21 02:55:52.6722250 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_134)
2024-07-21 02:55:52.6726996 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_56)
2024-07-21 02:55:52.6730470 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_135)
2024-07-21 02:55:52.6734477 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_136)
2024-07-21 02:55:52.6736911 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_6/MatMul)
2024-07-21 02:55:52.6767935 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_6/Add)
2024-07-21 02:55:52.6775562 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/key_3/MatMul)
2024-07-21 02:55:52.6792305 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/value_3/MatMul)
2024-07-21 02:55:52.6802459 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/value_3/Add)
2024-07-21 02:55:52.6807865 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_183)
2024-07-21 02:55:52.6812322 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_57)
2024-07-21 02:55:52.6828353 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_184)
2024-07-21 02:55:52.6835773 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_54)
2024-07-21 02:55:52.6840632 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_36)
2024-07-21 02:55:52.6846423 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_37)
2024-07-21 02:55:52.6849862 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_58)
2024-07-21 02:55:52.6860487 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_38)
2024-07-21 02:55:52.6863457 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_60)
2024-07-21 02:55:52.6872609 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_61)
2024-07-21 02:55:52.6875113 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_58)
2024-07-21 02:55:52.6880056 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_59)
2024-07-21 02:55:52.6882836 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_188)
2024-07-21 02:55:52.6885318 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_55)
2024-07-21 02:55:52.6886871 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_120)
2024-07-21 02:55:52.6888468 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_56)
2024-07-21 02:55:52.6889878 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_121)
2024-07-21 02:55:52.6891283 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_57)
2024-07-21 02:55:52.6893881 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_122)
2024-07-21 02:55:52.6895188 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_48)
2024-07-21 02:55:52.6896263 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_192)
2024-07-21 02:55:52.6898088 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_62)
2024-07-21 02:55:52.6899543 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_12)
2024-07-21 02:55:52.6901135 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_193)
2024-07-21 02:55:52.6903205 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_60)
2024-07-21 02:55:52.6905593 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_194)
2024-07-21 02:55:52.6908363 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_58)
2024-07-21 02:55:52.6911092 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_39)
2024-07-21 02:55:52.6914093 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_40)
2024-07-21 02:55:52.6917987 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_61)
2024-07-21 02:55:52.6921045 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_41)
2024-07-21 02:55:52.6923537 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_63)
2024-07-21 02:55:52.6925787 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_64)
2024-07-21 02:55:52.6928519 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_60)
2024-07-21 02:55:52.6931314 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_61)
2024-07-21 02:55:52.6934879 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_198)
2024-07-21 02:55:52.6939868 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_59)
2024-07-21 02:55:52.6945540 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_125)
2024-07-21 02:55:52.6974035 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_60)
2024-07-21 02:55:52.6995374 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_126)
2024-07-21 02:55:52.6998815 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_61)
2024-07-21 02:55:52.7001302 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_127)
2024-07-21 02:55:52.7004142 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_50)
2024-07-21 02:55:52.7006211 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_202)
2024-07-21 02:55:52.7007664 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_65)
2024-07-21 02:55:52.7008964 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_13)
2024-07-21 02:55:52.7010237 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_203)
2024-07-21 02:55:52.7011338 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_66)
2024-07-21 02:55:52.7017087 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_24)
2024-07-21 02:55:52.7021795 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_60)
2024-07-21 02:55:52.7023629 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_67)
2024-07-21 02:55:52.7030992 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_25)
2024-07-21 02:55:52.7033341 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_61)
2024-07-21 02:55:52.7036789 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_68)
2024-07-21 02:55:52.7040661 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_26)
2024-07-21 02:55:52.7042194 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_12)
2024-07-21 02:55:52.7045762 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_63)
2024-07-21 02:55:52.7047795 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_64)
2024-07-21 02:55:52.7049271 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_62)
2024-07-21 02:55:52.7051137 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_6)
2024-07-21 02:55:52.7056126 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_13)
2024-07-21 02:55:52.7058875 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_27)
2024-07-21 02:55:52.7061254 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_210)
2024-07-21 02:55:52.7069265 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_69)
2024-07-21 02:55:52.7073657 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_6/MatMul)
2024-07-21 02:55:52.7076242 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_6/Add)
2024-07-21 02:55:52.7078133 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_63)
2024-07-21 02:55:52.7080390 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/query_7/MatMul)
2024-07-21 02:55:52.7081783 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/query_7/Add)
2024-07-21 02:55:52.7083096 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_211)
2024-07-21 02:55:52.7085575 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_70)
2024-07-21 02:55:52.7088325 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_28)
2024-07-21 02:55:52.7089882 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_62)
2024-07-21 02:55:52.7094410 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_71)
2024-07-21 02:55:52.7096010 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_29)
2024-07-21 02:55:52.7102494 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Mul (/Mul_63)
2024-07-21 02:55:52.7105762 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_72)
2024-07-21 02:55:52.7108285 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_30)
2024-07-21 02:55:52.7113813 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_14)
2024-07-21 02:55:52.7119979 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Softmax (/Softmax_7)
2024-07-21 02:55:52.7121587 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/MatMul_15)
2024-07-21 02:55:52.7129922 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (/Transpose_31)
2024-07-21 02:55:52.7131728 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_218)
2024-07-21 02:55:52.7133730 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_73)
2024-07-21 02:55:52.7136041 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/out_7/MatMul)
2024-07-21 02:55:52.7140272 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/out_7/Add)
2024-07-21 02:55:52.7142227 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_64)
2024-07-21 02:55:52.7145037 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.0_3/MatMul)
2024-07-21 02:55:52.7147126 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.0_3/Add)
2024-07-21 02:55:52.7152985 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MatMul (/mlp/mlp.2_3/MatMul)
2024-07-21 02:55:52.7156460 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/mlp/mlp.2_3/Add)
2024-07-21 02:55:52.7162754 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_65)
2024-07-21 02:55:52.7164938 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_62)
2024-07-21 02:55:52.7166275 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_42)
2024-07-21 02:55:52.7167541 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_43)
2024-07-21 02:55:52.7168980 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_68)
2024-07-21 02:55:52.7170713 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_44)
2024-07-21 02:55:52.7173202 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_74)
2024-07-21 02:55:52.7176143 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_75)
2024-07-21 02:55:52.7177605 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_67)
2024-07-21 02:55:52.7179900 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_68)
2024-07-21 02:55:52.7182857 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_69)
2024-07-21 02:55:52.7185654 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_224)
2024-07-21 02:55:52.7188366 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_63)
2024-07-21 02:55:52.7190956 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_144)
2024-07-21 02:55:52.7193684 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_64)
2024-07-21 02:55:52.7195382 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_145)
2024-07-21 02:55:52.7198004 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_65)
2024-07-21 02:55:52.7200257 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_146)
2024-07-21 02:55:52.7202471 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_66)
2024-07-21 02:55:52.7204477 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_147)
2024-07-21 02:55:52.7206943 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_60)
2024-07-21 02:55:52.7208834 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_229)
2024-07-21 02:55:52.7211055 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_76)
2024-07-21 02:55:52.7213469 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_14)
2024-07-21 02:55:52.7215724 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_67)
2024-07-21 02:55:52.7217950 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_45)
2024-07-21 02:55:52.7220943 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_46)
2024-07-21 02:55:52.7222460 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_71)
2024-07-21 02:55:52.7224090 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Range (/Range_47)
2024-07-21 02:55:52.7225343 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_77)
2024-07-21 02:55:52.7230246 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_78)
2024-07-21 02:55:52.7232110 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_71)
2024-07-21 02:55:52.7233986 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_72)
2024-07-21 02:55:52.7236487 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Add (/Add_73)
2024-07-21 02:55:52.7237803 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_235)
2024-07-21 02:55:52.7239860 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_68)
2024-07-21 02:55:52.7245285 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_150)
2024-07-21 02:55:52.7247751 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_69)
2024-07-21 02:55:52.7249663 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_151)
2024-07-21 02:55:52.7251551 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_70)
2024-07-21 02:55:52.7253068 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_152)
2024-07-21 02:55:52.7254877 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Expand (/Expand_71)
2024-07-21 02:55:52.7256307 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_153)
2024-07-21 02:55:52.7257253 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_62)
2024-07-21 02:55:52.7258085 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Shape (/Shape_240)
2024-07-21 02:55:52.7258927 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Reshape (/Reshape_79)
2024-07-21 02:55:52.7259784 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   ScatterND (/ScatterND_15)
2024-07-21 02:55:52.7260673 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Transpose (Transpose)
2024-07-21 02:55:52.7261529 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu)
2024-07-21 02:55:52.7262298 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_14)
2024-07-21 02:55:52.7263724 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_15)
2024-07-21 02:55:52.7268922 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gelu (Gelu_token_16)
2024-07-21 02:55:52.7269962 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization)
2024-07-21 02:55:52.7271362 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_17)
2024-07-21 02:55:52.7279680 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_18)
2024-07-21 02:55:52.7282664 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_19)
2024-07-21 02:55:52.7285094 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_20)
2024-07-21 02:55:52.7287087 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_21)
2024-07-21 02:55:52.7289028 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_22)
2024-07-21 02:55:52.7290679 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_23)
2024-07-21 02:55:52.7293902 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_24)
2024-07-21 02:55:52.7297202 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_25)
2024-07-21 02:55:52.7305408 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_26)
2024-07-21 02:55:52.7307386 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_27)
2024-07-21 02:55:52.7309111 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   LayerNormalization (LayerNormalization_token_28)
2024-07-21 02:55:52.7310837 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   FusedMatMul (MatMul_With_Transpose)
2024-07-21 02:55:52.7312823 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   DmlFusedNode_0_14 (DmlFusedNode_0_14)
2024-07-21 02:55:52.7314241 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy)
2024-07-21 02:55:52.7315501 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_34)
2024-07-21 02:55:52.7317153 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_35)
2024-07-21 02:55:52.7318678 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_36)
2024-07-21 02:55:52.7341773 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_37)
2024-07-21 02:55:52.7345441 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_38)
2024-07-21 02:55:52.7348353 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_39)
2024-07-21 02:55:52.7349937 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_40)
2024-07-21 02:55:52.7351382 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyFromHost (Memcpy_token_41)
2024-07-21 02:55:52.7353746 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyToHost (Memcpy_token_42)
2024-07-21 02:55:52.7357158 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   MemcpyToHost (Memcpy_token_43)
2024-07-21 02:55:52.7359776 [V:onnxruntime:, session_state.cc:1122 onnxruntime::VerifyEachNodeIsAssignedToAnEp]  Node(s) placed on [CPUExecutionProvider]. Number of nodes: 281
2024-07-21 02:55:52.7362438 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_2)
2024-07-21 02:55:52.7363782 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_11)
2024-07-21 02:55:52.7364913 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg)
2024-07-21 02:55:52.7366077 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_12)
2024-07-21 02:55:52.7368648 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_13)
2024-07-21 02:55:52.7370505 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_5)
2024-07-21 02:55:52.7371956 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_14)
2024-07-21 02:55:52.7373624 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal)
2024-07-21 02:55:52.7375424 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where)
2024-07-21 02:55:52.7377318 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_1)
2024-07-21 02:55:52.7379277 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_1)
2024-07-21 02:55:52.7380432 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_2)
2024-07-21 02:55:52.7381987 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_2)
2024-07-21 02:55:52.7383277 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_5)
2024-07-21 02:55:52.7384445 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_1)
2024-07-21 02:55:52.7386539 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_15)
2024-07-21 02:55:52.7388536 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_1)
2024-07-21 02:55:52.7389819 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_16)
2024-07-21 02:55:52.7391233 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_17)
2024-07-21 02:55:52.7392459 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_10)
2024-07-21 02:55:52.7394405 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_18)
2024-07-21 02:55:52.7396502 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_3)
2024-07-21 02:55:52.7397968 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_3)
2024-07-21 02:55:52.7399240 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_4)
2024-07-21 02:55:52.7400652 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_4)
2024-07-21 02:55:52.7402064 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_5)
2024-07-21 02:55:52.7403351 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_5)
2024-07-21 02:55:52.7404678 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_8)
2024-07-21 02:55:52.7407047 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_3)
2024-07-21 02:55:52.7409641 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_19)
2024-07-21 02:55:52.7412576 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_20)
2024-07-21 02:55:52.7414043 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div)
2024-07-21 02:55:52.7415275 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_9)
2024-07-21 02:55:52.7417403 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow)
2024-07-21 02:55:52.7419722 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_21)
2024-07-21 02:55:52.7421729 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_11)
2024-07-21 02:55:52.7423089 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_7)
2024-07-21 02:55:52.7425152 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_26)
2024-07-21 02:55:52.7427341 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_1)
2024-07-21 02:55:52.7429399 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_14)
2024-07-21 02:55:52.7431852 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_1)
2024-07-21 02:55:52.7433806 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_12)
2024-07-21 02:55:52.7435157 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_11)
2024-07-21 02:55:52.7436548 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_36)
2024-07-21 02:55:52.7439496 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_37)
2024-07-21 02:55:52.7440809 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_38)
2024-07-21 02:55:52.7445066 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_6)
2024-07-21 02:55:52.7447747 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_6)
2024-07-21 02:55:52.7450230 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_7)
2024-07-21 02:55:52.7454608 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_7)
2024-07-21 02:55:52.7456447 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_8)
2024-07-21 02:55:52.7459544 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_8)
2024-07-21 02:55:52.7462096 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_9)
2024-07-21 02:55:52.7463976 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_9)
2024-07-21 02:55:52.7465284 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_15)
2024-07-21 02:55:52.7467450 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_13)
2024-07-21 02:55:52.7470528 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_42)
2024-07-21 02:55:52.7472178 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_43)
2024-07-21 02:55:52.7473632 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_44)
2024-07-21 02:55:52.7477369 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_10)
2024-07-21 02:55:52.7479063 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_10)
2024-07-21 02:55:52.7482603 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_11)
2024-07-21 02:55:52.7484023 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_11)
2024-07-21 02:55:52.7485457 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_12)
2024-07-21 02:55:52.7486739 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_12)
2024-07-21 02:55:52.7488023 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_13)
2024-07-21 02:55:52.7491491 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_13)
2024-07-21 02:55:52.7493665 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_18)
2024-07-21 02:55:52.7495227 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_15)
2024-07-21 02:55:52.7497352 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_53)
2024-07-21 02:55:52.7501445 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_2)
2024-07-21 02:55:52.7503063 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_54)
2024-07-21 02:55:52.7505834 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_55)
2024-07-21 02:55:52.7508064 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_43)
2024-07-21 02:55:52.7510510 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_56)
2024-07-21 02:55:52.7512752 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_14)
2024-07-21 02:55:52.7514403 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_14)
2024-07-21 02:55:52.7516881 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_15)
2024-07-21 02:55:52.7519208 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_15)
2024-07-21 02:55:52.7520983 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_16)
2024-07-21 02:55:52.7523501 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_16)
2024-07-21 02:55:52.7526045 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_23)
2024-07-21 02:55:52.7528659 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_17)
2024-07-21 02:55:52.7530912 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_57)
2024-07-21 02:55:52.7533456 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_3)
2024-07-21 02:55:52.7536362 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_58)
2024-07-21 02:55:52.7538903 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_59)
2024-07-21 02:55:52.7541826 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_48)
2024-07-21 02:55:52.7546041 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_60)
2024-07-21 02:55:52.7549440 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_17)
2024-07-21 02:55:52.7552951 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_17)
2024-07-21 02:55:52.7556168 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_18)
2024-07-21 02:55:52.7557494 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_18)
2024-07-21 02:55:52.7559592 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_19)
2024-07-21 02:55:52.7562190 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_19)
2024-07-21 02:55:52.7564774 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_26)
2024-07-21 02:55:52.7566499 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_19)
2024-07-21 02:55:52.7567827 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_61)
2024-07-21 02:55:52.7569086 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_62)
2024-07-21 02:55:52.7571520 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_2)
2024-07-21 02:55:52.7573359 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_31)
2024-07-21 02:55:52.7575056 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_2)
2024-07-21 02:55:52.7577537 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_59)
2024-07-21 02:55:52.7579488 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_29)
2024-07-21 02:55:52.7581273 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_23)
2024-07-21 02:55:52.7582570 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_68)
2024-07-21 02:55:52.7584556 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_3)
2024-07-21 02:55:52.7586489 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_36)
2024-07-21 02:55:52.7588253 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_3)
2024-07-21 02:55:52.7590197 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_30)
2024-07-21 02:55:52.7592104 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_27)
2024-07-21 02:55:52.7594563 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_78)
2024-07-21 02:55:52.7596277 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_79)
2024-07-21 02:55:52.7598111 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_80)
2024-07-21 02:55:52.7604994 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_20)
2024-07-21 02:55:52.7606369 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_20)
2024-07-21 02:55:52.7607568 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_21)
2024-07-21 02:55:52.7610614 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_21)
2024-07-21 02:55:52.7612529 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_22)
2024-07-21 02:55:52.7615950 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_22)
2024-07-21 02:55:52.7617776 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_23)
2024-07-21 02:55:52.7619372 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_23)
2024-07-21 02:55:52.7621296 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_33)
2024-07-21 02:55:52.7623500 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_29)
2024-07-21 02:55:52.7630196 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_84)
2024-07-21 02:55:52.7635952 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_85)
2024-07-21 02:55:52.7638705 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_86)
2024-07-21 02:55:52.7640697 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_24)
2024-07-21 02:55:52.7642387 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_24)
2024-07-21 02:55:52.7644670 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_25)
2024-07-21 02:55:52.7646465 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_25)
2024-07-21 02:55:52.7649107 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_26)
2024-07-21 02:55:52.7658379 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_26)
2024-07-21 02:55:52.7669631 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_27)
2024-07-21 02:55:52.7680263 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_27)
2024-07-21 02:55:52.7682983 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_36)
2024-07-21 02:55:52.7686283 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_31)
2024-07-21 02:55:52.7689494 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_95)
2024-07-21 02:55:52.7690915 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_4)
2024-07-21 02:55:52.7695496 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_96)
2024-07-21 02:55:52.7697875 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_97)
2024-07-21 02:55:52.7700092 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_81)
2024-07-21 02:55:52.7702429 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_98)
2024-07-21 02:55:52.7704711 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_28)
2024-07-21 02:55:52.7706861 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_28)
2024-07-21 02:55:52.7709503 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_29)
2024-07-21 02:55:52.7711302 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_29)
2024-07-21 02:55:52.7712903 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_30)
2024-07-21 02:55:52.7715569 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_30)
2024-07-21 02:55:52.7717106 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_41)
2024-07-21 02:55:52.7718979 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_33)
2024-07-21 02:55:52.7720987 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_99)
2024-07-21 02:55:52.7722889 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_5)
2024-07-21 02:55:52.7724770 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_100)
2024-07-21 02:55:52.7726181 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_101)
2024-07-21 02:55:52.7728219 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_86)
2024-07-21 02:55:52.7729734 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_102)
2024-07-21 02:55:52.7731930 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_31)
2024-07-21 02:55:52.7733325 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_31)
2024-07-21 02:55:52.7734975 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_32)
2024-07-21 02:55:52.7736955 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_32)
2024-07-21 02:55:52.7738790 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_33)
2024-07-21 02:55:52.7740491 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_33)
2024-07-21 02:55:52.7742420 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_44)
2024-07-21 02:55:52.7744384 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_35)
2024-07-21 02:55:52.7746343 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_103)
2024-07-21 02:55:52.7748130 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_104)
2024-07-21 02:55:52.7749969 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_4)
2024-07-21 02:55:52.7752877 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_53)
2024-07-21 02:55:52.7755715 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_4)
2024-07-21 02:55:52.7760651 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_97)
2024-07-21 02:55:52.7762589 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_47)
2024-07-21 02:55:52.7765903 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_39)
2024-07-21 02:55:52.7768392 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_110)
2024-07-21 02:55:52.7770493 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_5)
2024-07-21 02:55:52.7772640 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_58)
2024-07-21 02:55:52.7777145 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_5)
2024-07-21 02:55:52.7784427 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_48)
2024-07-21 02:55:52.7786130 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_43)
2024-07-21 02:55:52.7787635 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_120)
2024-07-21 02:55:52.7804733 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_121)
2024-07-21 02:55:52.7813203 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_122)
2024-07-21 02:55:52.7818930 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_34)
2024-07-21 02:55:52.7824726 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_34)
2024-07-21 02:55:52.7832496 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_35)
2024-07-21 02:55:52.7834794 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_35)
2024-07-21 02:55:52.7837190 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_36)
2024-07-21 02:55:52.7839107 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_36)
2024-07-21 02:55:52.7845327 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_37)
2024-07-21 02:55:52.7847478 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_37)
2024-07-21 02:55:52.7856158 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_51)
2024-07-21 02:55:52.7859694 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_45)
2024-07-21 02:55:52.7861134 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_126)
2024-07-21 02:55:52.7862404 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_127)
2024-07-21 02:55:52.7863722 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_128)
2024-07-21 02:55:52.7869522 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_38)
2024-07-21 02:55:52.7870830 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_38)
2024-07-21 02:55:52.7872069 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_39)
2024-07-21 02:55:52.7879889 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_39)
2024-07-21 02:55:52.7883969 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_40)
2024-07-21 02:55:52.7889512 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_40)
2024-07-21 02:55:52.7893891 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_41)
2024-07-21 02:55:52.7928572 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_41)
2024-07-21 02:55:52.7930590 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_54)
2024-07-21 02:55:52.7933644 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_47)
2024-07-21 02:55:52.7939206 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_137)
2024-07-21 02:55:52.7941213 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_6)
2024-07-21 02:55:52.7966013 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_138)
2024-07-21 02:55:52.7967176 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_139)
2024-07-21 02:55:52.7968073 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_119)
2024-07-21 02:55:52.7969265 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_140)
2024-07-21 02:55:52.7970217 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_42)
2024-07-21 02:55:52.7987606 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_42)
2024-07-21 02:55:52.7989855 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_43)
2024-07-21 02:55:52.7991200 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_43)
2024-07-21 02:55:52.7993187 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_44)
2024-07-21 02:55:52.7996159 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_44)
2024-07-21 02:55:52.7998190 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_59)
2024-07-21 02:55:52.8007914 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_49)
2024-07-21 02:55:52.8011616 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_141)
2024-07-21 02:55:52.8014479 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Neg (/Neg_7)
2024-07-21 02:55:52.8016911 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_142)
2024-07-21 02:55:52.8020266 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_143)
2024-07-21 02:55:52.8022256 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_124)
2024-07-21 02:55:52.8024694 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_144)
2024-07-21 02:55:52.8029481 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_45)
2024-07-21 02:55:52.8032213 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_45)
2024-07-21 02:55:52.8035771 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_46)
2024-07-21 02:55:52.8040963 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_46)
2024-07-21 02:55:52.8044238 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_47)
2024-07-21 02:55:52.8047404 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_47)
2024-07-21 02:55:52.8050152 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_62)
2024-07-21 02:55:52.8051785 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_51)
2024-07-21 02:55:52.8054858 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_145)
2024-07-21 02:55:52.8056243 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_146)
2024-07-21 02:55:52.8057503 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_6)
2024-07-21 02:55:52.8058629 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_75)
2024-07-21 02:55:52.8061675 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_6)
2024-07-21 02:55:52.8063205 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Unsqueeze (/Unsqueeze_135)
2024-07-21 02:55:52.8065088 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_65)
2024-07-21 02:55:52.8066972 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_55)
2024-07-21 02:55:52.8069250 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_152)
2024-07-21 02:55:52.8070861 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Div (/Div_7)
2024-07-21 02:55:52.8072084 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Cast (/Cast_80)
2024-07-21 02:55:52.8073324 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Pow (/Pow_7)
2024-07-21 02:55:52.8074513 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_66)
2024-07-21 02:55:52.8075726 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_59)
2024-07-21 02:55:52.8077445 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_162)
2024-07-21 02:55:52.8078788 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_163)
2024-07-21 02:55:52.8080088 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_164)
2024-07-21 02:55:52.8081818 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_48)
2024-07-21 02:55:52.8083263 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_48)
2024-07-21 02:55:52.8085387 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_49)
2024-07-21 02:55:52.8086847 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_49)
2024-07-21 02:55:52.8088981 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_50)
2024-07-21 02:55:52.8090828 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_50)
2024-07-21 02:55:52.8092638 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_51)
2024-07-21 02:55:52.8094313 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_51)
2024-07-21 02:55:52.8095917 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_69)
2024-07-21 02:55:52.8097472 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_61)
2024-07-21 02:55:52.8099185 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_168)
2024-07-21 02:55:52.8100619 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_169)
2024-07-21 02:55:52.8102281 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (/Gather_170)
2024-07-21 02:55:52.8104014 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_52)
2024-07-21 02:55:52.8105747 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_52)
2024-07-21 02:55:52.8107372 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_53)
2024-07-21 02:55:52.8109818 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_53)
2024-07-21 02:55:52.8111876 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_54)
2024-07-21 02:55:52.8113348 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_54)
2024-07-21 02:55:52.8114555 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Equal (/Equal_55)
2024-07-21 02:55:52.8115809 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Where (/Where_55)
2024-07-21 02:55:52.8116991 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Slice (/Slice_72)
2024-07-21 02:55:52.8119801 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Concat (/Concat_63)
2024-07-21 02:55:52.8122882 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather)
2024-07-21 02:55:52.8126408 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_1)
2024-07-21 02:55:52.8134166 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_3)
2024-07-21 02:55:52.8142054 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_5)
2024-07-21 02:55:52.8151948 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_7)
2024-07-21 02:55:52.8158508 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_9)
2024-07-21 02:55:52.8162298 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_11)
2024-07-21 02:55:52.8167726 [V:onnxruntime:, session_state.cc:1124 onnxruntime::VerifyEachNodeIsAssignedToAnEp]   Gather (Gather_token_13)
2024-07-21 02:55:52.8170325 [W:onnxruntime:, session_state.cc:1136 onnxruntime::VerifyEachNodeIsAssignedToAnEp] Some nodes were not assigned to the preferred execution providers which may or may not have an negative impact on performance. e.g. ORT explicitly assigns shape related 
ops to CPU to improve perf.
2024-07-21 02:55:52.8284845 [V:onnxruntime:, session_state.cc:133 onnxruntime::SessionState::CreateGraphInfo] SaveMLValueNameIndexMapping
2024-07-21 02:55:52.8315493 [V:onnxruntime:, session_state.cc:179 onnxruntime::SessionState::CreateGraphInfo] Done saving OrtValue mappings.
2024-07-21 02:55:52.8318920 [I:onnxruntime:, allocation_planner.cc:2413 onnxruntime::IGraphPartitioner::CreateGraphPartitioner] Use DeviceBasedPartition as default
2024-07-21 02:55:52.8866604 [I:onnxruntime:, session_state_utils.cc:199 onnxruntime::session_state_utils::SaveInitializedTensors] Saving initialized tensors.
2024-07-21 02:55:53.7135272 [I:onnxruntime:, session_state_utils.cc:342 onnxruntime::session_state_utils::SaveInitializedTensors] Done saving initialized tensors
2024-07-21 02:55:53.7185779 [I:onnxruntime:, inference_session.cc:1521 onnxruntime::InferenceSession::Initialize] Session successfully initialized.
2024-07-21 02:55:53.8321715 [I:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteThePlan] Number of streams: 2
2024-07-21 02:55:53.8326700 [I:onnxruntime:, sequential_executor.cc:181 onnxruntime::SessionScope::SessionScope] Begin execution
2024-07-21 02:55:53.8349969 [I:onnxruntime:, sequential_executor.cc:498 onnxruntime::ExecuteKernel] stream 0 launch kernel with idx 0
2024-07-21 02:55:53.8363689 [E:onnxruntime:, sequential_executor.cc:494 onnxruntime::ExecuteKernel] Non-zero status code returned while running Gelu node. Name:'Gelu' Status Message: 
D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2340)\onnxruntime.dll!00007FFD1ADFE70A: (caller: 00007FFD1ADFDC5B) Exception(3) tid(c0c) 80070057 The parameter is incorrect.


C:\Users\User\Documents\code\sherpa-onnx3\sherpa-onnx/csrc/offline-recognizer-whisper-impl.h:DecodeStream:174 

Caught exception:

Non-zero status code returned while running Gelu node. Name:'Gelu' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2340)\onnxruntime.dll!00007FFD1ADFE70A: (caller: 00007FFD1ADFDC5B) Exception(3) tid(c0c) 80070057 The 
parameter is incorrect.



Return an empty result. Number of input frames: 198, Current tail paddings: 1000. If you see a lot of such exceptions, please consider using a larger --whisper-tail-paddings
Decoded text:

Maybe related:
microsoft/onnxruntime#20742

@csukuangfj
Copy link
Collaborator

After unpacking the nuget package, I get

-rw-r--r-- 1 root root  12M Feb 25  2023 runtimes/win-arm64/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-arm64/native/onnxruntime.lib
-rw-r--r-- 1 root root 8.9M Feb 25  2023 runtimes/win-arm/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-arm/native/onnxruntime.lib
-rw-r--r-- 1 root root  11M Feb 25  2023 runtimes/win-x64/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-x64/native/onnxruntime.lib
-rw-r--r-- 1 root root 9.6M Feb 25  2023 runtimes/win-x86/native/onnxruntime.dll
-rw-r--r-- 1 root root 3.2K Feb 25  2023 runtimes/win-x86/native/onnxruntime.lib

So the nuget package contains the shared library of onnxruntime.

The only issue in the bindings is that I had to copy the onnxruntime.dll file into the executable folder from build/_deps/onnxruntime-src/native/x64

After fixing the code review comment, I think you should fix this problem.

Please have a look at this comment.

You can refer to how we support windows x64 GPU with CUDA.

The directML package provides only shared libraries.

@thewh1teagle
Copy link
Contributor Author

thewh1teagle commented Jul 21, 2024 •
edited
Loading

Please have a look at this comment.

You can refer to how we support windows x64 GPU with CUDA.

The directML package provides only shared libraries.

Added new commits. let me know if something is missing.
Anyway I get the same error with whisper example.

Update:
Added commit that fixed the issue. The issue was that onnxruntime.dll used the older system DirectML.dll file. I added new one in Cmake. Now it works with DirectML with tiny whisper model.
But with medium model I get the error:

error.log 
PS C:\Users\User\Documents\code\sherpa-onnx> .\build\bin\Release\offline-stt-c-api.exe
C:\Users\User\Documents\code\sherpa-onnx\sherpa-onnx\c-api\c-api.cc:convertConfig:427 OfflineRecognizerConfig(feat_config=FeatureExtractorConfig(sampling_rate=16000, feature_dim=512, low_freq=20, high_freq=-400, dither=0), model_config=OfflineModelConfig(transducer=OfflineTransducerModelConfig(encoder_filename="", decoder_filename="", joiner_filename=""), paraformer=OfflineParaformerModelConfig(model=""), nemo_ctc=OfflineNemoEncDecCtcModelConfig(model=""), whisper=OfflineWhisperModelConfig(encoder="sherpa-onnx-whisper-medium/medium-encoder.onnx", decoder="sherpa-onnx-whisper-medium/medium-decoder.onnx", language="en", task="transcribe", tail_paddings=-1), tdnn=OfflineTdnnModelConfig(model=""), zipformer_ctc=OfflineZipformerCtcModelConfig(model=""), wenet_ctc=OfflineWenetCtcModelConfig(model=""), sense_voice=OfflineSenseVoiceModelConfig(model="", language="", use_itn=False), telespeech_ctc="", tokens="sherpa-onnx-whisper-medium/medium-tokens.txt", num_threads=1, debug=True, provider="directml", model_type="", modeling_unit="cjkchar", bpe_vocab=""), lm_config=OfflineLMConfig(model="", scale=1), ctc_fst_decoder_config=OfflineCtcFstDecoderConfig(graph="", max_active=3000), decoding_method="greedy_search", max_active_paths=4, hotwords_file="", hotwords_score=1.5, blank_penalty=0, rule_fsts="", rule_fars="")
C:\Users\User\Documents\code\sherpa-onnx\sherpa-onnx\csrc\offline-whisper-model.cc:InitEncoder:243 ---encoder---
n_audio_head=16
sot_prev=50361
blank_id=220
n_text_layer=24
version=1
model_type=whisper-medium
maintainer=k2-fsa
sot_lm=50360
n_mels=80
no_timestamps=50363
all_language_tokens=50272,50341,50314,50335,50313,50317,50264,50326,50324,50337,50320,50318,50352,50355,50350,50263,50348,50275,50342,50349,50279,50331,50268,50287,50303,50340,50325,50297,50299,50293,50319,50329,50315,50280,50300,50298,50306,50276,50286,50277,50281,50336,50292,50328,50288,50302,50310,50269,50312,50270,50333,50338,50262,50285,50354,50307,50284,50323,50346,50301,50321,50339,50334,50265,50309,50291,50266,50294,50267,50271,50308,50260,50305,50353,50289,50356,50282,50304,50332,50283,50274,50311,50357,50296,50259,50290,50278,50343,50322,50261,50351,50347,50327,50345,50330,50273,50295,50344,50316
n_audio_layer=24
n_audio_state=1024
n_audio_ctx=1500
n_vocab=51865
n_text_ctx=448
n_text_state=1024
n_text_head=16
sot_sequence=50258,50259,50359
all_language_codes=ar,tk,mn,yi,ne,sq,ko,so,sn,uz,mr,sw,haw,ba,as,ru,tl,id,nn,mg,he,tg,tr,ta,sr,ps,yo,cy,te,lt,gl,ka,bs,uk,fa,sk,kn,hi,hu,fi,el,lo,bg,oc,no,bn,eu,pl,hy,ca,gu,fo,es,da,ha,et,ro,km,my,lv,pa,ht,am,fr,br,hr,ja,la,pt,nl,mk,zh,sl,ln,th,jw,ms,az,sd,cs,it,is,su,ml,en,ur,vi,mt,si,de,tt,bo,af,lb,be,sv,mi,sa,kk
sot=50258
sot_index=0
eot=50257
is_multilingual=1
no_speech=50362
non_speech_tokens=1,2,7,8,9,10,14,25,26,27,28,29,31,58,59,60,61,62,63,90,91,92,93,359,503,522,542,873,893,902,918,922,931,1350,1853,1982,2460,2627,3246,3253,3268,3536,3846,3961,4183,4667,6585,6647,7273,9061,9383,10428,10929,11938,12033,12331,12562,13793,14157,14635,15265,15618,16553,16604,18362,18956,20075,21675,22520,26130,26161,26435,28279,29464,31650,32302,32470,36865,42863,47425,49870,50254
transcribe=50359
translate=50358


2024-07-22 00:04:32.5505644 [E:onnxruntime:, sequential_executor.cc:494 onnxruntime::ExecuteKernel] Non-zero status code returned while running MemcpyToHost node. Name:'Memcpy_token_244' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2429)\onnxruntime.dll!00007FFFD424E1D6: (caller: 00007FFFD4775FC7) Exception(3) tid(22fc) 887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.

C:\Users\User\Documents\code\sherpa-onnx\sherpa-onnx/csrc/offline-recognizer-whisper-impl.h:DecodeStream:176 

Caught exception:

Non-zero status code returned while running MemcpyToHost node. Name:'Memcpy_token_244' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2429)\onnxruntime.dll!00007FFFD424E1D6: (caller: 00007FFFD4775FC7) Exception(3) tid(22fc) 887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.


Return an empty result. Number of input frames: 2000, Current tail paddings: 1000. If you see a lot of such exceptions, please consider using a larger --whisper-tail-paddings
Decoded text:

@csukuangfj
Copy link
Collaborator

Please have a look at this comment.
You can refer to how we support windows x64 GPU with CUDA.
The directML package provides only shared libraries.

Added new commits. let me know if something is missing. Anyway I get the same error with whisper example.

Update: Added commit that fixed the issue. The issue was that onnxruntime.dll used the older system DirectML.dll file. I added new one in Cmake. Now it works with DirectML with tiny whisper model. But with medium model I get the error:

error.log

PS C:\Users\User\Documents\code\sherpa-onnx> .\build\bin\Release\offline-stt-c-api.exe
C:\Users\User\Documents\code\sherpa-onnx\sherpa-onnx\c-api\c-api.cc:convertConfig:427 OfflineRecognizerConfig(feat_config=FeatureExtractorConfig(sampling_rate=16000, feature_dim=512, low_freq=20, high_freq=-400, dither=0), model_config=OfflineModelConfig(transducer=OfflineTransducerModelConfig(encoder_filename="", decoder_filename="", joiner_filename=""), paraformer=OfflineParaformerModelConfig(model=""), nemo_ctc=OfflineNemoEncDecCtcModelConfig(model=""), whisper=OfflineWhisperModelConfig(encoder="sherpa-onnx-whisper-medium/medium-encoder.onnx", decoder="sherpa-onnx-whisper-medium/medium-decoder.onnx", language="en", task="transcribe", tail_paddings=-1), tdnn=OfflineTdnnModelConfig(model=""), zipformer_ctc=OfflineZipformerCtcModelConfig(model=""), wenet_ctc=OfflineWenetCtcModelConfig(model=""), sense_voice=OfflineSenseVoiceModelConfig(model="", language="", use_itn=False), telespeech_ctc="", tokens="sherpa-onnx-whisper-medium/medium-tokens.txt", num_threads=1, debug=True, provider="directml", model_type="", modeling_unit="cjkchar", bpe_vocab=""), lm_config=OfflineLMConfig(model="", scale=1), ctc_fst_decoder_config=OfflineCtcFstDecoderConfig(graph="", max_active=3000), decoding_method="greedy_search", max_active_paths=4, hotwords_file="", hotwords_score=1.5, blank_penalty=0, rule_fsts="", rule_fars="")
C:\Users\User\Documents\code\sherpa-onnx\sherpa-onnx\csrc\offline-whisper-model.cc:InitEncoder:243 ---encoder---
n_audio_head=16
sot_prev=50361
blank_id=220
n_text_layer=24
version=1
model_type=whisper-medium
maintainer=k2-fsa
sot_lm=50360
n_mels=80
no_timestamps=50363
all_language_tokens=50272,50341,50314,50335,50313,50317,50264,50326,50324,50337,50320,50318,50352,50355,50350,50263,50348,50275,50342,50349,50279,50331,50268,50287,50303,50340,50325,50297,50299,50293,50319,50329,50315,50280,50300,50298,50306,50276,50286,50277,50281,50336,50292,50328,50288,50302,50310,50269,50312,50270,50333,50338,50262,50285,50354,50307,50284,50323,50346,50301,50321,50339,50334,50265,50309,50291,50266,50294,50267,50271,50308,50260,50305,50353,50289,50356,50282,50304,50332,50283,50274,50311,50357,50296,50259,50290,50278,50343,50322,50261,50351,50347,50327,50345,50330,50273,50295,50344,50316
n_audio_layer=24
n_audio_state=1024
n_audio_ctx=1500
n_vocab=51865
n_text_ctx=448
n_text_state=1024
n_text_head=16
sot_sequence=50258,50259,50359
all_language_codes=ar,tk,mn,yi,ne,sq,ko,so,sn,uz,mr,sw,haw,ba,as,ru,tl,id,nn,mg,he,tg,tr,ta,sr,ps,yo,cy,te,lt,gl,ka,bs,uk,fa,sk,kn,hi,hu,fi,el,lo,bg,oc,no,bn,eu,pl,hy,ca,gu,fo,es,da,ha,et,ro,km,my,lv,pa,ht,am,fr,br,hr,ja,la,pt,nl,mk,zh,sl,ln,th,jw,ms,az,sd,cs,it,is,su,ml,en,ur,vi,mt,si,de,tt,bo,af,lb,be,sv,mi,sa,kk
sot=50258
sot_index=0
eot=50257
is_multilingual=1
no_speech=50362
non_speech_tokens=1,2,7,8,9,10,14,25,26,27,28,29,31,58,59,60,61,62,63,90,91,92,93,359,503,522,542,873,893,902,918,922,931,1350,1853,1982,2460,2627,3246,3253,3268,3536,3846,3961,4183,4667,6585,6647,7273,9061,9383,10428,10929,11938,12033,12331,12562,13793,14157,14635,15265,15618,16553,16604,18362,18956,20075,21675,22520,26130,26161,26435,28279,29464,31650,32302,32470,36865,42863,47425,49870,50254
transcribe=50359
translate=50358


2024-07-22 00:04:32.5505644 [E:onnxruntime:, sequential_executor.cc:494 onnxruntime::ExecuteKernel] Non-zero status code returned while running MemcpyToHost node. Name:'Memcpy_token_244' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2429)\onnxruntime.dll!00007FFFD424E1D6: (caller: 00007FFFD4775FC7) Exception(3) tid(22fc) 887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.

C:\Users\User\Documents\code\sherpa-onnx\sherpa-onnx/csrc/offline-recognizer-whisper-impl.h:DecodeStream:176 

Caught exception:

Non-zero status code returned while running MemcpyToHost node. Name:'Memcpy_token_244' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2429)\onnxruntime.dll!00007FFFD424E1D6: (caller: 00007FFFD4775FC7) Exception(3) tid(22fc) 887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.


Return an empty result. Number of input frames: 2000, Current tail paddings: 1000. If you see a lot of such exceptions, please consider using a larger --whisper-tail-paddings
Decoded text:

I will try to merge
#1037
and add C++ code for it.

csukuangfj
csukuangfj approved these changes Jul 22, 2024
View reviewed changes
Copy link
Collaborator

@csukuangfj csukuangfj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your contribution!

@csukuangfj csukuangfj merged commit d32a461 into k2-fsa:master Jul 22, 2024
182 of 191 checks passed
@csukuangfj csukuangfj mentioned this pull request Jul 22, 2024
Closed
@thewh1teagle
Copy link
Contributor Author

I will try to merge
#1037
and add C++ code for it.

I don't think it's related to that.
It works with tiny model. see #1240

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@csukuangfj csukuangfj csukuangfj approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@thewh1teagle @csukuangfj