两个报错日志，麻烦帮看下

[Gu23333]

service 版本是在官网下的最新的qairt，服务是通过genie-t2t-run的源码自己写的，运行里面自带的qnn-platform-validator和genie-t2t-run的日志报错，目前genie-t2t-run跑不起来

err2.log

Using libGenie.so version 1.17.0

Genie:      0.0ms [  INFO ] Genie Logger created with level : 4

Genie:      0.2ms [VERBOSE] dialog-new: dialog0 config {"context":{"bos-token":151644,"eos-token":151645,"eot-token":151643,"n-vocab":131072,"size":4096},"engine":{"backend-ext-conf":"/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/htp_backend_ext_config.json","backend-lib":"libQnnHtp.so","cpumask":"0xe0","kv-dim":128,"mmap-budget":0,"model-list":["/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_1_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_2_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_3_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_4_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_5_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-eli

Genie:      0.2ms [VERBOSE] ctx-new: dialog0 config {"bos-token":151644,"eos-token":151645,"eot-token":151643,"n-vocab":131072,"size":4096}

Genie:      0.3ms [VERBOSE] sampler-new: basic ctx dialog0 config {"role":"primary","seed":42,"temp":0.1,"top-k":40,"top-p":0.95,"type":"basic"}

Genie:      0.3ms [VERBOSE] engine-new: qnn-htp ctx dialog0 config {"backend-ext-conf":"/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/htp_backend_ext_config.json","backend-lib":"libQnnHtp.so","cpumask":"0xe0","kv-dim":128,"mmap-budget":0,"model-list":["/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_1_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_2_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_3_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_4_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_5_of_6.bin","/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_6_of_6.bin"],"n-threads":3,"poll":false,"pos-id-dim":64,"role":"prim

Genie:      0.3ms [VERBOSE] qnn-htp: init start

Genie:      0.3ms [VERBOSE] Cache groups parameters = [{"attention-mask-tensor-name":"","cache-index-tensor-name":"","longcontext":{"type":"disabled"},"prefix":"past_"}]

Genie:      0.4ms [  INFO ] qnn-htp: loading model

Genie:      1.3ms [WARNING] kv-update-method is deprecated. Defaulting to SMART_MASK or NATIVE_KV

Genie:      1.3ms [VERBOSE] nsp-model: starting threadpool : n_threads 3 params. 0xe0 poll false

Genie:      1.4ms [VERBOSE] qnn-htp: model init start

Genie:      1.4ms [  INFO ] Backend library : libQnnHtp.so

Genie:      1.4ms [  INFO ] System library  : libQnnSystem.so

Genie:      1.4ms [  INFO ] Model dir   : 

Genie:      1.4ms [  INFO ] Model files : ["/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_1_of_6.bin", "/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_2_of_6.bin", "/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_3_of_6.bin", "/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_4_of_6.bin", "/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_5_of_6.bin", "/home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/qwen2_5_7b_instruct_part_6_of_6.bin"]

Genie:      1.4ms [  INFO ] Backend extensions lib path : libQnnHtpNetRunExtensions.so

Genie:      1.5ms [  INFO ] Backend extensions config path : /home/qcom/AIGC/qwen2_5_7b_instruct-genie-w8a16-qualcomm-snapdragon-x-elite/htp_backend_ext_config.json

Genie:      1.5ms [  INFO ] DLC path : 

Genie:      1.8ms [  INFO ] qnn-api initialized with 12 graph(s)

Genie:      1.8ms [VERBOSE] Detected CacheGroup parameters = [{"attention-mask-tensor-name":"attention_mask","cache-index-tensor-name":"","longcontext":{"type":"disabled"},"prefix":"past_"}]

Genie:      1.9ms [VERBOSE] Could not find cache index tensor for CacheGroup past_

Genie:      1.9ms [VERBOSE] qnn-htp: Graph prompt_ar128_cl4096_1_of_6

Genie:      1.9ms [VERBOSE] Couldn't determine context length from tensors. Attempting to parse context length from graph name.

Genie:      1.9ms [VERBOSE] found input tensor input_ids

Genie:      1.9ms [  INFO ] graphName prompt_ar128_cl4096_1_of_6 and its variant Type LUT

Genie:      1.9ms [VERBOSE] qnn-htp: Graph token_ar1_cl4096_1_of_6

Genie:      1.9ms [VERBOSE] Couldn't determine context length from tensors. Attempting to parse context length from graph name.

Genie:      1.9ms [VERBOSE] found input tensor input_ids

Genie:      1.9ms [  INFO ] graphName token_ar1_cl4096_1_of_6 and its variant Type LUT

Genie:      1.9ms [VERBOSE] qnn-htp: Graph prompt_ar128_cl4096_2_of_6

Genie:      1.9ms [  INFO ] graphName prompt_ar128_cl4096_2_of_6 and its variant Type DECODER

Genie:      2.0ms [VERBOSE] qnn-htp: Graph token_ar1_cl4096_2_of_6

Genie:      2.0ms [  INFO ] graphName token_ar1_cl4096_2_of_6 and its variant Type DECODER

Genie:      2.0ms [VERBOSE] qnn-htp: Graph prompt_ar128_cl4096_3_of_6

Genie:      2.0ms [  INFO ] graphName prompt_ar128_cl4096_3_of_6 and its variant Type DECODER

Genie:      2.0ms [VERBOSE] qnn-htp: Graph token_ar1_cl4096_3_of_6

Genie:      2.0ms [  INFO ] graphName token_ar1_cl4096_3_of_6 and its variant Type DECODER

Genie:      2.0ms [VERBOSE] qnn-htp: Graph prompt_ar128_cl4096_4_of_6

Genie:      2.0ms [  INFO ] graphName prompt_ar128_cl4096_4_of_6 and its variant Type DECODER

Genie:      2.0ms [VERBOSE] qnn-htp: Graph token_ar1_cl4096_4_of_6

Genie:      2.0ms [  INFO ] graphName token_ar1_cl4096_4_of_6 and its variant Type DECODER

Genie:      2.1ms [VERBOSE] qnn-htp: Graph prompt_ar128_cl4096_5_of_6

Genie:      2.1ms [  INFO ] graphName prompt_ar128_cl4096_5_of_6 and its variant Type DECODER

Genie:      2.1ms [VERBOSE] qnn-htp: Graph token_ar1_cl4096_5_of_6

Genie:      2.1ms [  INFO ] graphName token_ar1_cl4096_5_of_6 and its variant Type DECODER

Genie:      2.1ms [VERBOSE] qnn-htp: Graph prompt_ar128_cl4096_6_of_6

Genie:      2.1ms [  INFO ] graphName prompt_ar128_cl4096_6_of_6 and its variant Type DEFAULT

Genie:      2.1ms [VERBOSE] qnn-htp: Graph token_ar1_cl4096_6_of_6

Genie:      2.1ms [  INFO ] graphName token_ar1_cl4096_6_of_6 and its variant Type DEFAULT

Genie:      2.1ms [  INFO ] Inserting graph token_ar1_cl4096_1_of_6 as idx 0 for AR-1 CL-4096

Genie:      2.1ms [  INFO ] Inserting graph token_ar1_cl4096_2_of_6 as idx 1 for AR-1 CL-4096

Genie:      2.1ms [  INFO ] Inserting graph token_ar1_cl4096_3_of_6 as idx 2 for AR-1 CL-4096

Genie:      2.1ms [  INFO ] Inserting graph token_ar1_cl4096_4_of_6 as idx 3 for AR-1 CL-4096

Genie:      2.1ms [  INFO ] Inserting graph token_ar1_cl4096_5_of_6 as idx 4 for AR-1 CL-4096

Genie:      2.1ms [  INFO ] Inserting graph token_ar1_cl4096_6_of_6 as idx 5 for AR-1 CL-4096

Genie:      2.2ms [  INFO ] Inserting graph prompt_ar128_cl4096_1_of_6 as idx 0 for AR-128 CL-4096

Genie:      2.2ms [  INFO ] Inserting graph prompt_ar128_cl4096_2_of_6 as idx 1 for AR-128 CL-4096

Genie:      2.2ms [  INFO ] Inserting graph prompt_ar128_cl4096_3_of_6 as idx 2 for AR-128 CL-4096

Genie:      2.2ms [  INFO ] Inserting graph prompt_ar128_cl4096_4_of_6 as idx 3 for AR-128 CL-4096

Genie:      2.2ms [  INFO ] Inserting graph prompt_ar128_cl4096_5_of_6 as idx 4 for AR-128 CL-4096

Genie:      2.2ms [  INFO ] Inserting graph prompt_ar128_cl4096_6_of_6 as idx 5 for AR-128 CL-4096

Genie:      2.2ms [  INFO ] qnn-htp: Graphs loaded ((AR-n, CL-x): #splits): {(1, 4096): 6, (128, 4096): 6}

Genie:      2.2ms [VERBOSE] Mapping for Cachegroup past_

Genie:      2.2ms [VERBOSE] Found AR-1 CL-4096 -> AR-1 CL-4096

Genie:      2.2ms [VERBOSE] Found AR-128 CL-4096 -> AR-128 CL-4096

Genie:      2.4ms [  INFO ]  <I> QnnLog_create started.

Genie:      2.6ms [VERBOSE]  <V> Registered a new graph environment 0 with priority: 100, num hvx threads: 1001, num hmx threads: 1001

Genie:      2.6ms [WARNING]  <W> Initializing HtpProvider

Genie:      2.6ms [VERBOSE]  <V> Creating default router

Genie:      2.6ms [VERBOSE]  <V> RouterFastRPC create

Genie:      2.7ms [VERBOSE]  <V> HTP: Initializing the router

Genie:      2.7ms [VERBOSE]  <V> Detected Snapdragon SOC SC8380XP with 4 SOCs

Genie:      2.7ms [VERBOSE]  <V> Allocating PlatformInfo struct size 120

Genie:      2.7ms [VERBOSE]  <V> Async property not supported. Skipping setup async threads

Genie:      2.7ms [VERBOSE]  <V> Detected Snapdragon SOC SC8380XP with 4 SOCs

Genie:      2.7ms [VERBOSE]  <V> Allocating PlatformInfo struct size 120

Genie:      2.7ms [VERBOSE]  <V> HTP: Initializing the graph registry

Genie:      2.7ms [VERBOSE]  <V> HTP: Initializing the context registry

Genie:      2.7ms [VERBOSE]  <V> HTP: Initializing the device registry

Genie:      2.7ms [VERBOSE]  <V> HTP: Initializing the tensor counter

Genie:      2.7ms [VERBOSE]  <V> HTP: setting isExitCalled to false

Genie:      2.7ms [VERBOSE]  <V> HTP: setting ssrInProgress to false

Genie:      2.7ms [VERBOSE]  <V> HTP: FinalCleanupFn fnPtr is nullptr

Genie:      2.7ms [VERBOSE]  <V> HTP: initializing mem registry

Genie:      2.7ms [VERBOSE]  <V> HTP: initializing mmap registry

Genie:      2.8ms [VERBOSE]  <V> HTP: Initializing the logger lifecycle manager

Genie:      2.8ms [VERBOSE]  <V> HTP: constructing bundle

Genie:      2.8ms [VERBOSE]  <V> Set default graph environment 0 remoteHandle 0

Genie:      2.8ms [VERBOSE]  <V> Opened default graph env, envRemoteHandle 0

Genie:      2.8ms [  INFO ]  <I> exit with 0

Genie:      2.8ms [  INFO ]  <I> exit with 0

Genie:      2.8ms [VERBOSE]  <V> HTP: initialization completed successfully

Genie:      2.8ms [  INFO ]  <I> QnnLog_create exit.

Genie:      0.2ms [  INFO ] Key: soc_id, Value: 60

Genie:      0.3ms [  INFO ] Key: dsp_arch, Value: 73

Genie:      0.3ms [  INFO ] Key: perf profile, Value: burst 

Genie:      0.3ms [  INFO ] Key: perf_profile, Value: 5

Genie:      0.3ms [  INFO ] Key: rpc_control_latency, Value: 100

Genie:      3.2ms [  INFO ]  <I> QnnBackend_create started. backend = 0xdb3d2960

Genie:      3.3ms [VERBOSE]  <V> Oem key validation infra not found, limiting oemMaxPriority to HIGHEST

Genie:      3.3ms [VERBOSE]  <V> Backend handle created: 1

Genie:      3.3ms [VERBOSE]  <V> Set default graph environment 0 remoteHandle 0

Genie:      3.3ms [VERBOSE]  <V> Opened default graph env, envRemoteHandle 0

Genie:      3.3ms [  INFO ]  <I> QnnBackend_create done successfully. backend = 0xdb3d2960

Genie:      3.3ms [VERBOSE]  <V> Deactivated logger with handle 0x1

Genie:      0.3ms [  INFO ] No core Ids specified by user, setting default single core execution

Genie:      3.3ms [  INFO ]  <I> QnnDevice_create started

Genie:      3.3ms [VERBOSE]  <V> Create device with id 0x1

Genie:      3.3ms [VERBOSE]  <V> Validating device config 0xaaaadb452270

Genie:      3.3ms [VERBOSE]  <V> Setting device config 0xaaaadb452270 via router

Genie:      3.3ms [WARNING]  <W> Specified config ARCH, ignoring on real target

Genie:      3.3ms [VERBOSE]  <V> Validating device config 0xaaaadb452280

Genie:      3.3ms [VERBOSE]  <V> Setting device config 0xaaaadb452280 via router

Genie:      3.3ms [WARNING]  <W> Specified config SOC, ignoring on real target

Genie:      3.3ms [VERBOSE]  <V> Setting default value for unsigned PD usage

Genie:      3.3ms [VERBOSE]  <V> Setting default value for unsigned PD usage

Genie:      4.0ms [VERBOSE]  <V> Attempting to open dynamically linked so: /home/qcom/AIGC/qairt/lib/aarch64-oe-linux-gcc11.2/libQnnHtpV73Stub.so using absolute filename

Genie:      4.0ms [  INFO ]  <I> First connection to QNN stub established!

Genie:      4.0ms [VERBOSE]  <V> Loading remote funcs

Genie:      4.0ms [VERBOSE]  <V> Successfully loaded off-chip memory allocation functions

Genie:      4.2ms [VERBOSE]  <V> Getting effective domain ID of domain name cdsp

Genie:      4.2ms [VERBOSE]  <V> Effective cdsp_id is: 3, Session_id is: 0 for original Device Id: 0, DeviceId: 0, CoreId: 0, pdId: 0

Genie:      4.2ms [VERBOSE]  <V> Factory created transport for normal PD

Genie:     10.1ms [ ERROR ]  <E> IDspTransport: Unknown rpc status 0x00000180

Genie:     10.1ms [ ERROR ]  <E> DspTransport.openSession qnn_open failed, 0x80000580, prio 100

Genie:     10.1ms [ ERROR ]  <E> IDspTransport: Unknown rpc status 0x00000180

Genie:     10.1ms [ ERROR ]  <E> DspTransport.getHandle failed, error 0xffffffff

Genie:     10.1ms [ ERROR ]  <E> createDspTransportInstance failed to config transport object

Genie:     10.1ms [ ERROR ]  <E> error in creation of transport instance

Genie:     10.1ms [WARNING]  <W> Failed to create transport instance: 1002

Genie:     10.1ms [ ERROR ]  <E> Failed to create transport for device, error: 1002

Genie:     10.1ms [ ERROR ]  <E> Failed to load skel, error: 1002

Genie:     10.1ms [VERBOSE]  <V> exits device initialization with  14001

Genie:     10.1ms [ ERROR ]  <E> Transport layer setup failed: 14001

Genie:     10.1ms [VERBOSE]  <V> SSR not encountered

Genie:     10.1ms [ ERROR ]  <E> Failed to parse platform info: 14001

Genie:     10.1ms [ ERROR ]  <E> Failed to parse platform config: 14001

Genie:     10.1ms [  INFO ]  <I> QnnDevice_create done. status 0x36b1

Genie:     10.1ms [VERBOSE]  <V> Deactivated logger with handle 0x1

[ERROR] "Failed to create device: 14001"
[ERROR] "Device Creation failure"

Genie:     10.2ms [ ERROR ] qnn-api initialization failed!

Genie:     10.5ms [VERBOSE] qnn-htp: model destruct complete: 245 usec

Genie:     10.5ms [VERBOSE] qnn-htp: del-NSP-graph

Genie:     10.5ms [VERBOSE] qnn-htp: del-NSP-graph

Genie:     10.5ms [VERBOSE] qnn-htp: del-NSP-graph

Genie:     10.5ms [VERBOSE] qnn-htp: del-NSP-graph

Genie:     10.5ms [VERBOSE] qnn-htp: del-NSP-graph

Genie:     10.5ms [VERBOSE] qnn-htp: del-NSP-graph

Genie:     10.6ms [  INFO ]  <I> QnnBackend_free started. backend = 0x1

Genie:     10.6ms [VERBOSE]  <V> Terminated backend 0x1 successfully in backendLifecycleManager

Genie:     10.6ms [VERBOSE]  <V> Unset default graph environment 0

Genie:     10.6ms [VERBOSE]  <V> Destroyed default graph env

Genie:     10.6ms [VERBOSE]  <V> RouterFastRPC tryUnLoadPrepare

Failure to initialize model. 
Failed to create the dialog.

 

 

[极市平台]

下载 2.42 的试一下，最新的可能不稳定