6,956
社区成员
发帖
与我相关
我的任务
分享使用qwen2.5vl3b
GenieAPIService_v2.1.3_QAIRT_v2.42.0_v73
请求的openai API请求格式,不兼容 json列表:
使用qwen-agent这样就会报错!!!
[W] ---------------------------------------------------
Time: 2026-01-31 21:21:02.556
Path: /v1/chat/completions
[W] model: qwen2.5vl3b has already been loaded
[E] raise the exception: user content is not a object
the request body: {"messages":[{"role":"user","content":[{"type":"text","text":"请描述这张图片"},{"type":"image_url","image_url":{"url":"data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wBDAAgGBgcGBQgHBwcJCQgKDBQNDAsLDBkSEw8UHRofHh0aHBwgJC4nICIsIxwcKDcpLDAxNDQ0Hyc5PTgyPC4zNDL/2wBDAQkJCQwLDBgNDRgyIRwhMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjL/wAARCAI+BAADASIAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREAAgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYkNOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwDssUuKWkrjNAxRS4oxQAlFLiigYUUUUAJS0YpcUgEopcUYoCwlFLRQMKKWjFIBKKcBRigBKKWigYlFOoxQFhtLS4oxQMSilxRikAlLS4oxQMTFGKWikAlLiilxQMTFFLS4oCw3FLS4pcUrjsNxRilpcUh2EoxS4pcUAJijFOopDG4oxTsUuKLgNxRinYoxSuMTFLSO38KYDix3fMeD070jOFOAB7ZoJyAF6479PyqMyBgBjkce1OxNyTJznkj2o3tjaMH69qjXcwG047cnNOY7RtyScZzQA5SRyO3vTyrc7ufc1Csjjkn5T2pByxUE/jRYLkrHeQCM/pTCP7pHWlR9o3HmkLNgk4x+tAj//Z"}}]}],"model":"qwen2.5vl3b","seed":101287174,"stream":true}
[W] /v1/chat/completions handling is done

正确的响应是这样:
[W] ---------------------------------------------------
Time: 2026-01-31 21:19:46.575
Path: /v1/chat/completions
[W] model: qwen2.5vl3b has already been loaded
[W] ~~~~~~~~~~~~~~Query Context Start~~~~~~~~~~~~~~~~~~
[W] start to initiate: genie/python/models/qwen2.5vl3b/veg.serialized.bin ....
qnn-htp-engine does not support usesCrossAttentio
这张图片显示了一个天空的场景,天空被橙色和黄色的色调所覆盖。天空中有一些云彩,它们的形状和大小各不相同。整体的氛围给人一种温暖和宁静的感觉。
[W] ~~~~~~~~~~~~~~~Query Context End~~~~~~~~~~~~~~~~~~~
[W] ~~~~~~~~~~~~~~Token Summary Start~~~~~~~~~~~~~~~~~~
[W] Time to First Token: 198.33 ms
[W] Token Generation Time: 2196.63 ms
[W] Num Prompt Tokens: 221, Text Length: 744635
[W] Prompt Processing Rate: 1114.83 toks/sec
[W] Num Generated Tokens: 44, Text Length: 210
[W] Token Generation Rate: 20.03 toks/sec
[W] ~~~~~~~~~~~~~~~Token Summary End~~~~~~~~~~~~~~~~~~~
[W] /v1/chat/completions handling is done
请查看链接最后的python调用
https://www.aidevhome.com/?id=55