Skip to content

modelAssetPath method of loading in LlmInference.createFromOptions results in inefficient loading and crashes #6160

@RandomGamingDev

Description

@RandomGamingDev

MediaPipe Solution (you are using)

@mediapipe/tasks-genai v0.10.25

Programming language

Javascript/Typescript

Are you willing to contribute it

Yes

Describe the feature and the current behaviour/state

Loading with

Will this change the current API? How?

No.

Who will benefit with this feature?

Anyone who wants to load a model since it benefits performance, latency, the number of models loaded, etc.

Please specify the use cases for this feature

Better loading models.

Any Other info

Relevant PR from mediapipe-samples

Metadata

Metadata

Assignees

Labels

stat:awaiting responseWaiting for user responsetask:LLM inferenceIssues related to MediaPipe LLM Inference Gen AI setuptype:featureEnhancement in the New Functionality or Request for a New Solution

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions