-
Notifications
You must be signed in to change notification settings - Fork 2
Open
Description
Hello, thank you for the work!
Will the images be supported for Gemma 3?
llm = Llama(
model_path=self.llm_path,
#clip_model_path=self.mmproj_path, #I have the path to the multimodal projector, but there is no argument for it :(
n_gpu_layers=self.config.n_gpu_layers,
n_ctx=self.config.n_ctx,
logits_all=False, # llama.cpp default is true, but often set to false for chat
verbose=False, # For llama.cpp verbose logging
flash_attn=self.config.use_flash_atten
)
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels