Skip to content

Gemma3 images support? #2

@IgorAherne

Description

@IgorAherne

Hello, thank you for the work!

Will the images be supported for Gemma 3?

llm = Llama(
    model_path=self.llm_path,
    #clip_model_path=self.mmproj_path, #I have the path to the multimodal projector, but there is no argument for it :(
    n_gpu_layers=self.config.n_gpu_layers,
    n_ctx=self.config.n_ctx,
    logits_all=False, # llama.cpp default is true, but often set to false for chat
    verbose=False,     # For llama.cpp verbose logging
    flash_attn=self.config.use_flash_atten
)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions