Unsupported model type: glm4_moe_lite

[vernonstinebaker]

Problem statement

GLM-4.7-Flash is the hot new kid in town. It would be great if support could be added for this model. It's already MLX compatible and already available in LM Studio and mlx-lm.

Proposed solution

No response

Alternatives considered

No response

Additional context

No response

[tpae]

This is coming soon: ml-explore/mlx-swift-lm#68

[zlatent]

This is coming soon: ml-explore/mlx-swift-lm#68

this PR ml-explore/mlx-swift-lm#68 has been merged.

[vernonstinebaker]

Different error than before, but still seeing an error: Error: The operation couldn’t be completed. (Jinja.JinjaError error 2.)

[tpae]

Yeah, it's related to swift-jinja. I opened another issue here: huggingface/swift-jinja#44

[tpae]

I opened a PR here: huggingface/swift-jinja#45

[mattt]

@tpae Thank you for reporting and providing a PR. I just released 2.2.2 with that fix.

[tpae]

There's few tool call related issues i'm tracking here: ml-explore/mlx-swift-lm#78

[vernonstinebaker]

Still seeing this:

Error: The operation couldn’t be completed. (Jinja.JinjaError error 2.)

[mattt]

@vernonstinebaker Can you please share more information about the error you're seeing? "Jinja.JinjaError error 2" corresponds to a runtime error, which could indicate ensure_ascii (huggingface/swift-jinja#45) wasn't fully resolved, or a new issue entirely. It'd be helpful to get the localizedDescription of the underlying error.

[vernonstinebaker]

@vernonstinebaker Can you please share more information about the error you're seeing? "Jinja.JinjaError error 2" corresponds to a runtime error, which could indicate ensure_ascii (huggingface/swift-jinja#45) wasn't fully resolved, or a new issue entirely. It'd be helpful to get the localizedDescription of the underlying error.

I would be happy to provide anything I can. Where can I find the "localizedDescription"?

I tried to capture some stuff from the console, but I'm not sure if it's useful. If not and you can point me to how I can be more helpful, I'll gratefully provide whatever I can.

default 19:20:23.102188+0800 runningboardd Acquiring assertion targeting [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] from originator [osservice<com.apple.coreservices.launchservicesd>:423] with description <RBSAssertionDescriptor| "frontmost:45713" ID:459-423-393250 target:45713 attributes:[
<RBSDomainAttribute| domain:"com.apple.launchservicesd" name:"RoleUserInteractiveFocal" sourceEnvironment:"(null)">
]>
default 19:20:23.102488+0800 runningboardd Assertion 459-423-393250 (target:[app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713]) will be created as active
default 19:20:23.104101+0800 WindowServer 0[PostFilteredEventTapData]: [DeferringManager] Updating policy {
advicePolicy: .frontmost;
frontmostProcess: 0x0-0x168a689 (Osaurus) mainConnectionID: 176B13;
} for reason: updated frontmost process
default 19:20:23.103842+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring jetsam update because this process is not memory-managed
default 19:20:23.104183+0800 WindowServer 0[PostFilteredEventTapData]: [DeferringManager] Deferring events from frontmost process PSN 0x0-0x168a689 (Osaurus) -> <pid: 45713>
default 19:20:23.103858+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring suspend because this process is not lifecycle managed
default 19:20:23.104274+0800 WindowServer new deferring rules for pid:454: [
[454-3066]; <keyboardFocus; Osaurus:0x0-0x168a689>; () -> <pid: 45713>; reason: frontmost PSN --> outbound target,
[454-3065]; <keyboardFocus; >; () -> <token: Osaurus:0x0-0x168a689; pid: 454>; reason: frontmost PSN,
[454-3064]; ; () -> <token: ; pid: 454>; reason: Deferring to
]
default 19:20:23.104006+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Set darwin role to: UserInteractiveFocal
default 19:20:23.104307+0800 WindowServer [keyboardFocus 0xb64ce64e0] setRules:forPID(454): [
[454-3066]; <keyboardFocus; Osaurus:0x0-0x168a689>; () -> <pid: 45713>; reason: frontmost PSN --> outbound target,
[454-3065]; <keyboardFocus; >; () -> <token: Osaurus:0x0-0x168a689; pid: 454>; reason: frontmost PSN,
[454-3064]; ; () -> <token: ; pid: 454>; reason: Deferring to
]
default 19:20:23.104048+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring GPU update because this process is not GPU managed
default 19:20:23.104247+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring memory limit update because this process is not memory-managed
default 19:20:23.106079+0800 osaurus NSPasteboard (name: Apple CFPasteboard find): data requested for type NSStringPboardType at index 0
default 19:20:23.107152+0800 WindowServer chain did update (setDeferringRules) <keyboardFocus; display: null> containsEndOfChain: YES; [
<token: ; pid: 454>,
<token: Osaurus:0x0-0x168a689; pid: 454>,
<pid: 45713>,
<token: viewbridge-key-window; pid: 45713>
]
default 19:20:23.109541+0800 runningboardd Acquiring assertion targeting [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] from originator [osservice<com.apple.WindowServer(88)>:454] with description <RBSAssertionDescriptor| "FUSBFrontmostProcess" ID:459-454-393251 target:45713 attributes:[
<RBSDomainAttribute| domain:"com.apple.fuseboard" name:"Frontmost" sourceEnvironment:"(null)">,
<RBSAcquisitionCompletionAttribute| policy:AfterApplication>
]>
default 19:20:23.109699+0800 runningboardd Assertion 459-454-393251 (target:[app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713]) will be created as active
default 19:20:23.118700+0800 osaurus [0x9ea058140] activating connection: mach=false listener=false peer=false name=com.apple.TextInputUI.xpc.CursorUIViewService
default 19:20:23.118962+0800 osaurus [0x9ea058140] invalidated after the last release of the connection object
default 19:20:23.123065+0800 runningboardd Calculated state for app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>: running-active (role: UserInteractiveFocal) (endowments: )
default 19:20:23.123433+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring jetsam update because this process is not memory-managed
default 19:20:23.123466+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring suspend because this process is not lifecycle managed
default 19:20:23.123502+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring GPU update because this process is not GPU managed
default 19:20:23.123563+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring memory limit update because this process is not memory-managed
default 19:20:23.123846+0800 runningboardd Acquiring assertion targeting [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] from originator [osservice<com.apple.coreservices.launchservicesd>:423] with description <RBSAssertionDescriptor| "notification:45713" ID:459-423-393252 target:45713 attributes:[
<RBSDomainAttribute| domain:"com.apple.launchservicesd" name:"LSNotification" sourceEnvironment:"(null)">
]>
default 19:20:23.123769+0800 ControlCenter Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:23.123920+0800 runningboardd Assertion 459-423-393252 (target:[app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713]) will be created as active
default 19:20:23.125755+0800 gamepolicyd Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:23.127506+0800 runningboardd Calculated state for app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>: running-active (role: UserInteractiveFocal) (endowments: )
default 19:20:23.128180+0800 ControlCenter Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:23.128552+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring jetsam update because this process is not memory-managed
default 19:20:23.128565+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring suspend because this process is not lifecycle managed
default 19:20:23.128575+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring GPU update because this process is not GPU managed
default 19:20:23.128627+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring memory limit update because this process is not memory-managed
default 19:20:23.129810+0800 gamepolicyd Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:23.131457+0800 osaurus channel: signal: sessionID: timestamp: payload:
default 19:20:23.132754+0800 runningboardd Calculated state for app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>: running-active (role: UserInteractiveFocal) (endowments: )
default 19:20:23.133280+0800 ControlCenter Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:23.133382+0800 gamepolicyd Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:23.137670+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app
default 19:20:23.138055+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app/Contents
default 19:20:23.138130+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app/Contents/Info.plist
default 19:20:23.139003+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app
default 19:20:23.139926+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app/Contents/MacOS/osaurus
default 19:20:23.140194+0800 kernel 1 duplicate report for Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app/Contents/MacOS/osaurus
default 19:20:23.140201+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-xattr /Applications/Osaurus.app/Contents/MacOS/osaurus
default 19:20:23.156546+0800 osaurus Item () is attached but is too large to fit without clipping. minWidth=72.000000
default 19:20:23.157640+0800 osaurus Item () is attached but is too large to fit without clipping. minWidth=72.000000
default 19:20:23.160130+0800 osaurus [0x9ea05a940] activating connection: mach=false listener=false peer=false name=(anonymous)
default 19:20:23.160167+0800 osaurus [0x9ea05a580] activating connection: mach=false listener=false peer=false name=(anonymous)
default 19:20:23.168603+0800 kernel Sandbox: ContextStoreAgent(32618) allow file-read-data /Applications/Osaurus.app/Contents/Info.plist
default 19:20:23.178493+0800 osaurus -[TUINSCursorUIController activate:]_block_invoke: Create CursorUIViewService: TUINSRemoteViewController
default 19:20:23.178729+0800 osaurus [0x9ea058500] invalidated because the current process cancelled the connection by calling xpc_connection_cancel()
default 19:20:23.178738+0800 osaurus [0x9ea058640] invalidated because the current process cancelled the connection by calling xpc_connection_cancel()
default 19:20:23.179883+0800 WindowServer chain did update (setDeferringRules) <keyboardFocus; display: null> containsEndOfChain: YES; [
<token: ; pid: 454>,
<token: Osaurus:0x0-0x168a689; pid: 454>,
<pid: 45713>,
<token: viewbridge-key-window; pid: 45713>
]
default 19:20:23.180617+0800 WindowServer chain did update (setDeferringRules) <keyboardFocus; display: null> containsEndOfChain: YES; [
<token: ; pid: 454>,
<token: Osaurus:0x0-0x168a689; pid: 454>,
<pid: 45713>,
<token: viewbridge-key-window; pid: 45713>
]
default 19:20:26.567373+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:26.572669+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:26.657006+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:26.659826+0800 osaurus channel: signal: sessionID: timestamp: payload:
default 19:20:26.663290+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:26.715420+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:26.721966+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:26.865432+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:26.871751+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:26.923494+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:26.930191+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.075139+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.080418+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.165498+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.171845+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.280550+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.289680+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.421138+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.422844+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.481219+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.482541+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.690236+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.697798+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.823514+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.830149+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:27.974205+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:27.980318+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:28.108351+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:28.114197+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:28.825490+0800 runningboardd Assertion did invalidate due to timeout: 459-423-393252 (target:[app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713])
default 19:20:29.030874+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring jetsam update because this process is not memory-managed
default 19:20:29.030905+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring suspend because this process is not lifecycle managed
default 19:20:29.030925+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring GPU update because this process is not GPU managed
default 19:20:29.030950+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring memory limit update because this process is not memory-managed
default 19:20:29.037029+0800 runningboardd Calculated state for app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>: running-active (role: UserInteractiveFocal) (endowments: )
default 19:20:29.038088+0800 ControlCenter Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:29.038538+0800 gamepolicyd Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:29.133816+0800 WindowServer destinations for Keyboard event: (<keyboardFocus; osaurus.45713; token: viewbridge-key-window>)
default 19:20:29.146347+0800 osaurus -[TUINSCursorUIController scheduleUpdateCursorLocation]
default 19:20:29.176599+0800 osaurus [com.apple.controlcenter:C84A7FD6-9667-4CB9-9DE2-77AB78C23075-Aux[1]-NSStatusItemView] Sending action(s) in update: NSSceneFenceAction
default 19:20:29.182138+0800 osaurus [com.apple.controlcenter:C84A7FD6-9667-4CB9-9DE2-77AB78C23075] Sending action(s) in update: NSSceneFenceAction
default 19:20:29.223237+0800 osaurus [com.apple.controlcenter:C84A7FD6-9667-4CB9-9DE2-77AB78C23075-Aux[1]-NSStatusItemView] Sending action(s) in update: NSSceneFenceAction
default 19:20:29.228166+0800 osaurus [com.apple.controlcenter:C84A7FD6-9667-4CB9-9DE2-77AB78C23075] Sending action(s) in update: NSSceneFenceAction
default 19:20:32.493376+0800 osaurus Could not fetch group for change type 1 with identifier , making it a delete change type.
default 19:20:32.554280+0800 osaurus Rebroadcasting external notification ABDatabaseChangedExternallyNotification from process (null) ()
default 19:20:33.395235+0800 osaurus Could not fetch group for change type 1 with identifier , making it a delete change type.
default 19:20:33.455071+0800 osaurus Rebroadcasting external notification ABDatabaseChangedExternallyNotification from process (null) ()
default 19:20:34.273055+0800 runningboardd Invalidating assertion 459-423-393250 (target:[app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713]) from originator [osservice<com.apple.coreservices.launchservicesd>:423]
default 19:20:34.286879+0800 osaurus channel: signal: sessionID: timestamp: payload:
default 19:20:34.287911+0800 osaurus channel: signal: sessionID: timestamp: payload:
default 19:20:34.288301+0800 osaurus channel: signal: sessionID: timestamp: payload:
default 19:20:34.290083+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring jetsam update because this process is not memory-managed
default 19:20:34.290158+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring suspend because this process is not lifecycle managed
default 19:20:34.290204+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring GPU update because this process is not GPU managed
default 19:20:34.290321+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring memory limit update because this process is not memory-managed
default 19:20:34.296761+0800 runningboardd Calculated state for app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>: running-active (role: UserInteractiveFocal) (endowments: )
default 19:20:34.297303+0800 ControlCenter Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:34.297369+0800 gamepolicyd Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:34.301492+0800 runningboardd Invalidating assertion 459-454-393251 (target:[app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713]) from originator [osservice<com.apple.WindowServer(88)>:454]
default 19:20:34.408844+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring jetsam update because this process is not memory-managed
default 19:20:34.408857+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring suspend because this process is not lifecycle managed
default 19:20:34.408900+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Set darwin role to: UserInteractiveNonFocal
default 19:20:34.408911+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring GPU update because this process is not GPU managed
default 19:20:34.408989+0800 runningboardd [app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>:45713] Ignoring memory limit update because this process is not memory-managed
default 19:20:34.413242+0800 runningboardd Calculated state for app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>: running-active (role: UserInteractiveNonFocal) (endowments: )
default 19:20:34.413697+0800 ControlCenter Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible
default 19:20:34.414042+0800 gamepolicyd Received state update for 45713 (app<application.com.dinoki.osaurus.1148586639.1158509086.AB84CD6C-781A-40B6-B77B-6EB215F37752(501)>, running-active-NotVisible

[mattt]

@vernonstinebaker Hey thanks, I appreciate your willingness to help!

I don't see anything in these console logs. The most direct way to get that information would be to build and run Osaurus in Xcode, set a breakpoint at the code for handling that error.

...but looking at where I think that happens, it looks like we're already doing that?

https://github.com/dinoki-ai/osaurus/blob/4f2bbd32345faf2156654df6438eb4fbc0236b14/Packages/OsaurusCore/Views/ChatView.swift#L1245-L1247

Thoughts, @tpae?

[tpae]

@vernonstinebaker Hey thanks, I appreciate your willingness to help!

I don't see anything in these console logs. The most direct way to get that information would be to build and run Osaurus in Xcode, set a breakpoint at the code for handling that error.

...but looking at where I think that happens, it looks like we're already doing that?

osaurus/Packages/OsaurusCore/Views/ChatView.swift

Lines 1245 to 1247 in 4f2bbd3

} catch {
assistantTurn.content = "Error: (error.localizedDescription)"
}
Thoughts, @tpae?

Yeah it's strange it's not returning better error messages, when running locally, it does show detailed localizedDescription. I'll take a stab at this today and see what the issue is

[vernonstinebaker]

Anything else I can do to help troubleshoot?

I upgrade every day (brew update/brew upgrade) and I'm still seeing the same problem today.

[tpae]

Sorry I ran out of disk space to download the model, but recently I uninstalled a bunch of stuff so I'm able to test it now.

GLM4.7-Flash is still TBD, this is the error I'm seeing:

Error: Key model.layers.0.self_attn.kv_b_proj.weight not found in GLM4MoELiteModel.GLM4MoELiteModelInner.GLM4MoELiteDecoderLayer.GLM4MoELiteAttention.Linear

GLM4.7 weights have been updated about 2 weeks ago, and the while MLX community patched the repos, there were critical issues from mlx-swift-lm that's preventing it from merging the fix.

ml-explore/mlx-swift-lm#73 cc @ronaldmannak

This was already 2 weeks ago, hopefully there's an update soon.