Skip to content

feat: Phase 2 & 3 - CoreML acceleration and NLP support#1

Merged
rlaope merged 3 commits intomasterfrom
feature/phase2-coreml
Jan 31, 2026
Merged

feat: Phase 2 & 3 - CoreML acceleration and NLP support#1
rlaope merged 3 commits intomasterfrom
feature/phase2-coreml

Conversation

@rlaope
Copy link
Owner

@rlaope rlaope commented Jan 31, 2026

Summary

  • Implement CoreML/Neural Engine acceleration (ort 2.0 API)
  • Add NLP feature: embed command for text embeddings
  • Add documentation: ARCHITECTURE.md, TUTORIAL.md, API.md

Changes

Phase 2: CoreML Acceleration

  • coreml.rs: Complete rewrite with ort 2.0 API
  • Add ComputeUnits enum (All, CpuAndNeuralEngine, CpuAndGpu, CpuOnly)
  • bench.rs: Add neural-engine provider option

Phase 3: NLP Support

  • Add embed CLI command
  • Add run_multiple() method for multi-input models
  • Text tokenization and embedding generation

Documentation

  • docs/ARCHITECTURE.md: Internal architecture explanation
  • docs/TUTORIAL.md: Step-by-step tutorials
  • docs/API.md: Complete API reference
  • README.md: Updated with new features

Test plan

  • cargo build --release --features coreml,nlp
  • Test airml embed command
  • CoreML benchmark comparison

🤖 Generated with Claude Code

@rlaope rlaope merged commit c60ca83 into master Jan 31, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant