Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MLX #33

Open
fakerybakery opened this issue Feb 20, 2024 · 3 comments
Open

MLX #33

fakerybakery opened this issue Feb 20, 2024 · 3 comments
Labels
enhancement Improves existing code needs model updates Requires associated model change

Comments

@fakerybakery
Copy link

Hey,
Apple just dropped MLX-Swift, a cross-platform (currently only iOS/macOS) MLX framework. Are there any plans to support it?
Thanks!
@atiorh
Copy link
Contributor

atiorh commented Feb 20, 2024

Stay tuned for an announcement soon :)

@ZachNagengast
Copy link
Contributor

Worth noting here that MLX doesn't yet support ANE, but there are a number of tasks in WhisperKit that it is a great fit for 🚀

@ZachNagengast ZachNagengast added enhancement Improves existing code needs model updates Requires associated model change labels Feb 20, 2024
@vade
Copy link

vade commented Feb 21, 2024

Now that MLX supports Swift, in theory, custom CoreML layers could be implemented in MLX - and assuming one can configure the MLX layers to operate on float 16 and have an IOSurface backed memory storage (which, I believe, unless I am under a misapprehension MLX Supports and MLX Swift should as well?) you could have zero copy from buffers computed in ANE <-> MLX Layers <-> ANE

Which would be super cool

@ZachNagengast ZachNagengast mentioned this issue Mar 6, 2024
Closed
@atiorh atiorh mentioned this issue Apr 11, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Improves existing code needs model updates Requires associated model change
Projects
WhisperKit
Status: No status
Milestone
No milestone
Development

No branches or pull requests
4 participants
@vade @ZachNagengast @atiorh @fakerybakery