Apple’s Harbor App Turns a Mac Into a Private AI Server

The Harbor app from Apple subsidiary Claris turns a Mac into a private AI inference server that runs open-weight models on Apple silicon. Two or more Macs with Thunderbolt 5 can pool their unified memory, so a cluster can load models that are too big for a single Mac. Apple Foundation Models framework Aaron Perris posted Harbor’s App Store description on X, and Apple has since taken the listing down. The app is in private preview under Claris, the brand that also makes FileMaker, and it has no announced price or release date.

The Harbor App Pools Mac Memory

Harbor detects your Macs over Thunderbolt 5 and forms the cluster on its own, with no manual setup and no command line. You connect two or more Thunderbolt 5 Macs, and Harbor pools their unified memory into one inference resource. You can then run models larger than any single Mac can hold, or serve more concurrent requests across the cluster. The amount of unified memory in your Mac sets how large a model you can load, and even the Mac Studio with M5 Ultra tops out at 512GB. Harbor’s cluster view shows a MacBook Pro with M5 Max linked to two M4 Pro Mac minis, with the two Mac minis linked to each other. Clustering Macs already works without Harbor, because the Mac Studio supports Thunderbolt 5 and RDMA clustering. The manual route means cabling the Macs in a mesh, where every Mac connects to every other, or in a ring, where each Mac connects to two neighbors. After the cabling, you turn on RDMA in System Settings, restart, and generate a configuration with the mlx.distributed_config command-line tool. Harbor aims to replace those steps with plugging the Macs in and pressing start.

Harbor Runs Models Locally

Harbor runs open-weight models on Apple silicon, so your data stays on your Mac and nothing goes to the cloud. You can find and download models inside the app, and Harbor handles loading and managing them. Harbor’s server panel has a copy button for an API endpoint and a Switch Model button for the loaded model. Its hardware section shows Thunderbolt and RDMA settings. Harbor joins local AI options that already run on the Mac. Perplexity Computer now runs fully on the device for Pro, Max and Enterprise subscribers, and Meta says its Muse Spark Open model runs locally on two M5 Ultra Mac Studios.
Newsletter
Never miss an Apple story
One email a day, the news that matters. No spam, unsubscribe anytime.
About the Author

Imran Hussain is the founder and editor of iThinkDifferent, which he launched in 2008 to cover Apple news, reviews, and how-to guides. He has spent over 15 years writing about iOS, macOS, and the wider Apple ecosystem, with a focus on hands-on guides - installing developer betas, troubleshooting, and walking through new features on his own devices. Based in Dubai, he also loves to cover photography, gaming, and the tech industry more broadly on his social media profiles.

Leave a Reply