Apple is back in the server business
Does anyone else out there remember Xserve?Discontinued in 2010, this was an Apple server that saw adoption as asupercomputer cluster, and found another use within movie industry workflows as a RAID system. Fans might be interested to know that anXserve cluster at Virginia Techranked No. 7 on the Top 500 list of supercomputers in 2004, topping out at 12.25 teraflops of performance. (That, incidentally, is about the performance of an iPhone 12, or an M1-based Mac.)Holding it wrongApple discontinued the Xserve with a famously terse Steve Jobs email apparentlyclaiminghardly anyone was buying it.Today, with what is arguably the worlds most performant low-power computer chips rolling off production lines, the Apple Silicon opportunity means the company is returning to the server market; itstasking Foxconn with making M4-powered servers to run Apple Intelligence as that service gets rolled out globally over the coming year.Apple Intelligence servers are currently powered by the M2 Ultra chip, but Apple intends to upgrade these toM4 chips next year. It is alleged that the choice of Taiwan is deliberate, as the company hopes to gain some input from engineers who have worked on Nvidia servers, though as Apple Intelligence is an internal Apple project theres no conflict of interest in that proposal at least, not yet.After all, Apple is not competing in the server market simply by making servers for its own AI, though its M4 Ultra chip might even outperform Nvidias mighty RTX 4090 processor,reports claim. So perhaps theres a pathway there.Apple now makes serversApple uses these servers for Apple Intelligence functions that require more power than the Apple device used to request the task. When those tasks are uploaded to the cloud, they are given to Apples own super-private servers or (optionally) outsourced to OpenAI.To protect the flow of data, the companys Private Cloud Compute is a server-based Apple Intelligence rig that lets Mac, iPhone, and iPad users exploit Apples own AI in the cloud. Whats important about the service is that it maintains the high privacy and security we already expect from Apple. That means Apple wont get to see or keep your data and will not know what youve requested. Private Cloud Compute allows Apple Intelligence to process complex user requests with groundbreaking privacy,said Craig Federighi, Apples senior vice president of software engineering.The idea is that you can use these LLM tools with peace of mind the kind any rational person will require when handling their own information. Iveargued beforethat this is what every cloud-based AI serviceshould strive to deliver, though I dont think they will; too many business models are based around capturing, exploiting, and even selling information about their users. Thats why some companiesban staff from using AI.Perhaps it could sell or rent these servers?The one thing Apple Intelligence has that perhaps isnt being fully explained is that Apple alsooffers developers APIsso they can weave the generative AI technology into their products. Right now, that means introducing Apple Intelligence features within them, but given the importance of AI to developers, and the desire among some of them to make smart tools that can be used privately for specific use cases, at what point might Apple offer Private Cloud Compute as a service to provide trusted computing? Perhaps that is why it is putting the systemthrough such rigorous security review?There has to be an opportunity. There will be some companies who want to make their own AI solutions, but demand the kind of hardcore security Private Cloud Compute provides. Given that Apple has tasked Foxconn with making servers to support that service, at what point will provision of the servers, along with the bare bones, highly secure, software they run, become a business opportunity? Theres a business case, and given Apple is already leading the industry in just how willing it is to open these boxes up for security review, it feels like a potential direction if theres any money in it.And there clearly is quite a lot, in fact.As everything becomes AI, wheres the money?Recognition of the value and need for AI servers is, in part, what has driven Nvidias market cap to intermittently overtake that of Apple this year. The need for servers to provide support for AI is a growth opportunity for all in the space except perhaps for Intel and AMD, who are watching as ARMs reference designsdefine expectationsfor processor performance.Whether it wants to be or not, Apple is in the server business, and now that it is, it makes sense for the company to generate more revenue from it. After all, who else promises the kind of rock-solid platform-focused security? Who else can provide such fast chips at such low energy requirements? The only snag in this particular ointment is that Apple Intelligence is not inherently cross-platform, though this hasnt really got in the way of the companys success for the last couple of decades.Please follow me onLinkedIn,Mastodon, or join me in theAppleHolics bar & grillgroup on MeWe.