Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
AI Apple Hardware Technology

Apple Reportedly Developing Its Own Custom Silicon For AI Servers 30

Hartley Charlton reports via MacRumors: Apple is said to be developing its own AI server processor using TSMC's 3nm process, targeting mass production by the second half of 2025. According to a post by the Weibo user known as "Phone Chip Expert," Apple has ambitious plans to design its own artificial intelligence server processor. The user, who claims to have 25 years of experience in the integrated circuit industry, including work on Intel's Pentium processors, suggests this processor will be manufactured using TSMC's 3nm node.

Apple's purported move toward developing a specialist AI server processor is reflective of the company's ongoing strategy to vertically integrate its supply chain. By designing its own server chips, Apple can tailor hardware specifically to its software needs, potentially leading to more powerful and efficient technologies. Apple could use its own AI processors to enhance the performance of its data centers and future AI tools that rely on the cloud. While Apple is rumored to be prioritizing on-device processing for many of its upcoming AI tools, it is inevitable that some operations will have to occur in the cloud. By the time the custom processor could be integrated into operational servers in late 2025, Apple's new AI strategy should be well underway.

Apple Reportedly Developing Its Own Custom Silicon For AI Servers

Comments Filter:
  • by Valgrus Thunderaxe ( 8769977 ) on Wednesday April 24, 2024 @09:36PM (#64422952)
    They've tried this, twice. Why would I go with Apple for four times the price, vs. Supermicro?
    • by migos ( 10321981 )
      It's not for you. It's for internal use. You can cut down AI training cost by 2/3 if you have your own thing.
    • Not all products are intended for you.

    • You probably wouldn't unless you're already using Macs for whatever reason. Most of the people who have Apple "servers" are just buying a ton of cheap Mac Minis and putting them on the same network. For a lot of workloads it's apparently not all that bad and Apple's SoCs are already in the server-class in terms of power draw. It's just a matter of not getting the same raw core count, but you can buy a lot of cheap Mac Minis to string together if you're buying a $10,000 Xeon or Epyc processor.

      This is prob
      • by dfghjk ( 711126 )

        Mini's aren't used because they're a great choice, they're used because they're the only choice. Cloud provider have demand for Mac VMs, those need to run somehow. And those "lot of workloads" are Mac desktop workloads, what a surprise a Mac desktop is "not all that bad". You have incredible insights, but how is this relevant to Apple doing their own custom AI processor? Yeah, that AI processor is for a "render farm".

      • It's just a matter of not getting the same raw core count, but you can buy a lot of cheap Mac Minis to string together if you're buying a $10,000 Xeon or Epyc processor.

        If you're buying a $10,000 Epyc processor, you're presumably paying a heavy premium for being able to have a very large system image. It's something of a waste to buy those CPUs if your workload is embarrassingly parallel.

        Why not make a server product at that point.

        Why bother? You don't buy a mac for the bang per buck, you buy it because y

      • I kind of want to see some special grade, precision-milled aluminum server getting shoved into a rack where it will languish in the darkness for the next decade.

        Like this?

        https://www.apple.com/shop/buy... [apple.com]

      • For a lot of workloads it's apparently not all that bad and Apple's SoCs are already in the server-class in terms of power draw. It's just a matter of not getting the same raw core count, but you can buy a lot of cheap Mac Minis to string together if you're buying a $10,000 Xeon or Epyc processor.

        That's fine if you have an embarrassingly parallel problem which doesn't require a lot of data transfer between processors. There are jobs like that, of course, but those mac minis have pretty poor connectivity and having that many nodes means doing a lot of extra work to set up and maintain them. The EPYC processor (and to a lesser extent the Xeon) also offers very good price:performance. The minis come with a lot of extra case material that you have to pay for (including making it pretty) but don't really

      • by Anonymous Coward

        I kind of want to see some special grade, precision-milled aluminum server getting shoved into a rack where it will languish in the darkness for the next decade.

        Apple did that already. They were called X-Serves, and they were amazing 1U chassis, even if the internal hardware didn't match the cost. Then instead of RAID array capable, dual PSU servers, Apple decided we needed to buy shelves for the racks and stack a bunch of home-user computers. That's when we stopped spending over $90,000 per year on Apple.

    • by dfghjk ( 711126 )

      It's not being made to sell to you, it would be internal use. By all means, stay with Supermicro for your personal LLM needs.

    • It won't happen or won't last long, servers are too much of a long term commitment for Apple. Apple's pricing models don't make sense for businesses either. If Apple wanted a commitment they'd make MacOS compete with Windows and install on modern PCs and servers, even if only ARM platforms.
    • by Misagon ( 1135 )

      I'd think these are intended not for server Macs for sale but for Apple's own server farms. Probably for services available to Apple device users only.

  • by registrations_suck ( 1075251 ) on Wednesday April 24, 2024 @09:51PM (#64422974)

    The EU needs to investigate this, fine Apple and put a stop to it.

    • eh, why?

      That makes no sense.

      • Like that matters.

      • That was the joke alright, he doesn't think any of the action against Apple makes sense because he's in favor of anticompetitive behavior at the expense of customers for some sick reason, probably cognitive dissonance.

        • It very much had the feeling of "oh noe teh EW".

          he's in favor of anticompetitive behavior at the expense of customers for some sick reason, probably cognitive dissonance.

          I think some people fundamentally support this sort of thing because they believe that one day eith enough hard work, they'' get to be the ones raking in heaps cash by screwing over people like they are now.

          • I am pro consumer and pro choice.

            I think the EU's actions are anti-consumer.

            • Please please please write a screed explaining how forcing Apple to use stuff that users want them to use and support things users want them to support with absolutely zero harm to other users who simply don't turn on any additional features which will be disabled by default is bad for consumers. And don't cheat and use AI, really lean into it.

    • If it's for their own internal use, I doubt EU got anything to say about that.

      They can't force you to buy gear from someone else when you are perfectly capably of making gear which is super customised to your needs.

      And even if Apple decides to sell it to others, I doubt EU will get involved since there are so many companies which are selling "AI processors" - from Nvidia, AMD, Intel and a whole bunch more.

  • by backslashdot ( 95548 ) on Wednesday April 24, 2024 @11:49PM (#64423160)

    but a "Phone Chip Expert". .. doesn't reek of dying to be taken seriously?

  • by ledow ( 319597 )

    Apple - that famous server company.

"When it comes to humility, I'm the greatest." -- Bullwinkle Moose

Working...