Is a full-featured Mac sufficient for AI and ML development compared to NVIDIA GPU systems?
text
Is a full-featured Mac sufficient for AI and ML development compared to NVIDIA GPU systems?
new_line
new_line
Hello everyone,
text
Hello everyone,
new_line
We are about to make the decision to purchase a powerful Mac with maximum features for our university. This Mac will primarily serve as a development computer in the field of artificial intelligence (AI) and machine learning (ML) and will be used by a small group of users in the local network. After development, the systems will be transferred to servers that have to withstand higher loads and visitor numbers.
text
We are about to make the decision to purchase a powerful Mac with maximum features for our university. This Mac will primarily serve as a development computer in the field of artificial intelligence (AI) and machine learning (ML) and will be used by a small group of users in the local network. After development, the systems will be transferred to servers that have to withstand higher loads and visitor numbers.
new_line
new_line
Planned system:
text
Planned system:
new_line
Apple Mac Studio 2023 with M2 Ultra processor
text
Apple Mac Studio 2023 with M2 Ultra processor
new_line
24-core CPU
text
24-core CPU
new_line
76-core GPU
text
76-core GPU
new_line
32-core NPU (neural engine) for machine learning
text
32-core NPU (neural engine) for machine learning
new_line
128GB RAM
text
128GB RAM
new_line
1TB HDD
text
1TB HDD
new_line
new_line
Our question to you:
text
Our question to you:
new_line
Is a fully equipped Mac with the latest SoCs chips and integrated neural engines sufficient for the development of AI and ML systems?
text
Is a fully equipped Mac with the latest SoCs chips and integrated neural engines sufficient for the development of AI and ML systems?
new_line
Or should we rather rely on proven Windows/Linux systems with powerful NVIDIA graphics cards?
text
Or should we rather rely on proven Windows/Linux systems with powerful NVIDIA graphics cards?
new_line
new_line
We already have several NVIDIA graphics cards available at the university:
text
We already have several NVIDIA graphics cards available at the university:
new_line
NVIDIA Tesla T4
text
NVIDIA Tesla T4
new_line
NVIDIA 2080Ti
text
NVIDIA 2080Ti
new_line
NVIDIA 3080Ti
text
NVIDIA 3080Ti
new_line
new_line
We are particularly interested in your experiences and assessments of how the performance of the Mac compares to the GPU systems mentioned. 
text
We are particularly interested in your experiences and assessments of how the performance of the Mac compares to the GPU systems mentioned. 
new_line
new_line
Are there significant differences, especially in the development and training of models? 
text
Are there significant differences, especially in the development and training of models? 
new_line
new_line
What difference would you consider to be significant? 
text
What difference would you consider to be significant? 
new_line
new_line
For us, a difference of 100% or more would be considered significant.
text
For us, a difference of 100% or more would be considered significant.
new_line
In other words, computer A (Mac) takes twice as long to calculate as computer B (NVIDIA system).
text
In other words, computer A (Mac) takes twice as long to calculate as computer B (NVIDIA system).
new_line
new_line
Many thanks in advance for your answers and experience!
text
Many thanks in advance for your answers and experience!
new_line
Best regards,
text
Best regards,
new_line
 Oliver
text
 Oliver
Is a full-featured Mac sufficient for AI and ML development compared to NVIDIA GPU systems?

Hello everyone,
We are about to make the decision to purchase a powerful Mac with maximum features for our university. This Mac will primarily serve as a development computer in the field of artificial intelligence (AI) and machine learning (ML) and will be used by a small group of users in the local network. After development, the systems will be transferred to servers that have to withstand higher loads and visitor numbers.

Planned system:
Apple Mac Studio 2023 with M2 Ultra processor
24-core CPU
76-core GPU
32-core NPU (neural engine) for machine learning
128GB RAM
1TB HDD

Our question to you:
Is a fully equipped Mac with the latest SoCs chips and integrated neural engines sufficient for the development of AI and ML systems?
Or should we rather rely on proven Windows/Linux systems with powerful NVIDIA graphics cards?

We already have several NVIDIA graphics cards available at the university:
NVIDIA Tesla T4
NVIDIA 2080Ti
NVIDIA 3080Ti

We are particularly interested in your experiences and assessments of how the performance of the Mac compares to the GPU systems mentioned. 

Are there significant differences, especially in the development and training of models? 

What difference would you consider to be significant? 

For us, a difference of 100% or more would be considered significant.
In other words, computer A (Mac) takes twice as long to calculate as computer B (NVIDIA system).

Many thanks in advance for your answers and experience!
Best regards,
 Oliver
👀
zzlxv