Interconnection


Connectors for AI accelerators

31 July 2024 Interconnection

Developments of the last few years have thrust the subjects of artificial intelligence and machine learning into the limelight.

With the growth of online tools, consumers can now harness the power of AI for a range of tasks. High-performance interconnects provide the link between CPUs and AI accelerators and play a vital role in the scalability and flexibility that these systems demand.

Despite its recent place in the spotlight, AI has been with us for some time. AI powers the algorithms that navigate us through the world. It keeps traffic moving and recommends our next purchase, along with countless other tasks. In essence, these systems are crunching through enormous amount of data, making vast numbers of calculations, and analysing patterns to aid us in decision making.

Coping with larger models is at the heart of the AI revolution, and providing the computing power that is required is a challenge for designers. Fortunately, there is precedent in conventional computer design. The familiar desktop computer handles data-intensive tasks by handing off the processing required for specialist devices. The CPU is responsible for core tasks, but assigns graphics processing or sound emulation to secondary specialist modules. This has led to the structure that is familiar today – a graphics card and sound card, along with other specialist components, mounted to a CPU on a motherboard.

In the world of AI, accelerators perform a similar task. The CPU continues to provide the processing power for the overall system, whilst accelerators, often GPUs, are the specialist hardware, providing the dedicated computational power to crunch through the large models being used by the latest AI systems. The key difference between a conventional computer with its single accelerator or GPU is scalability.

Instead of a one-to-one relationship of CPU to accelerator card, it is possible to equip a single CPU with a potentially large number of accelerators. In such an arrangement, efficient computation depends on the transmission of data between cards with the lowest possible latency and the greatest possible signal integrity. The connections between the cards therefore play a vital role in allowing these computers to process the data they need to.

A range of Samtec connectors are playing an enormous role in delivering the connectivity required by AI systems. The range includes conventional board-to-board connector systems that support industry-standard form factors, including PCIe CEM AIC and PECFF. However, faster data rates can be supported over longer distances using ultra-low-skew twinax cable to bypass high-loss printed circuit boards. Samtec’s AcceleRate HP cable assembly is the industry’s highest density 112 Gbps PAM4-rated solution for cable-to-board applications.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

mBend cable assemblies
Conical Technologies Interconnection
The mBend cable assemblies from Anoison are designed to meet the growing demand for low-profile coaxial connections in applications where space is limited, and precise bending is necessary right next to the connectors.

Read more...
What’s the big deal with DPL?
Spectrum Concepts Enclosures, Racks, Cabinets & Panel Products
The dynamic performance layer (DPL) forms a key part of the construction of Nitrowave coaxial cables, Samtec’s range of high-performance RF solutions for microwave and mmWave applications.

Read more...
Configurable DIN rail housings
Wiltron Agencies Interconnection
With PTR HARTMANN’s INS265 design kit, DIN rail housings can be individually configured using a wide range of options.

Read more...
Coax achieves excellent performance
Spectrum Concepts Telecoms, Datacoms, Wireless, IoT
Samtec’s new coaxial cable achieves excellent performance while subject to dynamic flexing.

Read more...
Connectors for the latest server applications
Spectrum Concepts Interconnection
To deliver high-speed performance, many next-generation server applications will use cables inside the box instead of PCB traces to maintain the signal integrity demanded by high-speed communications.

Read more...
AI domain-specific architecture
Spectrum Concepts Enclosures, Racks, Cabinets & Panel Products
Designing a new product is often an exercise in priorities, carefully balancing a range of capabilities to obtain the best overall result.

Read more...
PCIe 7.0 technology. Too soon or not fast enough?
Spectrum Concepts Editor's Choice
Data scientists, AI system architects, IC designers, optical engineers, interconnect providers like Samtec, and other solutions providers, are rethinking system topologies.

Read more...
Industrial Ethernet with HARTING solutions
Interconnection
In today’s fast-paced industrial landscape, Ethernet connectivity plays a crucial role in automation, ensuring seamless communication between machines and systems, and HARTING offers a wide range of innovative Ethernet products.

Read more...
Steel wire cable tray systems
RS South Africa Interconnection
Legrand has developed a zinc aluminium finish surface treatment for its Cablofil steel wire cable tray system to minimise the threat of zinc whiskers forming.

Read more...
Versatile high-current contacts
Spectrum Concepts Interconnection
Mill-Max has announced the release of its number 36 contact, a unique contact designed to accept a wide range of lead sizes, while providing low insertion force and high current carrying capacity.

Read more...