Editor's Choice


From the editor's desk: A shift towards cost-effective AI infrastructure

28 February 2025 Editor's Choice


Peter Howells, Editor

Soon after US president Donald Trump; announced the Stargate Project offering financial support of $500 billion; towards AI research and development, the world of AI was hit by a bombshell with the announcement of DeepSeek AI model R1. It was designed and built in China by founder Liang&nbspWenfeng, who holds a degree in both Electronic Engineering and Computer Science and is also the current CEO of a hedge fund called High-Flyer. This hedge fund uses AI to analyse financial data to make investment decisions, a process called quantitative trading.

The main reason DeepSeek shook the AI community was by having development costs a fraction of the cost of AI LLMs developed in the USA, despite an import embargo on AI chips that the US imposed on China. AI stocks took a nose-dive after the announcement with company’s involved in AI hardware and software losing as much as 20% of their market value.

Wenfeng was able to perform this miraculous task by stockpiling a huge volume of older generation GPUs over the course of the year and using these to build his AI engine. DeepSeek R1; was released to the public to little fanfare - compared to existing online LLMs – as an opensource AI engine on 20&nbspJanuary&nbsp2025.

Despite being open to the public, many world leaders are sceptical of its intentions, with many countries, including USA and Australia, banning its use on government devices and systems, citing a national security risk.

Another bone of contention came from a well-known AI company, OpenAI, whose ChatGPT app fell to second place on the app store behind DeepSeek AI assistant within days of its release. CEO of OpenAI, Sam&nbspAltman, has accused DeepSeek of using OpenAI’s search results to generate its own responses. In the AI world this is known as ‘knowledge distillation’ or simply ‘distilling’ and is a technique where a large and complex AI model, known as a teacher, transfers its knowledge to a smaller, more efficient student learning model. This allows the student model to perform similar tasks to its bigger brother, while being faster and requiring less computational power [read energy].

Altman has said in a statement that “they believe that a Chinese startup called DeepSeek has used proprietary data from ChatGPT to train their own AI model”. He is essentially accusing them of intellectual property theft. I find the irony of this accusation quite humorous as ChatGPT was initially accused of using proprietary information on the web in its own training, a process that Altman has dismissed as being above board.

However this story may pan out, I believe that the introduction of DeepSeek R1; underscores an industry-wide shift towards more cost-effective AI infrastructure.


Credit(s)



Share this article:
Share via emailShare via LinkedInPrint this page

Further reading:

From the editor's desk: Is the current AI really what we want?
Technews Publishing Editor's Choice
The companies that develop LLMs need to change direction and concentrate on freeing up our time, not so that we can have more time to do the tasks we don’t want to do in the first place, but rather to allow us more time to do what we love.

Read more...
When it comes to long-term reliability of RF amplifier ICs, focus first on die junction temperature
Altron Arrow Editor's Choice Telecoms, Datacoms, Wireless, IoT
When considering the long-term reliability of integrated circuits, a common misconception is that high package or die thermal resistance is problematic. However, high or low thermal resistance, by itself, tells an incomplete story.

Read more...
ICs vs modules: Understanding the technical trade-offs for IoT applications
NuVision Electronics Editor's Choice DSP, Micros & Memory
As the IoT continues to transform industries, design decisions around wireless connectivity components become increasingly complex with engineers often facing the dilemma of choosing between ICs and wireless modules for their IoT applications.

Read more...
Why bis means business for LTE Cat 1 IoT connections
NuVision Electronics Editor's Choice Telecoms, Datacoms, Wireless, IoT
Tomaž Petaros, product manager IoT EMEA at Quectel Wireless Solutions explains why the market for Cat 1bis IoT connections is getting busy.

Read more...
Interview with Brian Aziz, vice president of global sales, Iridium
Editor's Choice
ridium is the leading satellite IoT player. Their network consists of 66 active low Earth orbit satellites covering every inch of the globe and are used for IoT and emergency services worldwide.

Read more...
From the editor's desk: Are we really being ripped off?
Technews Publishing News
To the surprise of many customers, installing solar panels does not always eliminate their utility bill – and in some cases, the power utility may impose additional charges on solar-powered homes.

Read more...
Accelerating AI adoption in MCU manufacturing
Editor's Choice AI & ML
To gain the value of ML functionality, designers of MCU-based devices have to adopt a new development method and accept a new type of probabilistic rather than deterministic output.

Read more...
Altron Arrow: Empowering innovation with STMicroelectronics AI processors
Altron Arrow Editor's Choice AI & ML
ST’s AI processors are not only smarter and faster, but also incredibly efficient, enabling a new wave of intelligent solutions across multiple industries.

Read more...
The superpower driving the future of low carbon electricity
Editor's Choice
Modularity is a superpower. The advantage lies in smaller units that can be built, tested, refined, adapted, improved repetitively, allowing many experimentation and learning iterations.

Read more...
Eskom’s evolution sparks hope
Editor's Choice
Eskom’s evolution has sparked hope that a large corporation can change and learn to think outside the grid.

Read more...