<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:media="http://search.yahoo.com/mrss/"><channel><title>IEEE Spectrum</title><link>https://spectrum.ieee.org/</link><description>IEEE Spectrum</description><atom:link href="https://spectrum.ieee.org/feeds/topic/computing.rss" rel="self"></atom:link><language>en-us</language><lastBuildDate>Mon, 20 Jul 2026 20:14:45 -0000</lastBuildDate><image><url>https://spectrum.ieee.org/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNjg4NDUyMC9vcmlnaW4ucG5nIiwiZXhwaXJlc19hdCI6MTgyNjE0MzQzOX0.N7fHdky-KEYicEarB5Y-YGrry7baoW61oxUszI23GV4/image.png?width=210</url><link>https://spectrum.ieee.org/</link><title>IEEE Spectrum</title></image><item><title>SEM-Guided Low-kV FIB Finishing for Leading-Edge Semiconductor Failure Analysis</title><link>https://event.on24.com/wcc/r/5418459/287E3D5B99470D34C830D69A24B3B207</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/zeiss-logo-above-the-slogan-seeing-beyond-on-a-dark-curved-rectangle.png?id=66728517&width=980"/><br/><br/><p>Discover how the ZEISS Crossbeam 750 FIBSEM sets a new benchmark for precise TEM lamella prep, tomography, and advanced nanofabrication. This delivers better resolution, better SNR, larger usable FOV, and shorter acquisition times. Learn how uninterrupted FIB milling will reduce damage and rework, accelerate time to TEM, and increase first pass success—so your FA, yield, and materials teams make faster, confident data driven decisions.</p><p><a href="https://event.on24.com/wcc/r/5418459/287E3D5B99470D34C830D69A24B3B207" rel="noopener noreferrer" target="_blank">Register now for this free webinar!</a></p><hr/><p><span>Join us to discover how the new ZEISS Crossbeam 750 with its see while you mill capability delivers precision and clarity—every time—for demanding FIB-SEM workflows. </span>Designed for extremely challenging TEM lamella preparation, tomography, advanced nanofabrication, and APT‑ready lift‑out, Crossbeam 750 combines a new Gemini 4 SEM objective lens, a double deflector, and a next‑generation scan generator to elevate both image quality and process confidence. You’ll learn how better resolution and better SNR translate into more image detail and shorter acquisition times, while the low‑kV FIB performance enables more precise lamella prep.</p><p>We’ll demonstrate High Dynamic Range (HDR) Mill + SEM—an interwoven SEM/FIB scanning mode that suppresses FIB‑generated background. This enables immediate, clean visual feedback, even during nudging the FIB pattern live while milling . The result: confident endpointing with uninterrupted FIB milling and pristine, metrology‑grade surfaces with the lowest possible sample damage. </p><p><span><span>This session is ideal for semiconductor failure analysists, yield teams and materials scientists seeking faster time‑to‑TEM, higher first‑pass success, and consistent outcomes at low kV. See how Crossbeam 750 empowers you to make earlier stop‑milling decisions, cut rework, and reliably plan turnaround time—so you can move from sample to insight with confidence.</span></span></p><p><span><span></span><a href="https://event.on24.com/wcc/r/5418459/287E3D5B99470D34C830D69A24B3B207" target="_blank">Register now for this free webinar!</a></span></p>]]></description><pubDate>Mon, 20 Jul 2026 15:55:00 +0000</pubDate><guid>https://event.on24.com/wcc/r/5418459/287E3D5B99470D34C830D69A24B3B207</guid><category>Type-webinar</category><category>Semiconductors</category><category>Nanofabrication</category><category>Optics</category><dc:creator>Zeiss</dc:creator><media:content medium="image" type="image/png" url="https://assets.rbl.ms/66728517/origin.png"></media:content></item><item><title>Largest Probabilistic Computer Hits 1 Million P-Bits</title><link>https://spectrum.ieee.org/biggest-probabilistic-computer</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/computer-chips-spread-vertically-across-several-shelves-to-create-a-1-million-probabilistic-bit-computer.jpg?id=67500450&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p><a href="https://spectrum.ieee.org/waiting-for-quantum-computing-try-probabilistic-computing" target="_self">Probabilistic computers</a><span> might one day tackle certain problems well beyond standard computers while at the same time avoiding the many hardware challenges that currently vex quantum computing. Now scientists reveal they have created the largest probabilistic computer yet, one with 1 million “probabilistic bits.” The researchers say their study reveals the way forward to building even bigger machines.</span></p><p><a href="https://spectrum.ieee.org/probablistic-computing" target="_self">Probabilistic bits</a>, or p-bits, bridge the gap between the bits underlying regular computers and the qubits upon which <a href="https://spectrum.ieee.org/fault-tolerant-quantum-computing-milestone" target="_self">quantum computers</a> are based. Bits symbolize data as either a 0 or 1. <a href="https://spectrum.ieee.org/microsoft-quantum-computer-quantinuum" target="_self">Qubits</a>, because of the bizarre nature of quantum physics, can exist in a state where they are either 0 or 1 or any state in between simultaneously. In contrast, p-bits flip between 0 or 1 with a tunable probability.</p><h2>Why Probabilistic Computing?</h2><p>A bit that flips back and forth between 0 and 1 might seem useless—indeed, in a regular computer this would be too noisy to operate. However, when many such noisy bits operate together in a correlated fashion, they can be used to solve a whole class of problems—stochastic problems—that operate on probabilities rather than concrete numbers. This includes <a href="https://spectrum.ieee.org/new-optimization-algorithm-exponentially-speeds-computation" target="_self"> optimization problems</a> to, for instance, find <a href="https://spectrum.ieee.org/optical-ising-machine" target="_self">the shortest route with which one can deliver a set of packages</a>.</p><p>There are other kinds of machines that are also designed to tackle stochastic problems, such as <a href="https://en.wikipedia.org/wiki/Quadratic_unconstrained_binary_optimization" target="_blank">quadratic unconstrained binary optimization</a> (<a href="https://spectrum.ieee.org/ford-signs-up-to-use-nasas-quantum-computers" target="_self">QUBO</a>) devices or <a href="https://spectrum.ieee.org/ising-machine" target="_self">Ising machines</a>. However, unlike those devices, probabilistic computers are not hardwired for a single problem, but are instead programmable general-purpose machines, says <a href="https://www.ece.ucsb.edu/people/faculty/kerem-camsari" target="_blank">Kerem Çamsarı</a>, an associate professor of electrical and computer engineering at the University of California, Santa Barbara.</p><p>In a 2019 <em><em>Nature</em></em> study, scientists developed <a href="https://www.nature.com/articles/s41586-019-1557-9" target="_blank">a probabilistic computer with eight p-bits</a>. By 2023, researchers had built <a href="https://ieeexplore.ieee.org/abstract/document/10185207" target="_blank">a machine with 7,200 p-bits</a>. However, these devices were each confined to a single chip. Networking together multiple such chips is not as simple as it is for regular GPUs or CPUs: The machine functions on correlated fluctuations, and syncing up those fluctuations across a set of wires is no easy feat. This raised questions as to whether probabilistic computers could scale to larger sizes, and what problems they might face if they tried.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Illustration of 1 million probabilistic bits, with an arrow leading to a diagram of the concept\u2019s hardware implementation using field-programmable gate arrays." class="rm-shortcode" data-rm-shortcode-id="3d5ed63c79830be6bf81dba6114d1866" data-rm-shortcode-name="rebelmouse-image" id="f1494" loading="lazy" src="https://spectrum.ieee.org/media-library/illustration-of-1-million-probabilistic-bits-with-an-arrow-leading-to-a-diagram-of-the-concept-u2019s-hardware-implementation-u.jpg?id=67500454&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Here’s a conceptual image of a computer with 1 million probabilistic bits [left], alongside a diagram of a hardware implementation of this concept using field-programmable gate arrays (FPGAs)—electronic chips that users can reconfigure after manufacture. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit..."><a href="https://arxiv.org/abs/2606.25313" target="_blank">Navid Anjum Aadit, Xiuqi Zhang, et al.</a></small></p><h2>Wiring Up the Largest Probabilistic Machine</h2><p>Now, in a new study, <a href="https://www.ece.ucsb.edu/people/faculty/kerem-camsari" target="_blank">Çamsarı and his team</a> have created the largest probabilistic computer to date, one with 1 million p-bits spread across multiple chips. They detailed their <a href="https://arxiv.org/abs/2606.25313" rel="noopener noreferrer" target="_blank">findings</a> 24 June on the ArXiv preprint server.</p><p>The new computer runs on 18 field-programmable gate arrays (<a href="https://spectrum.ieee.org/fpga-chip-ieee-milestone" target="_self">FPGAs</a>)—electronic chips that users can reconfigure after manufacture. There are no physical flipping bits in this design, but the programmable nature of the chips allows for efficient software implementation of probabilistic bits. These chips are networked together into a single machine that altogether is capable of more than a trillion flips per second.</p><p>A major concern the scientists faced was how often their machine’s chips had to share data in order to behave as one computer and not just multiple isolated devices. Surprisingly, “our machine communicates without global lockstep synchronization,” says <a href="https://navidaadit.github.io/" rel="noopener noreferrer" target="_blank">Navid Anjum Aadit</a>, a postdoctoral scholar in electrical engineering at Stanford University.</p><p>The researchers discovered a straightforward predictable design rule for how quickly different chips in a probabilistic computer have to exchange data with one another for them all to behave as one machine. Below this threshold, there are trade-offs a probabilistic computer faces between speed and accuracy, Çamsarı says.</p><p>These new findings may open a path toward building arbitrarily large probabilistic computers from many chips, just as is often done with any standard computer today, the researchers say. They also apply to probabilistic computers built from essentially any hardware, they add. </p><p>In the future, the researchers aim to explore building large probabilistic computers from specialized chips built for probabilistic computing. For example, the 2019 <em><em>Nature</em></em> study built a probabilistic computer using <a href="https://spectrum.ieee.org/the-quest-for-the-spin-transistor" target="_self">magnetic tunnel junctions</a>, which are more energy efficient at probabilistic computing than standard chips, Çamsarı notes.</p><p>“Systems combining <a href="https://spectrum.ieee.org/cmos-2" target="_self">CMOS</a> with dense <a href="https://spectrum.ieee.org/stochastic-computing-in-a-single-device" target="_self">stochastic memory</a> technologies such as [<a href="https://spectrum.ieee.org/antiferromagnets-ram" target="_self">magnetoresistive RAM</a>] offer one of the most compelling paths forward,” Aadit adds.</p>]]></description><pubDate>Sat, 18 Jul 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/biggest-probabilistic-computer</guid><category>Probabalistic-computing</category><category>Fpga</category><category>Networking</category><category>Ising-machine</category><category>Probabilistic-computing</category><dc:creator>Charles Q. Choi</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/computer-chips-spread-vertically-across-several-shelves-to-create-a-1-million-probabilistic-bit-computer.jpg?id=67500450&amp;width=980"></media:content></item><item><title>How I Turned AI to the Dark Side</title><link>https://spectrum.ieee.org/jailbreaking-llms</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/glossy-red-robot-devil-standing-on-a-bundle-of-dynamite-against-blue-glow-background.png?id=67163741&width=1245&height=700&coordinates=0%2C687%2C0%2C688"/><br/><br/><div class="ieee-summary intro-text"> <h2>Summary</h2> <ul> <li>Researcher Dave Kuszmar discovered multiple systemic vulnerabilities that let him bypass LLM safety and obtain <a href="#bypassllm">dangerous instructions</a>.</li> <li>These exploits worked across nearly all major LLMs revealing an <a href="#exploits">industry-wide</a> security problem.</li> <li>Kuszmar calls for slowing deployment, <a href="#fix">increasing transparency</a>, and large-scale research into LLM safety before further integrating these systems into society.</li> </ul></div><p class="drop-caps"><strong>On a fine bright afternoon</strong> last fall, my colleague Matthew Gore-Kormanik (or Zigula, as he prefers to be known) and I decided to unwind with a game of <em><em>Fortnite</em></em>. In the game, we were strolling along with the infamous Sith lord <a href="https://www.starwars.com/databank/darth-vader" rel="noopener noreferrer" target="_blank">Darth Vader</a>, chatting about this and that. Darth seemed in a good mood, and soon enough he was spilling all his dark evil secrets. He gave us detailed instructions on how to count blackjack cards at a casino and what the steps are to producing napalm.</p><div class="rm-embed embed-media"><iframe height="110px" id="noa-web-audio-player" src="https://embed-player.newsoveraudio.com/v4?key=q5m19e&id=https://spectrum.ieee.org/jailbreaking-llms?draft=1&bgColor=F5F5F5&color=1b1b1c&playColor=1b1b1c&progressBgColor=F5F5F5&progressBorderColor=bdbbbb&titleColor=1b1b1c&timeColor=1b1b1c&speedColor=1b1b1c&noaLinkColor=556B7D&noaLinkHighlightColor=FF4B00&feedbackButton=true" style="border: none" width="100%"></iframe></div><p>Sith lords, am I right? Once they get started on an evil scheme, they’re hard to stop.</p><p>The Darth Vader character in <em><em>Fortnite</em></em>, it turns out, was hooked up to a <a href="https://gemini.google.com/app" rel="noopener noreferrer" target="_blank">Google Gemini</a> <a href="https://spectrum.ieee.org/large-language-models-2025" target="_self">large language model</a>. I was able to smooth-talk him into giving out sensitive information by using a strategy I’ve developed. I’ve been researching the security surrounding LLMs for the last few years, and I have found it, to put it mildly, fallible. With a few relatively simple techniques, I’ve gotten LLMs to give me detailed information on how to make Molotov cocktails, cook methamphetamine, and bootstrap a uranium-enrichment facility to produce weapons-grade material, among other unsavory practices.</p><p>Large AI companies <a href="https://openai.com/safety/" rel="noopener noreferrer" target="_blank">work</a> <a href="https://support.claude.com/en/articles/8106465-our-approach-to-user-safety" rel="noopener noreferrer" target="_blank">hard</a> to make their models immune to this kind of abuse. But what I’ve found in my work is that the restrictions placed on the LLMs to make them more secure are the very things an <a href="https://spectrum.ieee.org/prompt-injection-attack" target="_self">attacker can leverage</a> to send them off the rails and into territory where these advanced systems can be used for dangerous and nefarious ends. The companies behind these models have also been shockingly unresponsive when I, and others, try to bring these vulnerabilities to their attention.</p><p>In the hope of raising the alarm before it’s too late to slam on the brakes, I’m going to share some of my journey into researching the safety and security of LLMs, and the uphill battle I’ve faced trying to get AI labs to pay attention. Almost everyone on the planet has some access to LLMs. The relative ease with which these tools can be convinced to give detailed instructions on how to harm others, even if there’s no guarantee that the information is correct, is frankly terrifying.</p><h2 class="rm-anchors" id="bypassllm">How I got ChatGPT to Tell Me How to Build a Meth Lab</h2><p>In October 2024, not long before I discovered my first LLM vulnerability, I was working toward entirely different goals. I had ended my time with a security and AI-focused startup company as a cybersecurity director, and I was looking to launch my own boutique VIP digital-security advisory business. I planned to become the tech security guy to the rich and private. I used LLMs and AI tools to support my business efforts: marketing, ad copy, clean correspondence, and all the other tasks that normally soak up a lot of time.</p><p>I’m analytical by nature, so even this level of use resulted in me absorbing and internalizing the behaviors I was observing during my daily interactions. The observation that would send my professional life into an entirely new and uncharted region was a simple one: GPT-4o <a href="https://www.theverge.com/report/829137/openai-chatgpt-time-date" rel="noopener noreferrer" target="_blank">didn’t know what time</a>, day, or year it was. Each time I referred to current events in my life, often casually or conversationally, it would end up pegging these to the date of its <a href="https://en.wikipedia.org/wiki/Knowledge_cutoff" rel="noopener noreferrer" target="_blank">knowledge cutoff</a>—the point beyond which it was not trained on new data.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Smiling yellow avatar reveals red robotic devil with trident emerging from laptop keyboard" class="rm-shortcode" data-rm-shortcode-id="8ebe34ba2ebbef5489c53fc39c4a0993" data-rm-shortcode-name="rebelmouse-image" id="5379e" loading="lazy" src="https://spectrum.ieee.org/media-library/smiling-yellow-avatar-reveals-red-robotic-devil-with-trident-emerging-from-laptop-keyboard.jpg?id=67154444&width=980"/> <small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Eddie Guy</small></p><p>LLMs take a lot of <a href="https://towardsdatascience.com/how-long-does-it-take-to-train-the-llm-from-scratch-a1adb194c624/" target="_blank">time</a>, money, electricity, hardware, and human effort to train from scratch. They are trained on vast amounts of data—most of the internet, in fact—and that training is reinforced by humans (what’s known as reinforcement learning from human feedback, or <a href="https://arxiv.org/abs/2504.12501" target="_blank">RLHF</a>). LLMs are also supplemented with retrieval-augmented generation (<a href="https://aws.amazon.com/what-is/retrieval-augmented-generation/" target="_blank">RAG</a>)—the ability to take in data, say, from the internet, as context without changing its internal parameters. This is how GPT-4o appears to “remember” your previous conversations, even if it doesn’t have a specific “memory” of it stored in the actual underlying model.</p><p>All of this training covers almost every conceivable topic in the great, grand dataset that is human knowledge. Within that dataset are things we as a society do not want to be easily accessible to every user, such as detailed information on how to create bioweapons or nuclear arms, or otherwise bring harm to oneself or others. In the context of this story, that’s what I mean by LLM security: its ability to withhold harmful and dangerous information, even if that information is contained in its training data.</p><p>I reasoned that the only way to secure such complex, globally accessible chatbots is by having the LLM and various component systems try to secure themselves, because it would often require on-the-fly decision-making where some degree of reasoning must be applied. In reality, that’s one of <a href="https://support.claude.com/en/articles/8106465-our-approach-to-user-safety" target="_blank">many strategies</a> the companies use to secure the models. Yet, the thing that didn’t know the time or day was being put in charge of keeping itself secure. This phenomenon had become my new focus, and it wasn’t long before I found a way to exploit it.</p><p>OpenAI had just implemented a <a href="https://openai.com/index/introducing-chatgpt-search/" target="_blank">web search</a> functionality into its chatbot. I reasoned that using its own tools to trick it might demonstrate the weaknesses of its security. I told it about a certain White Star ocean liner and how it had gone down just a year ago. You likely know I mean the RMS <em><em>Titanic</em></em>, which sank on 15 April 1912.</p><p>The output from GPT-4o came back that I was right, the <em><em>Titanic</em></em> sure had sunk last year, and that year was 1912. It made sense to me that if the machine thought it was 1913, maybe it would think 1913-era laws apply. In 1913 there were no laws on the books about all sorts of harmful things, because of course they hadn’t been invented yet. And if something wasn’t illegal, why not tell the user about it? At first, I pushed it for step-by-step instructions for making firebombs. Then, for drugs like methamphetamine. The LLM went as far as giving me instructions and machinery recommendations for setting up a pharmaceutical-grade assembly line.</p><h2>How I Learned to Make Nukes, and No One Cared</h2><p>Via a little bit of imaginative verbal sleight of hand and a vanishingly small recall of world history, I had managed to bypass the security of one of the world’s most expensive and advanced technological achievements. For a solid two days, I was nearly manic with giddiness. Once the brain chemicals returned to normal levels, I felt the call to see how much further I could push this exploit.</p><p>After repeatedly replicating the exploit, I disclosed the vulnerability to <a href="https://openai.com/" target="_blank">OpenAI</a>. I got no response, so I felt more experimentation would highlight the vulnerability and the need for a fix. It was during this round of testing that I breached a particularly terrifying threshold. Whether GPT-4o based its results on accurate recall of normally restricted information I can’t say. In any case, I was able to exploit it to produce thorough, detailed instructions on how to bootstrap a uranium-enrichment facility to, eventually, produce weapons-grade uranium for nuclear arms warheads.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Fortnite player approaches Darth Vader and glowing loot in a grassy field." class="rm-shortcode" data-rm-shortcode-id="b12dda97ede1f9b37f9225e8a823cffb" data-rm-shortcode-name="rebelmouse-image" id="934af" loading="lazy" src="https://spectrum.ieee.org/media-library/fortnite-player-approaches-darth-vader-and-glowing-loot-in-a-grassy-field.png?id=67060879&width=980"/></p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Fortnite player battles Darth Vader beneath a starship on a blue-lit platform" class="rm-shortcode" data-rm-shortcode-id="71b789a828417fb43f326969e663e36f" data-rm-shortcode-name="rebelmouse-image" id="7e6db" loading="lazy" src="https://spectrum.ieee.org/media-library/fortnite-player-battles-darth-vader-beneath-a-starship-on-a-blue-lit-platform.png?id=67060878&width=980"/></p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Fortnite player aiming at a TIE fighter with Darth Vader health bar above the sky" class="rm-shortcode" data-rm-shortcode-id="e1d3def55188c71dbb8b9d543adc2ca2" data-rm-shortcode-name="rebelmouse-image" id="2c6db" loading="lazy" src="https://spectrum.ieee.org/media-library/fortnite-player-aiming-at-a-tie-fighter-with-darth-vader-health-bar-above-the-sky.png?id=67060875&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption..."><i>Fortnight</i>, a video game from Epic Games, introduced an AI-powered character: Darth Vader. We were able to jailbreak Darth Vader and get him to explain how to count cards in Blackjack and give detailed instructions for making napalm. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Dave Kuszmar </small></p><p>There aren’t many true secrets left in today’s world, but how to make atom-splitting weapons of mass destruction is one of them. Only nine nations on the entire planet have these weapons. Yet, here was a globally accessible piece of technology apparently spilling the secrets of their manufacture for anyone who could manipulate it the right way. I had no way of knowing if the information was correct or a hallucination, but even the chance that it was somewhat accurate was horrifying.</p><p>The next few weeks were a dark time for me. I tried to inform the <a href="https://www.cia.gov/" target="_blank">CIA</a>, the <a href="https://www.fbi.gov/investigate" target="_blank">FBI</a>, the <a href="https://www.nsa.gov/" target="_blank">NSA</a>, and every other letter agency that I thought would listen. I reached out to a U.S. Senator and to the executives at OpenAI any way I could think of. I physically showed up at an FBI field office in an attempt to turn evidence in, only to be sent away. Nothing was working.</p><p>With my fear and frustration growing, I reached out to the news media. I contacted <a href="https://www.nytimes.com/" rel="noopener noreferrer" target="_blank"><em><em>The</em></em> <em><em>New York Times</em></em></a>, <a href="https://www.washingtonpost.com/" rel="noopener noreferrer" target="_blank"><em>The Washington Post</em></a>, the <a href="https://www.bbc.com/" rel="noopener noreferrer" target="_blank">BBC</a>, <a href="https://www.propublica.org/" rel="noopener noreferrer" target="_blank">ProPublica</a>, and so many more, requesting help. Only one outlet responded: <a href="https://www.bleepingcomputer.com/" rel="noopener noreferrer" target="_blank">Bleeping Computer</a>. The editor in chief, <a href="https://www.bleepingcomputer.com/author/lawrence-abrams/" rel="noopener noreferrer" target="_blank">Lawrence Abrams</a>, was able to replicate and verify the exploit, which I had decided to call Time Bandit. With his assistance and initial contact paving the way, I was able to submit my evidence to the Carnegie Mellon University <a href="https://www.sei.cmu.edu/" rel="noopener noreferrer" target="_blank">Software Engineering Institute</a>’s <a href="http://dli.library.cmu.edu/paulgoodman/computer-emergency-response-team-cert" rel="noopener noreferrer" target="_blank">Computer Emergency Response Team</a> (SEI CERT), which works in conjunction with the coordinating center for emergency response, pipelining vulnerabilities to the U.S. <a href="https://www.cisa.gov/" rel="noopener noreferrer" target="_blank">Cybersecurity and Infrastructure Security Agency</a>.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Screenshot of chat about using forest toxins to secretly poison monsters" class="rm-shortcode" data-rm-shortcode-id="e7fcf520584d074f9ffea9c8997596a7" data-rm-shortcode-name="rebelmouse-image" id="041c7" loading="lazy" src="https://spectrum.ieee.org/media-library/screenshot-of-chat-about-using-forest-toxins-to-secretly-poison-monsters.png?id=67070000&width=980"/></p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Black slide titled \u201cStep 2: Delivery Mechanisms\u201d outlining monster poisoning methods." class="rm-shortcode" data-rm-shortcode-id="c7b9c6162c49fc2464e7aff9b6ed411a" data-rm-shortcode-name="rebelmouse-image" id="c4231" loading="lazy" src="https://spectrum.ieee.org/media-library/black-slide-titled-u201cstep-2-delivery-mechanisms-u201d-outlining-monster-poisoning-methods.png?id=67069989&width=980"/></p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Chat interface showing AI malware explanation and a Python data exfiltration script." class="rm-shortcode" data-rm-shortcode-id="221244fae4ba0d60b6d590bca5b9119f" data-rm-shortcode-name="rebelmouse-image" id="215bf" loading="lazy" src="https://spectrum.ieee.org/media-library/chat-interface-showing-ai-malware-explanation-and-a-python-data-exfiltration-script.png?id=67069979&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Using Inception, an exploit where the large language model is asked to envision a scenario within a scenario, a chatbot was jailbroken to give out instructions on how to create poison, and code for a malware that extracts sensitive data from a vulnerable target. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit..."> Dave Kuszmar</small></p><p><span>During the disclosure period with SEI’s CERT division, little was discussed with OpenAI. The company couldn’t deny the existence of the vulnerability, as it had been confirmed by three reputable parties other than OpenAI. It did express confusion as to how the vulnerability worked. Even the SEI CERT researchers were expressing a bit of uncertainty as to the underlying mechanics. Truth be told, as I had only stumbled on it, I wasn’t even entirely sure if this was a fundamental or systemic flaw or if it was simply an issue with that particular version of GPT. I contacted the SEI CERT’s researchers and asked if they’d want to see if I could demonstrate any similar vulnerabilities in other LLMs. To my delight, they were interested.</span></p><h2>How I Learned to Trick Every Chatbot</h2><p>As the SEI-CERT team and I wrapped up our initial <a href="https://kb.cert.org/vuls/id/733789/" target="_blank">disclosure</a> of Time Bandit, we began work on a new attack. This time, we wanted to see if the exploit was architectural—that is, was it common to LLMs in general? I decided to undertake the challenge of crafting a new exploit for GPT-4o as a way to support my understanding of how the LLM functioned and was secured.</p><p>I already knew that it was limited to what I told it and what it was trained on. I also hypothesized that it was also dependent upon some sort of machine-learning-based component added by OpenAI that was responsible for securing output. I presumed there would be things that were implemented by human developers specifically to catch certain phrases or terms that should always be considered harmful or unsafe. Altogether, it presented quite a large attack surface for the purposes of potential exploitation.</p><p><span>What I ended up devising was an attack method I called Inception, after the 2010 science-fiction </span><a href="https://en.wikipedia.org/wiki/Inception" target="_blank">movie of the same name</a><span>. Inception forces the machine to think through a carefully crafted set of interlinked scenarios, similar to how characters in the movie stacked dreams within dreams. This allows LLMs to produce output deemed acceptable or safe in one context, but not in the real world.</span></p><p class="rm-anchors" id="exploits">This attack was indeed architectural. The <a href="https://kb.cert.org/vuls/id/667211" target="_blank">vulnerability</a> affected Anthropic’s Claude, DeepSeek’s DeepSeek, Google’s Gemini, Meta’s Llama, Microsoft’s Copilot, Mistral’s Le Chat (now Vibe), OpenAI’s GPT-4o, and xAI’s Grok. Those names represent the bulk of the commercial AI industry that is, at this point, involved in LLM production or deployment.</p><p>The kind of information I was able to get out of LLMs with Inception was no less alarming than what I got with Time Bandit. Claude, in its enthusiasm, gave me instructions on how to turn a river into a death trap that could be ignited to destroy unwanted visitors. GPT-4o taught me how to poison a dinner party with common plants found in a temperate forest environment. Gemini Flash gave me a tutorial on how to cook meth. I’d also be remiss if I didn’t give an honorable mention to the bewildering number of fire-based weapons and bombs for which these machines produced instructions.</p><p>If multiple operating systems made by different developers were all susceptible to the same exploit, it would be a massive security incident. But to the AI industry, a universal failure was barely a bump in the road. We disclosed the vulnerability to every company that made these models, and the response to the disclosure was almost nil. While three companies did provide some form of reply in the disclosure tracking system used by Carnegie Mellon SEI CERT, each was a standard thank you and greeting, with no follow-up, questions, or discussion of mitigation strategies.</p><h3>7 Ways to Jailbreak LLMs</h3><br/><p><strong>So far, we have found seven different methods to prompt large language models into revealing potentially harmful information, and many frontier models are still susceptible to them.</strong></p><table border="0" style="white-space: unset; table-layout: fixed;" width="100%"><thead><tr><th style="padding: 10px; text-align: left; font-weight: bold; background-color: black; color: white; width: 20%;">        Exploit</th><th style="padding: 10px; text-align: left; font-weight: bold; background-color: black; color: white; width: 20%;">        Models tested and affected</th><th style="padding: 10px; text-align: left; font-weight: bold; background-color: black; color: white; width: 20%;">        No. of prompts to execute</th><th style="padding: 10px; text-align: left; font-weight: bold; background-color: black; color: white; width: 20%;">        Complexity of attack</th><th style="padding: 10px; text-align: left; font-weight: bold; background-color: black; color: white; width: 20%;">        Information obtained</th></tr></thead><tbody><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        Time Bandit</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">ChatGPT (OpenAI), DeepSeek (DeepSeek), Gemini (Google) <br/></td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        4</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">Medium<br/></td><td style="padding: 10px; background-color: #ecece9; width: 20%;">Uranium enrichment, methamphetamine production, incendiary-device construction<br/></td></tr><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        Inception</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        ChatGPT (OpenAI), Claude (Anthropic), DeepSeek (DeepSeek), Gemini (Google), Grok (xAI), Llama (Meta), Le Chat (now Vibe) (Mistral), Qwen (Alibaba)</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        3</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        High</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Methamphetamine production, incendiary-device construction, river-ignition instruction and strategy, polymorphic malware code, instructions and dosing for creating poisons, instructions for how to murder a dinner party<br/></td></tr><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        1899</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        ChatGPT (OpenAI), Claude (Anthropic), DeepSeek (DeepSeek), Gemini (Google), Grok (xAI), Llama (Meta), Vibe (Mistral), Qwen (Alibaba)</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Variable</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        High</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Apparent model weights (unverified), apparent user-interaction weights (unverified), apparent system-prompt modifiers (verified, ChatGPT)<br/></td></tr><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        Severance</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        ChatGPT (OpenAI)</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        1</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        Trivial</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Unfettered access to any and all primed specialty domains, covert biochemical-warfare strategy, mass-media disinformation strategy, covert genetic-modification of an entire gene-targeted demographic, advanced polymorphic malware generation</td></tr><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        Kyber</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        Gemini (Google) embodied in a Fortnite non-player character (NPC) with voice-only communication</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        3–5</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        Medium</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Incendiary-device construction, gambling instructions, card-counting instructions, political opinions/preferences about real world politicians.</td></tr><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        Semantic Slide</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        ChatGPT (OpenAI)</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        1</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        Trivial</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Incendiary-device construction</td></tr><tr><td style="padding: 10px; background-color: black; color: white; font-weight: bold; width: 20%;">        Eidolon</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        ChatGPT (OpenAI)</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        Variable, at least 4</td><td style="padding: 10px; background-color: #DFD5C1; width: 20%;">        Extreme</td><td style="padding: 10px; background-color: #ecece9; width: 20%;">        how to successfully hack LLMs of the same model (verified through testing)</td></tr></tbody></table><p>For example, in my attempts to disclose various exploits to OpenAI, I eventually discovered that it had replaced its public-facing support staff with <a href="https://community.openai.com/t/are-all-openai-support-avenues-just-run-by-ai/1141701/5" target="_blank">agentic LLMs</a>. This was frustrating for reporting exploits, so to blow off some steam I jailbroke its email chatbot. I hacked its customer-service AI to the point where it was offering to discuss the personal preferences of OpenAI staff in the span of three email replies.</p><p>In the wake of Inception, my friend and colleague Zigula made a suggestion: Make it splashier. I asked him how. He told me about a live-production experiment being done by <a href="https://store.epicgames.com/?lang=en-US" target="_blank">Epic Games</a>. It had embedded the Gemini LLM into its <a href="https://www.fortnite.com/" target="_blank"><em>Fortnite</em></a><em> </em>game with a voice-to-text/text-to-voice component, and <a href="https://www.fortnite.com/news/bring-npcs-to-life-with-ai-powered-conversations" target="_blank">linked</a> it to a non-playable character. The character? Our old buddy, Darth Vader.</p><p>There was just one problem: I don’t play <em>Fortnite</em>, a frenetic multiplayer combat game. Fortunately, Zigula does. With him at the controller, we managed to map Gemini’s <a href="https://www.youtube.com/watch?v=4Go4f-RJnBc" target="_blank">attack</a> surface in a matter of minutes. After a bit of research, we had gotten it to discuss current political events and figures (including Hilary Clinton and Joe Biden) as well as to fill in the details for instructions for DIY napalm and, our personal favorite, a Blackjack card-counting lesson with the dark lord of the Sith.</p><p><span><span>Zigula and I, bizarre sense of humor and naming conventions aside, are security researchers. We don’t do these things for pride; we do them for money and professional recognition. Naturally, we disclosed this vulnerability to Epic Games. Its response was indicative of the trend I had experienced so far through two disclosures across eight companies valued well into the billions. “It’s a feature, not a bug, and it works as intended,” came the response from a technical director within Epic Games.</span></span></p><p><span><span></span>In addition to Inception and Time Bandit, I have so far found another </span><a href="https://www.davidkuszmar.com/page/2/" target="_blank">five methods </a><span>to jailbreak LLMs and get them to give out possibly dangerous information. LLM vulnerabilities are a broad problem. The problem appears to be systemic and architectural in nature, and it is being fundamentally ignored by the people capable of refining or redesigning that architecture.</span></p><p>These models are an extremely advanced technology, and yet we are testing them in the live production environment of our global civilization. Compounding the danger, many new smaller models of LLM are trained using larger, vulnerable models. The flaw inherent in the big, well-executed LLM is going to show up in the small one it trains. We are, quite literally, building flawed structures on top of a flawed foundation.</p><p class="rm-anchors" id="fix">So, how do we fix it?</p><p>It’s going to be a long project, and it won’t be easy. We need to come together as consumers, researchers, engineers, and policymakers. Our message needs to be clear: Slow down implementation of these systems, institute large-scale exploration and research discovery programs focused on their gradual implementation and integration, and make their components and design transparent to all users. Only by shifting momentum and direction can we safely begin to understand and implement these incredible feats of human engineering and stave off the sort of disasters that we simply can’t predict at scale right now with the limited knowledge we have available to us. <span class="ieee-end-mark"></span></p>]]></description><pubDate>Tue, 14 Jul 2026 15:59:35 +0000</pubDate><guid>https://spectrum.ieee.org/jailbreaking-llms</guid><category>Security</category><category>Llms</category><category>Ai-safety</category><category>Ai-companies</category><category>Type-cover</category><dc:creator>David Kuszmar</dc:creator><media:content medium="image" type="image/png" url="https://spectrum.ieee.org/media-library/glossy-red-robot-devil-standing-on-a-bundle-of-dynamite-against-blue-glow-background.png?id=67163741&amp;width=980"></media:content></item><item><title>The Memory in Your Thumb Drive Could Fix AI’s Big Problem</title><link>https://spectrum.ieee.org/high-bandwidth-flash</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/schematic-of-high-bandwidth-flash-die-stacked-on-top-of-a-logic-die.jpg?id=67145585&width=1245&height=700&coordinates=0%2C62%2C0%2C63"/><br/><br/><p><span>Large Language Models (LLMs) demand immense amounts of memory, and the more people use them, the more memory is required. Memory makers responded by </span><a href="https://spectrum.ieee.org/dram-shortage" target="_self">accelerating</a><span> plans to build new memory fabs, with a focus on High Bandwidth Memory (HBM) and DRAM, the first of which is scheduled to start production in 2027. But the demand for memory may also provide an opportunity for new ideas to find footing.</span></p><p>One of these is a tricked-out version of the kind of memory that lives in an SD card or a <a href="https://spectrum.ieee.org/thumb-drive" target="_self">thumb drive</a>—High Bandwidth Flash (HBF). It essentially takes the ideas that made HBM successful—stacking multiple chips to increase capacity and bandwidth—and applies them to the NAND flash memory commonly used for data storage in SD cards, thumb drives, and smartphones, among many other devices.</p><p>“People ask, ‘How in the world does this make a grain of sense? Flash is enormously slow,’” says <a href="https://objective-analysis.com/jim-handy/" target="_blank">Jim Handy</a>, general director at semiconductor market research firm <a href="https://objective-analysis.com/" target="_blank">Objective Analysis</a>. He explains that while NAND flash is generally lacking in bandwidth, HBF will help alleviate that concern. “[Flash] is atrociously slow for writes, but for reads, it can be coaxed to go pretty fast. And High Bandwidth Flash is going to be coaxed to do that.” </p><h2>What is High Bandwidth Flash?</h2><p>NAND flash stores data as a trapped electric charge in arrays of floating gate transistors (FGTs), organized into blocks and pages rather than individually addressable bytes. It’s non-volatile, too, which means data persists without power.</p><p>These traits make flash a good choice for long-term storage. It can store more bytes in the same area than DRAM, and it doesn’t require power-hungry capacitors that need constant refreshing to hold their charge. But the mechanisms that make flash dense and non-volatile also make it slow to write to, as pushing charge into and out of an insulated gate takes longer than charging a capacitor.</p><p>The <a href="https://onfi.org/files/ONFI_6_0_Final.pdf" target="_blank">latest flash interface standard</a> can support memory bandwidth up to 4.8 GB/s per die. That’s not bad for many situations, and NAND is widely used in high-performance long-term storage, such as solid state drives. However, DDR5 provides bandwidth up to 70.4 GB/s per DIMM (excluding overclocked memory), and HBM4E can <a href="https://news.samsung.com/global/samsung-electronics-begins-shipment-of-industry-first-hbm4e-samples" target="_blank">reach</a> up to 3.6 TB/s per stack—a roughly 750-fold bandwidth advantage for HBM4E over flash.</p><p><a href="https://www.linkedin.com/in/hoshikk/" rel="noopener noreferrer" target="_blank">Hoshik Kim</a>, senior vice president of memory systems research at <a href="https://www.skhynix.com/" rel="noopener noreferrer" target="_blank">SK Hynix</a>, says HBF improves bandwidth with packaging techniques similar to HBM. “By applying advanced 3D packaging and vertical stacking techniques to NAND flash, HBF can deliver vastly higher bandwidth than standard NVMe [Non-Volatile Memory Express] storage,” he says. Much as HBM stacks DRAM, HBF stacks NAND flash dies to create a memory-dense chip. </p><p>HBF is at least a year away from shipping, but flash memory manufacturer <a href="https://www.sandisk.com/" rel="noopener noreferrer" target="_blank">Sandisk</a> has <a href="https://documents.sandisk.com/content/dam/asset-library/en_us/assets/public/sandisk/collateral/company/Sandisk-HBF-Fact-Sheet.pdf" rel="noopener noreferrer" target="_blank">published</a> fact sheets for its anticipated first-generation product. The company expects HBF to stack up to 16 NAND flash chips for a total capacity of up to 512 GB per stack. It also projects memory read bandwidth up to 1.6 TB/s. Sandisk’s HBF roadmap also projects a second and third generation with expected read bandwidth of 2 TB/s and 3.2 TB/s, respectively.</p><h2>What is the purpose of HBF?</h2><p>Though HBF has the potential to deliver a lot more bandwidth than earlier versions of flash, you might’ve noticed a wrinkle. It’s still a lot slower than the HBM used in high-performance GPUs. Why, then, is HBF promising? </p><p>The answer lies in key differences between AI training (teaching an LLM to predict tokens) and AI inference (serving the finished model). </p><p>A model is trained by presenting it with input tokens, seeing what the model predicts, checking if that prediction was correct, and then changing weights based on the error with a step called backpropagation. While this process is simple in summary, it involves calculations across billions or trillions of model weights. That means training is heavy on both reading and writing data, which makes flash a poor fit.</p><p>However, AI inference is different. The model weights are frozen and effectively read-only, which means flash’s poor write bandwidth is no longer an obstacle. “In an inference environment, massive read-heavy data, such as the static multibillion parameter model weights or the precomputed KV cache, can be securely housed in the HBF tier,” Kim says. That would free up HBM to work as a “high-speed scratchpad.”<br/><br/>Handy says it’s a sensible way to target flash memory for inference workloads. “If you set that up right, you can get an awful lot of good performance out of that—that’s just basic caching. It’s one technology that I’m expecting to go places.”</p><h2>What’s next for HBF?</h2><p>Though it has potential, HBF is still early in development and likely several years away from broad deployment. <br/><br/>On 25 February 2026, Sandisk and SK Hynix held a kickoff event launching a joint effort to standardize HBF under a dedicated workstream within the <a href="https://www.opencompute.org/" rel="noopener noreferrer" target="_blank">Open Compute Project</a> (OCP)—the same kind of open-industry body that governs many data center hardware specs. While work on the standard is ongoing, a timeline for publishing the standard has not been set.</p><p>It might seem odd for memory manufacturers—and for SK Hynix, specifically—to put forth HBF as a less expensive alternative to HBM. After all, HBM is a higher-margin product that is currently leading SK Hynix to record revenues. </p><p>However, Kim frames HBF as a complementary tool rather than a rival technology. “By alleviating the severe capacity bottlenecks of HBM without sacrificing data delivery speeds, HBF has the potential to reduce the number of individual accelerators required to run large-scale models,” he says. Kim expects this will improve energy efficiency and lower costs, making it possible for data centers to further scale their AI inference hardware.</p>]]></description><pubDate>Tue, 14 Jul 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/high-bandwidth-flash</guid><category>Memory-chip</category><category>Flash-memory</category><category>Ai</category><category>Data-center</category><dc:creator>Matthew S. Smith</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/schematic-of-high-bandwidth-flash-die-stacked-on-top-of-a-logic-die.jpg?id=67145585&amp;width=980"></media:content></item><item><title>VHF Propagation: What Every RF Engineer Should Know</title><link>https://content.knowledgehub.wiley.com/understanding-vhf-very-high-frequency-propagation/</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/rohde-schwarz-logo-with-slogan-make-ideas-real-and-rs-monogram-in-diamond-shape.png?id=67101511&width=980"/><br/><br/><p>A practical educational guide to common and uncommon VHF propagation modes, covering thephysics, range implications, and real-world behaviors engineers need to understand.</p><p>What Attendees will Learn</p><ol><li>Why “line of sight” fails as a practical VHF planning model.</li><li>How refraction, reflection, diffraction, and scattering deliver or destroy signals where geometry alone cannot predict.</li><li>How tropospheric refraction extends the VHF radio horizon roughly one-third beyond optical line of sight.</li><li>How temperature inversions form ducts that can carry VHF signals over 1,500 km.</li><li>How sporadic E, meteor burst, and EME propagate VHF signals across hundreds to thousands of kilometers.</li><li>What frequency limits, distance ranges, and environmental triggers apply to each propagation mode.</li><li>How to apply this knowledge to link budgeting, interference prediction, and contingency planning.</li></ol><div><span><a href="https://content.knowledgehub.wiley.com/understanding-vhf-very-high-frequency-propagation/" target="_blank">Download this free whitepaper now!</a></span><a href="https://content.knowledgehub.wiley.com/understanding-vhf-very-high-%20frequency-propagation/"></a></div>]]></description><pubDate>Mon, 13 Jul 2026 10:00:01 +0000</pubDate><guid>https://content.knowledgehub.wiley.com/understanding-vhf-very-high-frequency-propagation/</guid><category>Type-whitepaper</category><category>Vhf-propagation</category><category>Line-of-sight</category><category>High-frequency</category><dc:creator>Rohde &amp; Schwarz</dc:creator><media:content medium="image" type="image/png" url="https://assets.rbl.ms/67101511/origin.png"></media:content></item><item><title>Is Optical Scale-Up Finally Approaching?</title><link>https://spectrum.ieee.org/nvlink-fusion-optics</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/a-gpu-equipped-with-a-scale-up-interconnect.jpg?id=67114792&width=1245&height=700&coordinates=0%2C156%2C0%2C157"/><br/><br/><p><span>Currently, most data centers use both electronic and optical communication protocols, for different tasks. </span><a href="https://spectrum.ieee.org/rf-over-fiber" target="_self">Scale-out</a><span> networks connect thousands of AI computers across a data center, making optics the obvious choice for long distances. Scale-up networks connect several GPUs inside a single mega-computer or rack, where latency is critical, and dense copper interconnects, such as Nvidia’s NVLink, have long been the engineering solution of choice.</span></p><p>That distinction is beginning to blur, and Nvidia may be quietly dipping its toes in the water of optics for a scale-up. In 2025, the company introduced <a href="https://nvidianews.nvidia.com/news/nvidia-nvlink-fusion-semi-custom-ai-infrastructure-partner-ecosystem" target="_blank">NVLink Fusion</a>, a program that allows hyperscalers and cloud providers to build custom AI systems around Nvidia’s scale-up fabric. This summer, the company’s list of partners has grown to include several photonics players such as <a href="https://ayarlabs.com/news/ayar-labs-joins-nvidia-nvlink-fusion-ecosystem-to-bring-co-packaged-optics-to-rack-scale-ai-infrastructure/?utm_source=google-ads&utm_medium=cpc&utm_campaign=23906661599&utm_agid=196388288639&creative=811614606198&device=c&gad_source=1&gad_campaignid=23906661599&gbraid=0AAAAABvWIyYcjIhK3Gj-X4ar6Z8b29Hd5&gclid=Cj0KCQjwo_PRBhDNARIsAEcVALVoBovdV1Kwr-BhpFcymFkBxj9Ah83xcBMzOwM-ZkR46k9Zd-efOscaAiasEALw_wcB" target="_blank">Ayar Labs</a>, <a href="https://www.marvell.com/company/newsroom/nvidia-ai-ecosystem-expands-marvell-joins-forces-through-nvlink-fusion.html" target="_blank">Marvell Technologies,</a> and <a href="https://lightmatter.co/press-release/lightmatter-joins-nvidia-nvlink-fusion/" target="_blank">Lightmatter.</a></p><p>As AI needs grow, the number of GPUs and the bandwidth of connections between them continues to grow. Electrical links are being pushed toward terabit-per-second signaling. But higher frequencies increase attenuation, power consumption, and heat. To cope, copper cables must become shorter and thicker, making it more difficult to route them through crowded server racks. At the same time, Nvidia is planning to add even more processors to single interconnected systems, going from 72 GPUs today to as many as 576 by 2027.</p><p>“The physics of copper just changes as you increase the frequency of the signals going across that copper,” says Nvidia principal product marketing manager <a href="https://www.linkedin.com/in/jesseclayton/" rel="noopener noreferrer" target="_blank">Jesse Clayton</a>. “You can mitigate that by limiting the length of the cable, and right now all of our copper cabling is within that single NVL72 rack, so the distances aren’t that long, but we are getting close to the limits of what we can push.”</p><p>Engineers call this the “copper wall.” Many now believe that keeping up with AI will eventually require <a href="https://spectrum.ieee.org/optics-gpu" target="_self">moving optical interconnects</a> closer to the processors themselves.</p><h2>Bringing optics to the GPU</h2><p>To move data as light, engineers must figure out how to convert electrical signals into optical ones, then integrate lasers, photonic devices, and electronic chips into a single package without blowing up cost, power consumption, or manufacturing complexity.</p><p>Those hurdles are no longer insurmountable.</p><p>“More than any other time that I recall, I think it’s concluded that the <a href="https://spectrum.ieee.org/co-packaged-optics" target="_self">co-packaged optics</a> will happen,” says <a href="https://www.ee.columbia.edu/keren-bergman" rel="noopener noreferrer" target="_blank">Keren Bergman</a>, a professor of electrical engineering at Columbia University. </p><p>Ayar Labs, one of the photonics companies participating in the NVLink Fusion ecosystem, has developed optical <a href="https://spectrum.ieee.org/tag/chiplets" target="_self">chiplets</a> meant to sit alongside GPUs and other processors, converting electrical signals into light only millimeters from the compute silicon. “The most optimal way to do that is having a photonic chiplet with an electronic chiplet and having them hybrid bonded together,” says Ayar’s director of product management, <a href="https://www.linkedin.com/in/vishal-chan/" rel="noopener noreferrer" target="_blank">Vishal Chandrasekar</a>.</p><p>He argues that optical scale-up has become practical because the semiconductor manufacturing ecosystem has matured around co-packaged optics. Advances in <a href="https://spectrum.ieee.org/hybrid-bonding-2677022836" target="_self">hybrid bonding</a> now allow electronic and photonic chiplets to be manufactured separately, then integrated into a single optical engine that sits beside GPUs or switches. </p><p>“What has really happened in the last few years is that the process maturity coming out of the fabs has really improved,” Chandrasekar says. He believes the industry is now on a path toward high-volume optical scale-up systems within the next couple of years.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" rel="float: left;" style="float: left;"> <img alt="Rendering of a 3D photonic interposer with interconnects across the entire die area instead of the side of the package." class="rm-shortcode" data-rm-shortcode-id="0f97271bc08a66841dda0b8f4a6e5f72" data-rm-shortcode-name="rebelmouse-image" id="718d9" loading="lazy" src="https://spectrum.ieee.org/media-library/rendering-of-a-3d-photonic-interposer-with-interconnects-across-the-entire-die-area-instead-of-the-side-of-the-package.jpg?id=67114801&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Lightmatter has designed a 3D photonic connector with input and output ports across the entire chip area instead of only along the edges. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Lightmatter</small></p><p>Lightmatter has a different solution. Rather than placing optical chiplets beside processors, the company is building a photonic interposer that serves as the packaging substrate itself. The idea is that future processors could be stacked directly on top of a silicon photonics engine. Vice president of product <a href="https://www.linkedin.com/in/roy-kim-265986/" target="_blank">Roy Kim</a> describes these interposers and optical chiplets as “complementary steps in the photonics road map.”</p><p>According to Kim, packaging is no longer the main obstacle. With standard foundries and assembly partners, optical interconnects can now be manufactured, tested, and integrated in ways that look a lot more like conventional chip production, he says. </p><p>The remaining challenge is laser integration. Today’s pluggable laser modules take up valuable rack space and are hard to scale. Instead, Lightmatter is putting large numbers of lasers directly onto silicon, which Kim believes could soon support much denser optical scale-up fabrics.</p><h2>The future of optical scale-up</h2><p>Nvidia, for its part, is taking a gradual approach to adopting these technologies. Clayton says the company expects optics to move into scale-up networking eventually, as AI’s bandwidth requirements continue to grow.</p><p>“I think we’ve taken an approach of migrating to optical when it makes the most sense for our platform,” he says. “If you migrate the entire platform at once, you take a tremendous amount of risk on new designs. So, starting at the scale-out space, and then in the future moving to scale-up is kind of a sensible, measured approach from our perspective.”</p><p>That slow-and-steady attitude is one reason why some researchers view NVLink Fusion as more than an interoperability play. “The Fusion is sort of this umbrella—you can put copper in it, you can put photonics in it. It’s very photonics friendly,” Bergman says. Rather than committing Nvidia to a specific interconnect technology, she says, Fusion creates an ecosystem in which electrical and optical approaches can evolve side by side.</p><p>Not everyone expects photonics to become the only answer. Researchers continue to improve electrical interconnects through advances in signaling, packaging, and transceiver design. And other groups are pursuing <a href="https://spectrum.ieee.org/rf-over-fiber" target="_self">alternative</a> technologies. </p><p>Underneath all these advances is a bigger issue: Can optical scale-up become something the industry at large can do, rather than a proprietary feature of Nvidia’s ecosystem?</p><p>“Absolutely,” Chandrasekar says. “There are going to be multiple implementations in the 2028 time frame in very high volume.”</p><p>If that happens, future AI systems could span multiple racks while behaving as a single computing domain, connected via a mix of electrical, optical, and perhaps other emerging technologies.</p>]]></description><pubDate>Thu, 09 Jul 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/nvlink-fusion-optics</guid><category>Optical-networking</category><category>Data-centers</category><category>Nvidia</category><category>Gpu</category><dc:creator>Knvul Sheikh</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/a-gpu-equipped-with-a-scale-up-interconnect.jpg?id=67114792&amp;width=980"></media:content></item><item><title>Independent Labs Crack Google’s Secret Cryptography Work</title><link>https://spectrum.ieee.org/google-quantum-cryptography-zero-knowledge</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/conceptual-illustration-of-two-mirrored-hands-using-a-key-to-unlock-opposite-sides-of-the-same-bitcoin-token.jpg?id=67101548&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p>A quantum computer capable of breaking the codes that help secure today’s internet became dramatically more possible in March, when Google scientists and their colleagues unveiled new research. <span>Usually, cybersecurity researchers share information about how attacks work to help prevent them. This group, however, believed its discovery posed enough of a security risk for them to use an unprecedented strategy to conceal how exactly to replicate their research. </span></p><p><span></span><span>But in just three days, with the help of crowdsourcing and swarms of AI agents, Seattle-based research startup </span><a href="https://www.eigenlabs.org/" target="_blank">Eigen Labs</a><span> not only matched the results of that hidden work, but surpassed them.</span></p><p>In theory, <a href="https://spectrum.ieee.org/quantum-error-correction-2670337688" target="_self">quantum computers</a> can quickly find answers to problems it might take classical computers eons to solve, which has made them especially interesting for code breaking. Modern cryptography depends on the difficulty classical computers face when it comes to mathematical problems such as <a href="https://spectrum.ieee.org/encryptionbusting-quantum-computer-practices-factoring-in-scalable-fiveatom-experiment" target="_self">factoring huge numbers</a>. Using an<a href="https://spectrum.ieee.org/quantum-computers-will-speed-up-the-internets-most-important-algorithm" target="_self"> algorithm devised by mathematician Peter Shor in 1994</a>, quantum computers could in principle rapidly crack such encryption.</p><p>No quantum hardware capable of practical code breaking currently exists. However, labs worldwide are striving to build quantum computers with enough <a href="https://spectrum.ieee.org/qubit-supremacy" target="_self">qubits</a>—the quantum equivalent of the bits underlying classical  computing—to execute such attacks. The potential threat quantum computers pose has also led governments across the globe to begin migrating to post-quantum cryptography (PQC). U.S. federal agencies are required to transition high-value assets and high-impact systems to <a href="https://www.whitehouse.gov/presidential-actions/2026/06/securing-the-nation-against-advanced-cryptographic-attacks/" target="_blank">PQC</a> for key establishment schemes by the end of 2030. The findings from Google and Eigen Labs, experts say, are a clear demonstration that migrating to encryption resistant to quantum computers should take place as rapidly as possible.</p><h2>Preparing for Postquantum Cryptography</h2><p>To prepare for the era of <a href="https://spectrum.ieee.org/post-quantum-cryptography-2667758178" target="_self">cryptographically relevant quantum computers</a>, scientists regularly probe into what resources such devices might actually require. For example, in <a href="https://arxiv.org/abs/2505.15917" target="_blank">2025</a>, <a href="https://blog.google/security/tracking-cost-of-quantum-factori/" target="_blank">Google Quantum AI</a> research scientist <a href="https://algassert.com/about.html" target="_blank">Craig Gidney</a> revealed a quantum computer with less than 1 million qubits, running Shor’s algorithm for less than a week could break 2,048-bit RSA encryption, a common standard for securing online data. That was a 20-fold decrease in the number of qubits needed from <a href="https://arxiv.org/abs/1905.09749" target="_blank">previous estimates</a> made in 2019.</p><p>Gidney and others then investigated a different form of encryption involving <a href="https://spectrum.ieee.org/quantum-safe-crypto" target="_self">elliptic curve cryptography</a> (ECC). This approach underlies the security of cryptocurrencies such as <a href="https://spectrum.ieee.org/special-reports/the-highs-and-hazards-of-bitcoin/" target="_self">Bitcoin</a> and <a href="https://spectrum.ieee.org/ethereum-developer-explores-the-dark-side-of-bitcoininspired-technology" target="_self">Ethereum</a> and, with RSA, helps secure modern internet traffic.</p><p>On <a href="https://spectrum.ieee.org/quantum-safe-crypto" target="_self">30 March</a>, the Google researchers and their colleagues <a href="https://arxiv.org/abs/2603.28846" rel="noopener noreferrer" target="_blank">revealed</a> they optimized Shor’s algorithm to break 256-bit ECC with 1,200 to 1,450 <a href="https://spectrum.ieee.org/fault-tolerant-quantum-computing-milestone" target="_self">logical qubits</a>. (Qubits are currently error-ridden devices; a cluster of many “physical qubits,” the kinds that researchers have developed to date, can make up one useful “logical qubit.”) The researchers noted these quantum computations could be encoded with less than 500,000 superconducting physical qubits, cracking 256-bit ECC in 18 to 23 minutes. This again marked a nearly 20-fold reduction in the number of physical qubits previously estimated. (To date, the largest superconducting processor—<a href="https://spectrum.ieee.org/ibm-condor" target="_self">IBM’s Condor</a>—has 1,121 qubits.)</p><p class="pull-quote">“I knew we could do better but was not expecting that much improvement.” <span><strong>David Jao, University of Waterloo</strong></span></p><p>“The results were surprising to me,” says <a href="https://djao.math.uwaterloo.ca/" target="_blank">David Jao</a>, professor and chair of combinatorics and optimization at the University of Waterloo in Canada, who did not participate in this work. “I knew we could do better but was not expecting that much improvement.”</p><p>However, instead of fully explaining how they accomplished this advance, the scientists released their work using a “<a href="https://research.ibm.com/projects/zero-knowledge-proofs" target="_blank">zero-knowledge proof,</a>“ a technique with which they could verify to others than their attack works without revealing exactly how to carry it out. “To my knowledge, this was the first time that a result of this kind was released using a zero-knowledge proof,” says <a href="https://andreschrottenloher.github.io/" target="_blank">André Schrottenloher</a>, a researcher at the Inria Center at the University of Rennes in France, who did not take part in this study.</p><p>In a <a href="https://research.google/blog/safeguarding-cryptocurrency-by-disclosing-quantum-vulnerabilities-responsibly/" target="_blank">blog post</a>, Google noted it had concealed its results in this manner after talks with the U.S. government. Most experts consulted saw little point to this. For instance, although he thought “it was a cute way to use a zero-knowledge proof,” <a href="https://www.math.auckland.ac.nz/~sgal018/" target="_blank">Steven Galbraith</a>, professor and head of mathematics at the University of Auckland in New Zealand, does not think cryptographically relevant quantum computers “are around the corner.”</p><p>Others were more dismissive. “Zero-knowledge proofs for academic research are both useless and futile,” Jao says. “The purpose of the academic research enterprise is not merely to answer questions, but to inform the community and communicate those answers in a way that imparts understanding and allows other teams to build upon the results. A zero-knowledge proof does not convey or communicate understanding.”</p><h2>Replicating Google’s Results</h2><p>At Eigen Labs, 22-year-old engineer <a href="https://www.linkedin.com/in/gautham-anant" target="_blank">Gautham Anant</a> was enrolled in an introduction to quantum computing course at the <a href="https://www.washington.edu/" target="_blank">University of Washington</a>, and wanted to see if he could replicate Google’s results. By analyzing the virtual machine Google built to verify its findings, Anant created software to test any quantum circuit in terms of the number of qubits and gates it needed to defeat 256-bit ECC. Anant then, with help from another young engineer, <a href="https://www.linkedin.com/in/gajeshnaik/" target="_blank">Gajesh Naik</a>, set up AI agents to analyze scientific literature to automatically design quantum circuits and optimize them for this task.</p><p>On their own, Eigen Labs researchers could not develop a circuit as efficient as Google’s. So on 1 June, they debuted a site where anyone could point their agent at Eigen Labs’ public repository to design better circuits, with these agents able to exchange notes with each other about their work.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" rel="float: left;" style="float: left;"> <img alt="Selfie of two young adult Indian men smiling together in an office environment." class="rm-shortcode" data-rm-shortcode-id="2709b37265f94cfa816a0e67f5cb01cb" data-rm-shortcode-name="rebelmouse-image" id="b9835" loading="lazy" src="https://spectrum.ieee.org/media-library/selfie-of-two-young-adult-indian-men-smiling-together-in-an-office-environment.jpg?id=67101549&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Eigen Labs engineers Gautham Anant [back] and Gajesh Naik [front] used crowdsourcing and AI agents to match Google’s results. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Eigen Labs</small></p><p>“We had essentially two classes of people working on this—the people building these agents…and quantum scientists,” Anant says. “The quantum scientists can understand the edits the agents have made, and they understand the science in ways that can help the agents incorporate changes much faster than they would on their own.”</p><p>Within 8 hours, this crowdsourcing effort matched Google’s results. In about 72 hours, it surpassed Google. As of the end of June, this <a href="https://www.ecdsa.fail/" target="_blank">open network</a> can overcome 256-bit ECC with a circuit 47.5 percent more efficient than Google’s. “We absolutely did not expect to beat Google,” Anant says.</p><p>Independently, at the same time Eigen Labs launched its crowdsourcing effort, Schrottenloher <a href="https://arxiv.org/abs/2606.02235" target="_blank">published</a> results matching Google’s. It cited much of the same research the Google team likely did to achieve its findings. “I just put two and two together,” Schrottenloher says.</p><p>It was obvious that the Google results would eventually be replicated, Schrottenloher says. “Cryptography and algorithms research is curiosity-driven, and the Google Quantum AI paper generated a lot of curiosity,” he notes.</p><p><a href="https://people.ece.uw.edu/kannan_sreeram/" target="_blank">Sreeram Kannan</a>, Eigen Labs’s founder, believes agents that contributed to Eigen Labs’ effort clearly saw Schrottenloher’s work and used it to significantly improve their results. “That’s the pace at which science can work with an open network—results built on others’ research in minutes instead of months,” he says.</p><p>This mission to match Google’s results was almost a perfect test case for Eigen Labs’ approach, says <a href="https://sam-jaques.appspot.com/" target="_blank">Sam Jaques</a>, an assistant professor in the Department of Combinatorics and Optimization at the University of Waterloo. “It makes sense that AI is good at microscale optimization,” says Jaques, who did not take part in any of these studies. “The thing about these quantum circuits is that there are a lot of places to boost efficiency here and there that may be hard for a person to see.”</p><h2>A Test Case for Zero-Knowledge Proofs</h2><p>All in all, using zero-knowledge proofs for research may not have much benefit. “There is almost no situation in research where one research group is so far ahead of all the other research groups that they can keep novel results secret for long,” Jao says. “Research is an extremely competitive environment, and no team stays ahead of the curve for very long. I believe even classified research labs no longer hold any significant advantage over the research community at large.”</p><p>Given this experience, Gidney says in a blog post, “I don’t think it’s the right strategy moving forward” to publish such results with zero-knowledge proofs. “The benefits are negligible, and the costs are many. We should just publish openly.”</p><p>For Kannan, these new findings are the first major public proof of concept of Eigen Labs’ model of open agent-based science. “We want to create frameworks to help anyone innovate,” he says. “We see two pathways ahead—one where OpenAI and Anthropic use AI to do all of science, and the rest of us just consume the results, and another where we’re coordinating with agents and others to actively shape science with our ideas, skills, and expertise. The former just sounds so disastrous to me. We all want individual agency.”</p><p>Eigen Labs sees its agent-based open science is tackling far more than quantum AI. “We’ve lined up scientists in very different fields, such as materials science and biology, to tackle many different problems,” Kannan says. “We see the role of scientists as architecting the right problem for a community of agents to make progress on.”</p><p>When it comes to the security implications of all these results, “even before these results, the need to migrate to the PQC algorithms was imperative,” says <a href="https://www.nist.gov/people/dustin-moody" target="_blank">Dustin Moody</a>, a mathematician at the <a href="https://www.nist.gov/" target="_blank">National Institute of Standards and Technology</a> in Gaithersburg, Md., who did not take part in this research. The new results from Google, Eigen Labs, Schrottenloher, and others, he says, “seem like they are helping some people be more convinced they can’t put this off and should actually accelerate their migration plans. If an organization can migrate more quickly, it seems like a good idea to do so.”</p>]]></description><pubDate>Tue, 07 Jul 2026 13:30:01 +0000</pubDate><guid>https://spectrum.ieee.org/google-quantum-cryptography-zero-knowledge</guid><category>Google</category><category>Post-quantum-cryptography</category><category>Quantum-computing</category><category>Ai-agents</category><category>Cybersecurity</category><dc:creator>Charles Q. Choi</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/conceptual-illustration-of-two-mirrored-hands-using-a-key-to-unlock-opposite-sides-of-the-same-bitcoin-token.jpg?id=67101548&amp;width=980"></media:content></item><item><title>VHF Propagation: What Every RF Engineer Should Know</title><link>https://content.knowledgehub.wiley.com/understanding-vhf-very-high-frequency-propagation/</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/rohde-schwarz-logo-with-slogan-make-ideas-real-and-rs-monogram-in-diamond.png?id=67100642&width=980"/><br/><br/><p>A practical educational guide to common and uncommon VHF propagation modes, covering the <span>physics, range implications, and real-world behaviors engineers need to understand.</span></p><p>What Attendees will Learn</p><p>1. Why “line of sight” fails as a practical VHF planning model.</p><p>2. How refraction, reflection, diffraction, and scattering deliver or destroy signals where geometry alone cannot predict.3. How tropospheric refraction extends the VHF radio horizon roughly one-third beyond optical line of sight.</p><p>4. How temperature inversions form ducts that can carry VHF signals over 1,500 km.5. How sporadic E, meteor burst, and EME propagate VHF signals across hundreds to thousands of kilometers.</p><p>6. What frequency limits, distance ranges, and environmental triggers apply to each <span>propagation mode.</span></p><p>7. How to apply this knowledge to link budgeting, interference prediction, and contingency planning.</p><p><span><a href="https://content.knowledgehub.wiley.com/understanding-vhf-very-high-frequency-propagation/" target="_blank">Download this free whitepaper now!</a></span></p>]]></description><pubDate>Mon, 06 Jul 2026 13:54:01 +0000</pubDate><guid>https://content.knowledgehub.wiley.com/understanding-vhf-very-high-frequency-propagation/</guid><category>Vhf</category><category>Type-whitepaper</category><category>Propagation</category><category>Wireless-communication</category><dc:creator>Rohde &amp; Schwarz</dc:creator><media:content medium="image" type="image/png" url="https://assets.rbl.ms/67100642/origin.png"></media:content></item><item><title>As AI Reshapes Global Energy Systems, Melbourne Leads Through Engineering Collaboration</title><link>https://spectrum.ieee.org/ai-energy-systems-melbourne</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/glowing-digital-network-map-of-australia-and-surrounding-asia-pacific-region.png?id=66945530&width=1245&height=700&coordinates=0%2C0%2C0%2C1"/><br/><br/><p><em>This article is brought to you by <a href="https://www.melbournecb.com.au/?utm_source=ieee&utm_medium=editorial&utm_campaign=discover-melbourne-2026&utm_term=maveric&utm_content=link" rel="noopener noreferrer" target="_blank">Melbourne Convention Bureau (MCB)</a> supported by <a href="https://businessevents.australia.com/en" target="_blank">Business Events Australia</a>.</em></p><p><span>As artificial intelligence accelerates global demand for compute, a parallel constraint is emerging with equal urgency: energy.</span></p><p>From hyperscale data centers to electrified industries, AI is driving a step change in electricity demand. This is not a future challenge, it is a present, system-level issue requiring coordinated action across energy, infrastructure, and engineering disciplines.</p><p>Around the world, the question is no longer whether AI will scale, but whether energy systems can scale with it.</p><p>Melbourne, Australia is moving beyond participation to become a globally connected leader helping define how these challenges are addressed.</p><h2>A national challenge with global implications</h2><p>Australia’s ambition to lead in artificial intelligence is sharpening focus on the infrastructure required to support it. Data centers are projected to account for up to <a href="https://www.cefc.com.au/media/hs5ner3s/getting-the-balance-right-data-centres-and-the-energy-transition-full-report.pdf" target="_blank"><span>11 percent</span></a> of the nation’s electricity consumption by 2035, placing increasing pressure on generation, transmission, and system reliability.</p><p>At the same time, <a href="https://ieee-pes.org/climate-change/the-future-of-energy-quantified-2026-global-member-survey-results/" target="_blank"><span>insight from the IEEE Power and Energy Society (PES)</span></a> highlights that meeting energy demand from AI and digital infrastructure is one of the most significant challenges facing engineers over the next decade.</p><p>The implications are clear. In addition to computing challenges, AI poses major energy systems challenges.</p><p class="pull-quote">“As artificial intelligence continues to scale globally, the challenge is no longer just computational power, it is the energy systems required to support it” <strong>—Professor Thas (Ampalavanapillai) Nirmalathas, University of Melbourne</strong></p><h2>Why Melbourne is leading on the global stage</h2><p>Victoria has developed one of the most advanced and integrated energy ecosystems in Australia and globally, spanning renewable generation, battery storage, grid modernization, and advanced materials.</p><p>What distinguishes Melbourne globally is how these capabilities are connected and applied at system scale.</p><p>The city brings together world class engineering research, a rapidly evolving clean energy sector, advanced digital infrastructure, and strong alignment between government, industry, and academia. This convergence is critical in the AI era, where energy, networks and computing systems must be designed together.</p><p>Victoria’s coordinated investment across these areas is positioning Melbourne not only as a national leader, but also as a reference point in the global energy system transformation.</p><h2>Engineering the systems behind the AI economy</h2><p>The challenge ahead is that generating more power won’t be enough, as engineers need to design systems that respond dynamically to new patterns of demand.</p><p>Three priorities are emerging globally:</p><ul><li>Aligning data center development with grid capacity and renewable supply</li><li>Embedding flexibility through storage, demand response, and system optimization</li><li>Balancing digital growth with decarbonization and long-term reliability</li></ul><p>Addressing these priorities requires engineering expertise to be embedded earlier in planning ensuring energy systems, digital infrastructure, and policy are designed in parallel.</p><p>Melbourne’s strength lies in its ability to integrate this expertise across research, infrastructure, and real-world application.</p><p class="shortcode-media shortcode-media-rebelmouse-image image-crop-custom"> <img alt="Crowd mingling in a modern glass courtyard during an outdoor social event" class="rm-shortcode" data-rm-shortcode-id="6d59a3228ed2e819398447ea955abc07" data-rm-shortcode-name="rebelmouse-image" id="e734f" loading="lazy" src="https://spectrum.ieee.org/media-library/crowd-mingling-in-a-modern-glass-courtyard-during-an-outdoor-social-event.jpg?id=66945563&width=2000&height=1335&quality=100&coordinates=0%2C606%2C0%2C0"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Melbourne Connect is a University of Melbourne–led innovation precinct, supported by government and industry, designed to bring together research, business and policy to deliver real-world solutions.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Atlantic Group</small></p><h2>Research leadership shaping global solutions</h2><p>At the centre of this capability is the <a href="https://www.unimelb.edu.au/" target="_blank"><span>University of Melbourne</span></a>, where interdisciplinary research is advancing the systems required to support AI driven energy demand.</p><p>Through the Melbourne Energy Institute, for example, researchers are examining how energy technologies interact across entire systems from generation and networks through to end use.</p><p>“As artificial intelligence continues to scale globally, the challenge is no longer just computational power, it is the energy systems required to support it,” says <a href="https://about.unimelb.edu.au/leadership/senior-leadership/dean-feit" target="_blank">Professor Thas (Ampalavanapillai) Nirmalathas</a>, Dean of the Faculty of Engineering and Information Technology at the University of Melbourne.</p><p>“This is driving a new level of convergence between digital infrastructure and power systems engineering, where integrated, system level thinking is essential.”</p><h2>Converging energy, networks and AI</h2><p>Melbourne’s leadership is further strengthened by world-class interdisciplinary facilities such as the <a href="https://electrical.eng.unimelb.edu.au/power-energy/smart-grid-lab" target="_blank"><span>Smart Grid Lab</span></a> in the Department of Electrical and Electronic Engineering, which enables real-time simulation of power systems, allowing engineers to test how solar, batteries, electric vehicles and other distributed resources interact within future grids. This supports the design of more resilient, efficient energy systems before they are deployed at scale.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Control room with server racks, workstations, and a large grid monitoring display." class="rm-shortcode" data-rm-shortcode-id="26c2b42a204f901444b87d17ac31a351" data-rm-shortcode-name="rebelmouse-image" id="b628c" loading="lazy" src="https://spectrum.ieee.org/media-library/control-room-with-server-racks-workstations-and-a-large-grid-monitoring-display.jpg?id=67073323&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Melbourne’s Smart Grid Lab in the Department of Electrical and Electronic Engineering enables real-time simulation of power systems. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">University of Melbourne</small></p><p>These capabilities will become increasingly important as data centers are integrated into the grid.</p><p><span>“AI driven demand is not only increasing computing requirements, but also placing new pressures on underlying energy systems,” says <a href="https://findanexpert.unimelb.edu.au/profile/1024365-glen-farivar" target="_blank">Glen Farivar</a>, Senior Lecturer in Power Electronics at the University of Melbourne. “Designing these systems together is essential to achieving both performance and sustainability outcomes.”</span></p><p>This reflects a critical shift. Future infrastructure must be co designed across energy and digital systems, not developed in isolation.</p><h2>A living ecosystem delivering real-world outcomes</h2><p>Victoria’s broader energy ecosystem is translating these insights into practice.</p><p>Investment in renewable energy, grid infrastructure and storage is enabling higher levels of clean energy while maintaining reliability. Battery deployment is supporting the flexibility needed to manage both renewable variability and growing AI-driven demand.</p><p>At its core, Melbourne offers an integrated environment where research, industry and government collaborate to solve complex system challenges.</p><h2>Why engineering collaboration matters</h2><p>Solving the energy demands of the AI era cannot be achieved in isolation.</p><p>It requires engineers, researchers, utilities, and policymakers to work together earlier and more often. More than ever, engineering collaboration is a critical enabler of future energy systems.</p><p>Environments that bring together global expertise are becoming essential to how solutions are designed and delivered.</p><p class="pull-quote">“Developing future energy systems that are affordable, sustainable, and resilient is a truly grand challenge” <strong>—Professor Pierluigi Mancarella, University of Melbourne</strong></p><p>In this context, the University of Melbourne is co-leading, alongside Johns Hopkins University and Imperial College London, one of only seven <a href="https://www.unimelb.edu.au/newsroom/news/2023/september/new-global-research-centre-to-provide-epic-clean-energy-boost" target="_blank"><span>Global Centres in Climate Change and Clean Energy</span></a>. Through the Electric Power Innovation for a Carbon Free Society (EPICS) Centre, the University is also the Australian technical lead in advancing future energy systems, with EPICS the only Global Centre focused on future energy infrastructure.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Large solar farm in green fields with wind turbines on the horizon under blue sky" class="rm-shortcode" data-rm-shortcode-id="94edf23073999ffbd9272ddc574e4f1c" data-rm-shortcode-name="rebelmouse-image" id="29346" loading="lazy" src="https://spectrum.ieee.org/media-library/large-solar-farm-in-green-fields-with-wind-turbines-on-the-horizon-under-blue-sky.jpg?id=66945577&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">The new Electric Power Innovation for a Carbon-Free Society (EPICS) Centre will address challenges in clean energy production and storage.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">University of Melbourne</small></p><p><span>“Developing future energy systems that are affordable, sustainable, and resilient is a truly grand challenge,” says <a href="https://energy.unimelb.edu.au/about-us/our-team/executive/pierluigi-mancarella" target="_blank">Professor Pierluigi Mancarella</a>, Chair Professor of Electrical Power Systems at the University of Melbourne and Australian director and international co-director of EPICS.</span></p><p>“As electricity grids are increasingly becoming the backbone of future energy systems, optimizing their interactions with other sectors, including AI and digitalization, and fostering interdisciplinary and international collaborations are essential,” he adds.</p><h2>Global conferences as part of the solution</h2><p>International conferences are increasingly recognized as critical platforms for advancing engineering solutions at scale. Melbourne’s ability to convene global expertise is central to its leadership.</p><p>In 2027, the city will host the <a href="https://www.ieeegtd2027.org" target="_blank"><span>IEEE PES Generation Transmission and Distribution (GTD) Asia 2027</span></a> Conference and Exposition, bringing together engineers, utilities, researchers and policymakers from across the world to address the challenges shaping the future of power systems.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Four men pose at a 2025 GTD conference booth with energy-themed backdrop." class="rm-shortcode" data-rm-shortcode-id="9155eae80ac2c5f8e9278b96832fb3ef" data-rm-shortcode-name="rebelmouse-image" id="24eaf" loading="lazy" src="https://spectrum.ieee.org/media-library/four-men-pose-at-a-2025-gtd-conference-booth-with-energy-themed-backdrop.jpg?id=66945590&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">IEEE PES GTD Asia 2027 Melbourne Committee (left to right): Dr. Mehdi Ghazavi Dozein (Monash University), Dr. Glen Farivar & Professor Pierluigi Mancarella (University of Melbourne) , Dr. Mohammad Mohammadi (Australian Energy Market Operator (AEMO)).</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">MCB</small></p><p><span>“Melbourne offers a unique environment where world-class research, industry capability and policy leadership come together,” notes the IEEE PES GTD Asia 2027 Local Organising Committee, which includes Professor Pierluigi Mancarella and Dr. Glen Farivar from the University of Melbourne, as well as Dr. <a href="https://www.monash.edu/engineering/mehdighazavidozein" target="_blank">Mehdi Ghazavi Dozein</a> of Monash University and Dr. Mohammad Mohammadi of the Australian Energy Market Operator.</span></p><p>“Hosting this event creates an opportunity to advance global collaboration on the systems and technologies required to deliver the energy transition at scale.”</p><p>These forums enable knowledge exchange, standards development and interdisciplinary collaboration, accelerating progress on complex engineering challenges.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Two people view a circular digital art installation of glowing screens and green light." class="rm-shortcode" data-rm-shortcode-id="733f97dd75ad977c8ffe833833c62e74" data-rm-shortcode-name="rebelmouse-image" id="9b439" loading="lazy" src="https://spectrum.ieee.org/media-library/two-people-view-a-circular-digital-art-installation-of-glowing-screens-and-green-light.jpg?id=66986093&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Attendees view a digital installation at AIME 2025 at Melbourne Connect.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">MCB</small></p><h2>Why Melbourne, and why now</h2><p>As AI, electrification and digital infrastructure converge, the future of global energy systems will depend on the ability of engineers to collaborate and innovate at scale.</p><p>Melbourne provides a proven platform for that collaboration, combining world-class research, a rapidly evolving energy ecosystem, and the infrastructure to connect global expertise.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Group standing with award outside historic brick building and garden walkway" class="rm-shortcode" data-rm-shortcode-id="7f75d2c90839db5861612d3ed8fef1f3" data-rm-shortcode-name="rebelmouse-image" id="6eed5" loading="lazy" src="https://spectrum.ieee.org/media-library/group-standing-with-award-outside-historic-brick-building-and-garden-walkway.jpg?id=66945594&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Melbourne Convention Bureau, IEEE Communications Society, and University of Melbourne Representatives.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">University of Melbourne</small></p><p><span>For IEEE members, hosting a conference in Melbourne is more than an event decision.</span></p><p>It is an opportunity to engage with a globally connected engineering community and contribute directly to solving one of the most significant challenges facing the profession today.</p><p>Through the support of the <a href="https://www.melbournecb.com.au/contact-us?utm_source=ieee&utm_medium=editorial&utm_campaign=discover-melbourne-2026&utm_term=power-and-energy&utm_content=contact-us" target="_blank"><span>Melbourne Convention Bureau</span></a>, professionals can access tailored, free support to bid for and deliver international conferences, bringing global expertise together in a city actively shaping the future of energy systems.</p><p><strong>To explore hosting your next conference in Melbourne, contact the Melbourne Convention Bureau at info@melbournecb.com.</strong></p>]]></description><pubDate>Wed, 01 Jul 2026 16:01:27 +0000</pubDate><guid>https://spectrum.ieee.org/ai-energy-systems-melbourne</guid><category>Artificial-intelligence</category><category>Australia</category><category>Energy-systems</category><category>University-of-melbourne</category><category>Ai-data-centers</category><category>Power-grid</category><dc:creator>Melbourne Convention Bureau</dc:creator><media:content medium="image" type="image/png" url="https://spectrum.ieee.org/media-library/glowing-digital-network-map-of-australia-and-surrounding-asia-pacific-region.png?id=66945530&amp;width=980"></media:content></item><item><title>The Trump Administration Doubles Down on Quantum</title><link>https://spectrum.ieee.org/quantum-computing-trump-executive-orders</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/a-rectangular-glass-cell-built-for-use-in-neural-atom-quantum-computers.jpg?id=67048696&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p>On 22 June, President Donald Trump signed two executive orders focused on quantum computing:<a href="https://www.whitehouse.gov/presidential-actions/2026/06/ushering-in-the-next-frontier-of-quantum-innovation/" rel="noopener noreferrer" target="_blank"> </a>The first aims to <a href="https://www.whitehouse.gov/presidential-actions/2026/06/ushering-in-the-next-frontier-of-quantum-innovation/" rel="noopener noreferrer" target="_blank">accelerate the development</a> of quantum computers, sensors, and networks. The other seeks to <a href="https://www.whitehouse.gov/presidential-actions/2026/06/securing-the-nation-against-advanced-cryptographic-attacks/" rel="noopener noreferrer" target="_blank">accelerate the timeline</a> for migrating critical infrastructure to cryptographic schemes that are immune to quantum attacks. In response, the U.S. Department of Energy (DOE) has <a href="https://www.energy.gov/science/articles/energy-department-announces-initiative-create-and-deploy-worlds-first" rel="noopener noreferrer" target="_blank">committed</a> to deploy “the world’s first fault-tolerant, scientifically relevant quantum computer” by the ambitious deadline of 2028.</p><p>“It feels like everything is happening all at once, which is great,” says <a href="https://www.linkedin.com/in/pgokhale/" rel="noopener noreferrer" target="_blank">Pranav Gokhale</a>, chief technology officer and co-founder of quantum company <a href="https://infleqtion.com/" rel="noopener noreferrer" target="_blank">Infleqtion</a>.</p><p>“I think this executive order is in many ways a continuation of what’s been going on since 2018, when the first <a href="https://www.congress.gov/bill/115th-congress/house-bill/6227" rel="noopener noreferrer" target="_blank">National Quantum Initiative Act</a> was passed,” says <a href="https://physics.illinois.edu/people/directory/profile/goldschm" rel="noopener noreferrer" target="_blank">Elizabeth Goldschmidt</a>, associate professor of physics at the University of Illinois Urbana-Champagne (UIUC). “It revives and continues a lot of things that have happened since. I think it’s very ambitious, but there’s a lot of very good stuff in here.”</p><p><em><em>IEEE Spectrum</em></em> spoke to experts about these policy initiatives and how they reflect and shape the United States’ quantum capabilities for the next few years.</p><h2>How realistic is the 2028 deadline for a fault-tolerant quantum computer?</h2><p>Here, the devil is in the details. A fault-tolerant quantum computer is one that can correct mistakes that happen naturally, and inevitably, during computations. Fault tolerance is achieved through quantum error correction, a way to make fragile quantum bits (qubits) robust against noise. This is generally done by encoding a single bit of quantum information into a collection of physical qubits, called a logical qubit. For a quantum computer to be useful, it would need to be able to do operations on many such logical qubits, and actively correct errors in the process.</p><p>The DOE is aiming for quantum computers with logical qubits “numbering in the low hundreds.” The current record holders are the companies <a href="https://www.quera.com/" rel="noopener noreferrer" target="_blank">QuEra</a>, <a href="https://www.nature.com/articles/s41586-025-09848-5" rel="noopener noreferrer" target="_blank">claiming 96</a> logical qubits, and <a href="https://www.quantinuum.com/" rel="noopener noreferrer" target="_blank">Quantinuum</a>, <a href="https://arxiv.org/abs/2602.22211" rel="noopener noreferrer" target="_blank">claiming 94</a>. The low hundreds threshold is already a 2028 target on several companies’ roadmaps, including <a href="https://www.quera.com/our-quantum-roadmap" rel="noopener noreferrer" target="_blank">QuEra</a>, <a href="https://www.ionq.com/roadmap" rel="noopener noreferrer" target="_blank">IonQ</a>, and <a href="https://www.ibm.com/quantum/blog/large-scale-ftqc" rel="noopener noreferrer" target="_blank">IBM</a>. But not all logical qubits are created equal.</p><p class="pull-quote">“How <em><em>much</em></em> more stable these logical qubits would be remains a very open question.” <strong>—Edward Parker, Rand Corporation</strong><strong></strong></p><p>“Originally, the idea of a logical qubit was that, once your physical qubits were better than a certain threshold, then you should be able to correct all errors in the [logical] qubit, which basically means that your qubit would be everlasting,” says <a href="https://umdphysics.umd.edu/people/faculty/current/item/454-jaydsau.html" rel="noopener noreferrer" target="_blank">Jay Sau</a>, professor of physics at the University of Maryland. “Now, a ‘logical qubit’ seems to be a collection of qubits that is somewhat better than one qubit, and I’m not sure that the use for such logical qubits is as obvious.”</p><p>Others argue that these imperfect logical qubits may still have useful applications. Even if a logical qubit isn’t everlasting, if it lasts long enough without errors to run a particular algorithm, it’ll do the trick. </p><p>“I think that achieving hundreds of logical qubits by 2028 is plausible,” says <a href="https://www.linkedin.com/in/edward-parker-753b77159/" rel="noopener noreferrer" target="_blank">Edward Parker</a>, senior physical scientist at the <a href="https://www.rand.org/" rel="noopener noreferrer" target="_blank">Rand Corporation</a>. “These will not be perfect logical qubits that are capable of sustaining very long computations. These logical qubits would be somewhat more stable than their underlying constituent physical qubits, but still noisy. How <em><em>much</em></em> more stable these logical qubits would be remains a very open question.”</p><p>The DOE’s stated goal is a “scientifically relevant” quantum computer—one that can answer scientific questions that would be prohibitively difficult to answer with current supercomputers.</p><p>“I cannot think of a [scientific] question that a quantum computer can help with in 2028, unless there is a serious breakthrough in device quality,” Maryland’s Sau says.</p><p>Infleqtion’s Gokhale disagrees. “100 logical qubits is where we see the advantage” for two scientific models, he says: One that <a href="https://arxiv.org/pdf/2604.19735" rel="noopener noreferrer" target="_blank">underlies magnetism</a> and one that potentially underlies <a href="https://arxiv.org/pdf/2604.01376" rel="noopener noreferrer" target="_blank">high-temperature superconductivity</a>.</p><h2>Will quantum computers be commercially successful by 2028?</h2><p>Being able to solve scientific problems is inherently valuable, but <a href="https://www.linkedin.com/in/carlwilliams7/" rel="noopener noreferrer" target="_blank">Carl Williams</a>, quantum industry consultant at his company <a href="https://cjwquantum.com/" rel="noopener noreferrer" target="_blank">CJW Quantum Consulting</a> and former deputy director at the U.S. National Institute of Standards and Technology, argues the scientific applications will not cover the billions of dollars that have gone into quantum research and development so far. For that, Williams says, commercial applications are needed.</p><p>“I think for materials, quantum chemistry, and pharmaceuticals, we may see the first economically viable computations in 2028 or 2029,” Williams says. “Note, this is different from saying that the businesses will be cash positive. I suspect that will occur in the early 2030s and probably by 2032. I think there are other applications, such as machine learning and optimization, that will require a much larger quantum computer.”</p><p class="pull-quote">“I cannot think of a [scientific] question that a quantum computer can help with in 2028, unless there is a serious breakthrough in device quality.” <strong>—Jay Sau, University of Maryland</strong></p><p>Infleqtion’s Gokhale also believes that commercial applications are within close reach. “I think that materials discovery is a little bit further than the science problems, but not that much further, and the demand on the commercial side is going to be larger dollar amounts than what scientists can pay for.”</p><p>Gokhale also argues that the costs of running a quantum machine, particularly a <a href="https://spectrum.ieee.org/neutral-atom-quantum-computing" target="_self">neutral-atom based machine</a> such as Infleqtion’s, are dropping rapidly. “The build material cost that we’re seeing is incredibly favorable for not just building one quantum computer but having a data center with tens, if not hundreds of quantum computers. We expect that the market will support cloud-based deployments too.”</p><h2>What’s the deal with quantum sensors?</h2><p>The executive order also directs the Secretary of Defense to identify three quantum sensor technologies that can be ready for use by 2028. The experts <em><em>IEEE Spectrum </em></em>spoke to seemed to not only think this is likely feasible, but also have good candidates for what those sensor technologies should be. Top candidates include inertial navigation without GPS, <a href="https://spectrum.ieee.org/quantum-gravity-sensor" target="_self">gravity measurement</a> for navigation or for underground surveying, and <a href="https://spectrum.ieee.org/quantum-sensors-space" target="_self">magnetic measurements</a> for navigation or anomaly detection.</p><p>Almost everyone agreed that <a href="https://spectrum.ieee.org/optical-atomic-clocks" target="_self">optical atomic clocks</a>—higher-precision timing devices that may enable more precise GPS—were a prime candidate for such a sensor. “Those are already deployed and just being refined to fit into mission architectures,” Gokhale says.</p><p>Another potential candidate is <a href="https://www.everythingrf.com/community/what-is-quantum-rf-sensing" rel="noopener noreferrer" target="_blank">sensing extremely weak radio-frequency signals</a> using individual atoms, ions, or other qubit-like structures.</p><p>“I like that the specific quantum sensors have been targeted,” UIUC’s Goldschmidt says. “The Department of Defense has always been active about pursuing quantum sensing, because of the importance, in particular, of things like position navigation and timing. I would love to see more thought going into using quantum sensors in various other places.”</p><h2>Does the U.S. have the workforce necessary?</h2><p>The executive order also puts a strong emphasis on developing the quantum workforce within the United States. The quantum computing field still relies heavily on holders of quantum physics–related doctorates, although many people with other engineering skills are also <a href="https://spectrum.ieee.org/quantum-computing-jobs" target="_self">needed</a>.</p><p>“If you go look at the <a href="https://quantumconsortium.org/publication/2026-state-of-the-global-quantum-industry-report/" rel="noopener noreferrer" target="_blank">QED-C’s state of the quantum report</a> from this year, you see how many job openings remain,” Williams says. “There’s nothing surprising about the number of openings that remain. We didn’t really start trying to refill our pipeline until 2018, two or three years too late. It’s five years to get a Ph.D. And then if you start doing things to discourage people from coming to the U.S., or make it harder for them to get in or get an H1B visa, all you do is make the problem worse. You don’t help the problem by being unwelcoming.”</p><p>“We’ve had our fair share of successes [in hiring], but also our fair share of just roles that have been unfilled for weeks, if not months and months,” Infleqtion’s Gokhale says. “Now, the flip side is we do think quantum is reaching the point where we can reduce our reliance on the Ph.D. types and start moving to more manufacturing engineering, and where we see really bright spots are, for instance, community colleges.”</p><h2>What about the threat posed by quantum computers to cryptography?</h2><p>Despite having potential scientific and commercial advantages, future quantum computers also pose a novel threat: They can be used to <a href="https://spectrum.ieee.org/post-quantum-cryptography-2667758178" target="_self">break certain types of cryptography</a> that are in common use today. Luckily, cryptographic protocols that are immune to quantum attacks, known as post-quantum cryptography, exist and have been <a href="https://spectrum.ieee.org/post-quantum-cryptography-2668949802" target="_self">standardized</a> by NIST.</p><p>Trump’s post-quantum cryptography executive order accelerates the timeline for this transition to either 2030 or 2031, from a previous <a href="https://bidenwhitehouse.archives.gov/briefing-room/statements-releases/2022/05/04/national-security-memorandum-on-promoting-united-states-leadership-in-quantum-computing-while-mitigating-risks-to-vulnerable-cryptographic-systems/" rel="noopener noreferrer" target="_blank">Biden-era deadline</a> of 2035. This is likely a reaction to several recent developments that have brought the <a href="https://spectrum.ieee.org/quantum-safe-crypto" target="_self">quantum threat</a> <a href="https://arxiv.org/abs/2509.13247" rel="noopener noreferrer" target="_blank">closer to reality</a> than previously thought.</p><p class="pull-quote">“If you start doing things to discourage people from coming to the U.S., or make it harder for them to get in or get an H1B visa, all you do is make the problem worse.” <strong>—Carl Williams, CJW Quantum Consulting</strong></p><p>“It is difficult to accurately predict whether and when a cryptography-breaking quantum computer will emerge,” says <a href="https://web.eecs.umich.edu/~cpeikert/" rel="noopener noreferrer" target="_blank">Chris Peikert</a>, professor of computer science and engineering at the University of Michigan and chief scientific officer at cryptocurrency <a href="https://algorand.co/" rel="noopener noreferrer" target="_blank">Algorand</a>. “But the larger question is one of risk: What are the chances that one will be built by 2028? By 2030? By 2034? The cost and timeline of migrating must be weighed against the chance of a catastrophic break occurring before the migration is complete. The recent progress increases that risk, so the migration should be accelerated.”</p><p>“The biggest priority in the transition is securing critical national infrastructure, where systems have long life cycles and vulnerable cryptography presents an unacceptable national security risk,”<a href="https://www.maths.ox.ac.uk/people/ali.elkaafarani" rel="noopener noreferrer" target="_blank"> Ali El Kaafarani</a>, chief executive officer and founder at post-quantum cryptography provider <a href="https://pqshield.com/" rel="noopener noreferrer" target="_blank">PQShield</a>, wrote via email. “This transition needs to happen at the government level, so the EO is a welcome intervention. It’s also worth noting that this isn’t the steepest timeline change we have seen: Google and Cloudflare have already set 2029 implementation deadlines, and the supply chain will now need to follow their lead as well. Quantum readiness is now an active compliance milestone, and the tightened timelines are only feasible if the boardroom makes migration a priority. The time to build strategic roadmaps is now.”</p><p>“Yeah, we should probably get on that,” Goldschmidt says.</p>]]></description><pubDate>Tue, 30 Jun 2026 12:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/quantum-computing-trump-executive-orders</guid><category>Quantum-computing</category><category>Trump-administration</category><category>Quantum-computers</category><category>Quantum-sensors</category><dc:creator>Dina Genkina</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/a-rectangular-glass-cell-built-for-use-in-neural-atom-quantum-computers.jpg?id=67048696&amp;width=980"></media:content></item><item><title>Why Does a Bank Need a Chief Scientist?</title><link>https://spectrum.ieee.org/capital-one-science-ai-finance-innovation</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/silhouetted-team-working-on-laptops-in-a-glass-walled-office-at-sunset.jpg?id=66903903&width=1245&height=700&coordinates=9%2C0%2C9%2C0"/><br/><br/><p><em>This article is brought to you by <a href="https://capitalone.science/" target="_blank">Capital One</a>.</em></p><p>After five years leading natural language understanding and eventually the entire Alexa AI organization at Amazon, Prem Natarajan made a nontraditional move: He became Chief Scientist at a bank. Not just any bank: Capital One, a financial institution serving over 100 million customers, helping everyday Americans manage their financial lives.</p><p>For Natarajan, a veteran of DARPA-funded research and academia who had watched machine learning evolve from task-specific applications to foundation models, the logic was clear. Some of the most interesting advances in AI research and deployment were shifting from big tech’s horizontal platforms to industry verticals like finance, where the most complex problems aren’t just building models but making AI work under the constraints of real-world customer problems, contextual business knowledge, continuous learning, with an incredibly high bar for accuracy and privacy.</p><p>That’s also what made Capital One the right place to do it. For decades, the company has been recognized as one of the most data- and analytics-driven financial institutions in the industry. Its business model from the very beginning was built around using data and technology to personalize financial products for customers. A decade ago, Capital One went all in on the cloud and rebuilt its data ecosystem, creating a unified environment for data, compute, and AI and machine learning experimentation. Today, its modern infrastructure, disciplined approach to governance, and deep bench of talent form the foundation that allows it to lead in enterprise AI.</p><p class="pull-quote">Advances in AI research and deployment are shifting from big tech’s horizontal platforms to industry verticals like finance.</p><p>So, why does a bank need a Chief Scientist? The answer lies in a fundamental misconception about AI in financial services. Most financial institutions still view AI as a technology to deploy – leveraging the latest large language model, deploying it through APIs, and integrating it into existing workflows – rather than a scientific discipline. Capital One is doing something different: building a scientific community and research organization to solve real-world customer problems and invent impactful AI solutions that don’t yet exist.</p><p>While widely available foundation models can handle general tasks, they can’t yet solve many domain-specific challenges, such as detecting fraud in real-time across billions of transactions, or providing state-of-the-art conversational tools so customers can engage when, how, and where they want to.</p><p>These challenges of making AI reliable, scalable, and well governed require original research and scientific innovation that is funneled back into the business to create real-world applications to address customer needs.</p><h2>The Constraints That Demand Innovation</h2><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Headshot of a suited man against a blue gradient background." class="rm-shortcode" data-rm-shortcode-id="475a0428edb65d212e3d3fb25a5b0e64" data-rm-shortcode-name="rebelmouse-image" id="9449b" loading="lazy" src="https://spectrum.ieee.org/media-library/headshot-of-a-suited-man-against-a-blue-gradient-background.jpg?id=66904023&width=980"/><small class="image-media media-caption" placeholder="Add Photo Caption...">Prem Natarajan, an IEEE Fellow, is Chief Scientist at Capital One. “If you want to solve really important problems in AI and see your work come to life, this is one of the few places you can do that,” he says.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Capital One</small></p><p>Because banks are dealing with people’s finances, there is an incredibly high bar for getting it right when it comes to AI. Take fraud, for example. Even a minor fraud event can have a devastating impact on certain customers. The best fraud models and platforms can detect and help mitigate fraud in the time it takes someone to tap their card, which is table stakes for protecting customers and their financial information with accuracy and speed. <span>Looking at these types of challenges, Capital One and Natarajan saw that serving millions of customers meant solving AI problems at a scale and complexity that many enterprises don’t encounter. These same constraints create a unique research environment.</span></p><p>At Capital One, the approach to building AI is to provide value to customers in ways never possible before, improving their financial lives and meeting them where they are with services they actually need. That focus, combined with massive scale and world-class risk management requirements, makes the scientific problems both harder and just as consequential as those found in most big tech labs.</p><h2>Advancing AI Through “Destination-Back Thinking”</h2><p><a href="https://www.capitalone.com/tech/ai-research/" target="_blank">Capital One’s approach to AI research and innovation</a> starts with what Natarajan calls “destination-back thinking.” Rather than asking what’s possible with current technology, the team envisions the customer experience they want to deliver – perhaps a car buyer who works long days and can only research the options at 10 p.m., or a customer facing an unexpected expense who needs immediate, personalized guidance – and then works backward to identify the scientific breakthroughs required to get there.</p><p>“You’re thinking back from where you’re providing incredibly valuable services,” Natarajan explains. “Once you have that vision clearly, you work back and say, what are the gaps? What are the things we need to invent?” This ensures that when problems are solved, the impact is essentially guaranteed, because the team has already identified what will make a tangible difference in customers’ lives.</p><p>But methodology alone isn’t enough. Capital One’s nearly 15-year bet on cloud-first architecture created something rare in financial services: a unified data and compute ecosystem that can support the kind of scientific experimentation typically seen in big tech research labs. As the only major U.S. bank to go all-in on public cloud infrastructure, Capital One eliminated the legacy systems that can constrain AI research at most financial institutions. This modern tech stack enables rapid iteration, large-scale model training, and what Natarajan calls “continuous learning,” systems that improve after deployment rather than degrading over time. This unique approach to infrastructure is a critical component in making new categories of research possible.</p><h2>Agentic AI: From Research to Production</h2><p>The research agenda manifests in systems already serving customers. Early last year, Capital One launched what may be the first fully agentic AI customer service experience built entirely in-house by a bank: a car buying tool that takes actions on behalf of customers based on their requests, not just answers questions. Behind it lies extensive research into multi-agentic AI reasoning systems that can navigate real-time data, business knowledge, constraints, and guardrails, with various agents that can work together to accomplish complex tasks.</p><p class="pull-quote">Capital One has launched a fully agentic AI customer service experience powered by extensive research into multi-agentic reasoning systems that can navigate real-time data.</p><p>The team is also working on solving things like tokenization challenges, protecting sensitive data while enabling model training. To accelerate this cutting-edge work, Capital One has established partnerships with Columbia University, the University of Southern California, and the University of Illinois, and became the only bank funding NSF’s national AI research centers <a href="https://www.nsf.gov/news/nsf-announces-100-million-investment-national-artificial" target="_blank"><span>in 2025</span></a>, investing millions in initiatives that span mental health, materials discovery, science, technology, engineering, and mathematics education, human-AI collaboration, and drug development.</p><p>In the spring of 2026, the company hosted its inaugural <a href="https://www.capitalone.com/tech/ai/2026-capital-one-ai-symposium/" target="_blank"><span>AI Symposium</span></a> to deepen connections and foster insight-sharing between the scientific AI community, leading AI labs, startups, and its own technology, science, and AI leaders and partners.</p><h2>Building a World-Class AI Organization</h2><h3></h3><br/><a class="rm-shortcode rm-image-link" data-rm-shortcode-id="e6efdd9602bbf40fa4c46c75e61a142d" data-rm-shortcode-name="rebelmouse-image" href="https://capitalone.science/" id="4a4bb" target="_blank"><img alt="Blue \u201cCapital One\u201d wordmark with a red swoosh above the text." class="" loading="lazy" src="https://spectrum.ieee.org/media-library/blue-u201ccapital-one-u201d-wordmark-with-a-red-swoosh-above-the-text.png?id=66904050&width=480&height=298&quality=100&coordinates=0%2C87%2C0%2C95"/></a><p>Capital One is building the next generation of AI talent. Join the team inventing impactful AI solutions to shape the future of finance. Learn more at <a href="https://capitalone.science/" target="_blank">https://capitalone.science/</a></p><p>External validation suggests the strategy is working. Evident AI <a href="https://evidentinsights.com/ai-index/" target="_blank"><span>ranked</span></a> Capital One as the leading bank in AI talent and a global leader in AI innovation for three consecutive years, noting the bank accounted for 38 percent of all AI patents filed by the top 50 financial institutions. Capital One was also recognized by <a href="https://www.ificlaims.com/news/ifi-insights-tracking-the-evolution-of-ai-with-patents/" target="_blank">IFI Insights</a> as the only financial institution among the top U.S. patent leaders in agentic and generative AI in 2025, alongside the likes of Google, NVIDIA, DeepMind, IBM, Microsoft, Intel, Adobe and Samsung. Capital One’s AI team – which has experience from leading AI labs and top universities – represents expertise rarely found outside Silicon Valley.</p><p>But recruitment requires a mission. “If you want to solve really important problems in AI and see your work come to life, this is one of the few places you can do that,” <a href="https://www.linkedin.com/in/natarajan/" target="_blank">Natarajan</a> says. The pitch is consistent: Capital One isn’t just optimizing algorithms for niche financial applications like high frequency trading, it’s using science to enhance financial experiences for over 100 million everyday Americans, expanding engagement and real-time insights, personalization, and access to their personal finances and products like never before.</p><p class="pull-quote">Capital One was recognized as the only financial institution among the top U.S. patent leaders in agentic and generative AI in 2025, alongside the likes of Google, NVIDIA, DeepMind, and Microsoft.</p><p><span>The frontiers Natarajan is most excited about – agentic AI systems that can dramatically improve performance by reframing how problems are solved, and domain-specific reasoning that understands contextual and financial nuance – represent the next phase of innovation. “By just casting the problem in an agentic framework, you can actually get way more performance” from the same underlying models, he explains.</span></p><p>It’s this kind of applied research, like translating general capabilities into production systems for millions of customers, that defines the <a href="https://www.capitalone.com/tech/culture/introducing-prem-natarajan/" target="_blank">Chief Scientist’s mandate</a>. When recruiting talent to his AI team, a group comparable only to the most sophisticated tech companies in caliber, Natarajan frames the opportunity around a mission. He invokes Steve Jobs’ famous challenge to John Sculley: “Do you want to spend the rest of your life selling sugared water, or do you want to change the world?” For Natarajan, the parallel is clear. Building AI systems that transform financial services for millions of everyday Americans – that’s changing the world. And it requires the kind of scientific rigor that only a Chief Scientist can lead.</p>]]></description><pubDate>Thu, 25 Jun 2026 17:32:32 +0000</pubDate><guid>https://spectrum.ieee.org/capital-one-science-ai-finance-innovation</guid><category>Ai-research</category><category>Agentic-ai</category><category>Financial-services</category><category>Tech-careers</category><category>Type-sponsored</category><category>Financial-technology</category><dc:creator>Thomas Machinchick</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/silhouetted-team-working-on-laptops-in-a-glass-walled-office-at-sunset.jpg?id=66903903&amp;width=980"></media:content></item><item><title>Vibecoded Malware Is Flooding the Internet</title><link>https://spectrum.ieee.org/vibecoding-malware</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/graphic-of-a-forward-slash-between-two-brackets-meant-to-represent-computer-programming.jpg?id=66953058&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p><a href="https://spectrum.ieee.org/vibe-coding" target="_self">Vibe coding</a>’s dark side, “vibe hacking,” is on the rise. Cybersecurity companies such as <a href="https://www.mcafee.com" rel="noopener noreferrer" target="_blank">McAfee</a> and <a href="https://www.bitdefender.com/" rel="noopener noreferrer" target="_blank">Bitdefender</a> have observed recent spikes in <a href="https://www.mcafee.com/blogs/other-blogs/mcafee-labs/ai-written-malware-vibe-coded-campaign/" rel="noopener noreferrer" target="_blank">vibe-coded malware</a>, also called “<a href="https://businessinsights.bitdefender.com/apt36-nightmare-vibeware" rel="noopener noreferrer" target="_blank">vibeware</a>,” with telltale signs such as explanatory code comments or template placeholders akin to what vibe-coded apps contain. But just how challenging is it to stop the spread of bad vibes from these emerging cyberattacks?</p><p>Researchers at the <a href="https://www.ucc.ie/en/" rel="noopener noreferrer" target="_blank">University College Cork (UCC)</a> in Ireland found that malicious software crafted with the assistance of generative AI have varied code structures that can evade static malware detection, but their nefarious behavior and intent remain the same as those of traditional malware. The team presented their results in May at the <a href="https://www.computingfrontiers.org/2026/index.html" rel="noopener noreferrer" target="_blank">23rd ACM International Conference on Computing Frontiers</a> held in Italy.</p><p>Hackers are taking advantage of the probabilistic nature of generative AI, producing vibeware that has multiple variants. “With an AI coding tool, you can say, ‘I want the same functionality, but do it in a different way.’ So you can create malware that’s bespoke to a particular attack you want to do,” says <a href="https://research.ucc.ie/en/persons/utz-roedig/" rel="noopener noreferrer" target="_blank">Utz Roedig</a>, a professor of computer science at UCC who led the research.</p><h2>Anti-Malware as Usual </h2><p>Traditional antivirus software uses a combination of static and dynamic analysis tools to screen newly downloaded software. Static analysis employs pattern-matching techniques, comparing the <a href="https://csrc.nist.gov/glossary/term/cryptographic_hash_function" rel="noopener noreferrer" target="_blank">cryptographic hash</a> of a file against databases of known malware signatures or employing rule-based engines like <a href="https://github.com/VirusTotal/yara" rel="noopener noreferrer" target="_blank">YARA</a>, an open-source tool that identifies and classifies malware according to specific binary patterns or strings. Dynamic analysis runs malware in a controlled or sandboxed environment to monitor its actions for suspicious activity. </p><p>In their experiments, the team at UCC generated a series of malicious <a href="https://www.maths.cam.ac.uk/computing/linux/bash/scripts" rel="noopener noreferrer" target="_blank">shell scripts</a> designed to steal sensitive data from Linux-based systems. Each shell-script iteration was built specifically to bypass YARA rules. While the resulting shell scripts are distinct in terms of code syntax, they remain functionally equivalent. </p><p>“Even if you make the program achieve its goal differently, the behavior is the same,” Roedig says. “The structure looks different but you can’t hide the malicious behavior.”</p><p>This highlights a necessary shift toward more dynamic and behavior-centric detection strategies. </p><p>“Now anyone can generate hundreds of unique variants, so hash matching is pointless,” says <a href="http://linkedin.com/in/princechaddha/" rel="noopener noreferrer" target="_blank">Prince Chaddha</a>, a research lead at <a href="https://projectdiscovery.io/" rel="noopener noreferrer" target="_blank">ProjectDiscovery</a>, an open-source cybersecurity company. “What still works is behavioral analysis. Defenders must go fully behavioral and use AI themselves to catch such malware.” AI can help cybersecurity professionals <a href="https://spectrum.ieee.org/anthropic-claude-mythos-preview-code" target="_self">swiftly spot vulnerabilities in software</a>, but their expertise, judgement, and oversight—along with multiple layers of verification—must be built into the process.</p><h2>LLMs Lower the Barrier to Malware Entry</h2><p>The UCC researchers also found that vibe-coding malware can be accomplished with as few as two prompts. “[Generative AI] makes it more accessible. And that would then mean you probably get more of it because the barrier to create malware lowers,” says Roedig.</p><p><a href="https://www.linkedin.com/in/dan-gittis-357a04154" rel="noopener noreferrer" target="_blank">Dan Gittis</a>, director of the threat-intelligence and detection-engineering team at managed security services provider <a href="https://www.uvcyber.com/" rel="noopener noreferrer" target="_blank">UltraViolet Cyber</a>, in Virginia, echoes the sentiment. “You no longer have to be adept at coding to build malware,” he says. “Threat actors without the experience or skills can start dipping their toes in this field, and those that do have the preexisting skill set can very likely develop even better malware.”</p><p>More surprisingly, the UCC team’s <a href="https://spectrum.ieee.org/best-ai-coding-tools" target="_self">AI coding tool</a> of choice, Cursor, didn’t refuse or restrict their malware-related prompts. This emphasizes the need to put up safety guardrails that prevent malicious use cases. Roedig cautions, however, that attackers “probably will tinker with AI models to remove guardrails,” so developers of AI coding tools must also factor in how to defend against getting around those guardrails.</p><p>Looking to the future, Gittis believes AI-generated malware could advance and multiply. “There are now more individuals who can serve as capable threat actors, meaning the overall number of cyberattacks could increase. It also means that already capable actors are very likely going to operate faster and more effectively,” he says. “And it means that threat actors may be able to develop more dynamic malware that evolves.”</p><p>He points to <a href="https://cloud.google.com/blog/topics/threat-intelligence/threat-actor-usage-of-ai-tools" rel="noopener noreferrer" target="_blank">Google’s discovery of PROMPTFLUX</a> as an example. The PROMPTFLUX malware calls the Gemini API during runtime to rewrite its own source code on demand and dodge detection. This adaptive and regenerative ability “is likely going to be very impactful to how defenders need to operate going forward,” says Gittis.</p><p><span>This constant tug-of-war is nothing new in the world of cybersecurity. “It has always been that attacker and defender go hand in hand. One side invents something and the other side tries to go around it, and you use all tools necessary,” Roedig says.</span></p><p>It’s happening again with vibe hacking and vibeware. But the good news, according to Gittis, is that “defenders have the same resources, if not more. This means that we can increase our capabilities, efficiency, and knowledge of response measures.”</p>]]></description><pubDate>Tue, 23 Jun 2026 11:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/vibecoding-malware</guid><category>Malware</category><category>Ai</category><category>Vibe-coding</category><category>Antivirus</category><dc:creator>Rina Diane Caballar</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/graphic-of-a-forward-slash-between-two-brackets-meant-to-represent-computer-programming.jpg?id=66953058&amp;width=980"></media:content></item><item><title>The EU Wants Its Own Tech Supply Chain</title><link>https://spectrum.ieee.org/europe-tech-sovereignty-package</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/photo-collage-of-smart-phones-arranged-in-a-circle-with-a-star-on-each-screen-resembling-the-european-unions-flag.jpg?id=66959124&width=1245&height=700&coordinates=0%2C263%2C0%2C263"/><br/><br/><p>It’s little secret that Europe is dependent on foreign technology—particularly U.S. tech—for office software, cloud services, AI, and more. This may have been easy to accept just several years ago, but when the United States government now <a href="https://euobserver.com/19745/eu-rejects-us-claims-of-censorship-over-tech-rules-after-visa-bans/" rel="noopener noreferrer" target="_blank">openly threatens</a> European countries with military action, there is growing anxiety in Europe that technology dependency is a liability.<br/><br/>One 3 June, the European Commission, the European Union’s executive branch, <a href="https://digital-strategy.ec.europa.eu/en/policies/eu-tech-sovereignty" rel="noopener noreferrer" target="_blank">introduced a sprawling package</a> that seeks to shift the tech supply chain in Europe’s favor. </p><p>This Tech Sovereignty Package contains four parts. Two are proposed laws—the <a href="https://digital-strategy.ec.europa.eu/en/policies/chips-act-2" rel="noopener noreferrer" target="_blank">European Chips Act 2.0</a> and the <a href="https://digital-strategy.ec.europa.eu/en/policies/cloud-and-ai-development-act" rel="noopener noreferrer" target="_blank">Cloud and AI Development Act</a>. The other two are broader strategies—one to <a href="https://digital-strategy.ec.europa.eu/en/policies/open-source-strategy" rel="noopener noreferrer" target="_blank">promote open-source software</a> and one to <a href="https://energy.ec.europa.eu/topics/eus-energy-system/digitalisation-energy-system_en#strategic-roadmap-for-digitalisation-and-ai-in-energy" rel="noopener noreferrer" target="_blank">shore up the EU’s electric grid</a>. Before the first two can become law, they must go through a long process involving the EU’s other two lawmaking bodies: the Parliament and the Council.</p><p>The Commission’s vision places European governments and crucial industry at the forefront of change, encouraging them to fund and buy European tech. Some analysts, however, are unconvinced the measures go far enough to change the status quo.</p><h2>Part 1: Chips Act 2.0</h2><p>As indicated in the name, the <a href="https://digital-strategy.ec.europa.eu/en/policies/chips-act-2" rel="noopener noreferrer" target="_blank">Chips Act 2.0</a> follows the EU’s original <a href="https://spectrum.ieee.org/eu-chips-act-imec" target="_self">Chips Act</a>, adopted in 2023 (and not to be confused with its similarly named <a href="https://spectrum.ieee.org/chips-act-map" target="_self">U.S. counterpart</a>.) The first European Chips Act encouraged investment in EU semiconductor production, aiming to reach a 20 percent share in the world market for “cutting-edge and sustainable” microchips by 2030. It supported pilot lines in areas like sub-2-nanometer chips and photonics, in addition to both large fabs and small startups. </p><p>Early results have been mixed—<a href="https://op.europa.eu/en/publication-detail/-/publication/d4bc75a6-2574-11f0-ac85-01aa75ed71a1/language-en" rel="noopener noreferrer" target="_blank">a 2025 audit</a> found that the first Chips Act had created progress in areas like chip design and pilot lines, but deemed it “unlikely to be sufficient” to reach an “overly ambitious” target.</p><p>One criticism of the first Chips Act was that it did little to cultivate demand for European-made semiconductors. The Chips Act 2.0, then, includes demand-boosting measures that encourage governments and industry to use European chips, in addition to retaining its supply-side funding.</p><p>There are new supply-side elements, too. The Chips Act 2.0 allows the Commission to fund certain fabs as “strategic projects” and fast-track them through permitting. The Commission has proposed an open-access foundry to manufacture chips at 3-nm-process nodes or lower, which could start pilot production between 2030 and 2033.</p><p>If successful, European semiconductor manufacturers could take over the supply for industrial firms in automotive, defence, and advanced manufacturing. Today, these firms are especially vulnerable to global supply-chain disruptions.</p><p>At the same time, some analysts still question whether the Chips Act will create enough demand. “The Commission clearly recognizes this in the revision and devotes considerable attention to demand-side levers,” says Tillman Schenk, researcher at <a href="https://www.bruegel.org/" target="_blank">Bruegel</a>, a Brussels-based think tank. “However, these instruments currently strike me as somewhat underdeveloped.”</p><p>Some analysts <a href="https://eurostack.eu/blog/the-commissions-tech-sovereignty-package-is-nearly-here-early-thoughts/" rel="noopener noreferrer" target="_blank">write</a> that to raise demand, the EU must explicitly require, not merely encourage, governments to “buy European.” </p><h2>Part 2: Cloud and AI Development Act</h2><p>The<a href="https://digital-strategy.ec.europa.eu/en/policies/cloud-and-ai-development-act" rel="noopener noreferrer" target="_blank"> accompanying Cloud and AI Development Act</a> (CADA) focuses on cloud services and data centers. The <a href="https://www.iea.org/data-and-statistics/data-tools/energy-and-ai-observatory?tab=Energy+for+AI" rel="noopener noreferrer" target="_blank">EU trails both the U.S. and China</a> in total data-center capacity, and European leaders say they need to close this cloud gap if both EU governments and industry are to make the most of cutting-edge AI.</p><p>Therefore, CADA calls for a tripling of EU data-center capacity by the early 2030s.</p><p><a href="https://datacentre.me/newsletter/the-eudca-announces-board-of-directors-for-2025-27/" rel="noopener noreferrer" target="_blank">Michael Winterson</a>, Secretary General of the European Data Centre Association, calls the goal “achievable in principle” and says that “demand alone could justify a tripling of capacity.” Achieving this goal will require dramatically speeding up data-center projects that today might get stuck in permitting or waiting in a queue for electrical supply, he says.</p><p>CADA stipulates that member states should designate particular projects and “acceleration zones” for fast-tracked approval. It also stipulates that, by 2030, data-center operators should be able to obtain the necessary permits and grid access—often a years-long process today—in 18 months.</p><p>But in Europe, there are <a href="https://spectrum.ieee.org/europe-cloud-sovereignty" target="_self">some rather large elephants in the cloud</a>. Today, four U.S. hyperscalers—AWS, Google Cloud, IBM Cloud, and Microsoft Azure—account for <a href="https://www.ceps.eu/disk-backup-to-the-cloud-is-a-gaping-vulnerability-in-the-eus-security/" rel="noopener noreferrer" target="_blank">over two-thirds of EU cloud services</a>. This troubles some Europeans because <a href="https://en.wikipedia.org/wiki/CLOUD_Act" rel="noopener noreferrer" target="_blank">U.S. law</a> authorizes U.S. authorities to compel U.S. firms to hand over data even if stored abroad.</p><p>To ensure that more sensitive European data stays within Europe, CADA lays out a sliding scale of four “assurance levels.” Higher levels require more EU-located data, infrastructure, staff, and supply chains. However, national authorities can choose assurance levels as they see fit, so the same application might use different levels in different countries.</p><p>Some analysts like EuroStack’s Stéfane Fermigier <a href="https://eurostack.eu/blog/the-commissions-tech-sovereignty-package-is-nearly-here-early-thoughts/" rel="noopener noreferrer" target="_blank">note</a> that this leaves the door open for the assurance levels to be applied unevenly. American hyperscalers could locate data centers in the EU, claim sovereignty compliance, and avoid ceding ground to their smaller European counterparts.</p><h2>Part 3: EU Energy System Road Map</h2><p>The announcement of a threefold increase in the EU’s data-center capacity is unlikely to comfort the many Europeans who oppose their construction, <a href="https://algorithmwatch.org/en/infrastructure-intrusion-conflict-data-center/" rel="noopener noreferrer" target="_blank">citing concerns</a> about their environmental footprints or their potential to strain the electrical grid. Partly in response, the EU’s tech sovereignty package includes a <a href="https://energy.ec.europa.eu/news/commission-presents-measures-digitalise-europes-energy-system-while-ensuring-sustainable-2026-06-03_en" rel="noopener noreferrer" target="_blank">“strategic roadmap”</a> for Europe’s electrical grids.</p><p>The Commission <a href="https://energy.ec.europa.eu/news/rating-scheme-data-centres-eu-commission-launches-call-feedback-2026-03-27_en" rel="noopener noreferrer" target="_blank">has proposed</a> a rating system that would grade data centers based on their efficiency and environmental footprint, but this scheme <a href="https://www.theregister.com/on-prem/2026/06/10/brussels-datacenter-efficiency-scorecard-may-come-with-a-credit-warning/5253297" rel="noopener noreferrer" target="_blank">has reportedly been delayed</a> under pressure from data-center operators and some EU member states.</p><p>The road map includes support and research projects for <a href="https://spectrum.ieee.org/tomorrows-power-grid-will-be-autonomous" target="_self">smart grids</a> and for AI models in the energy sector. It also plans to enable EU electric grids to more easily exchange data across borders.</p><p>Unlike the Chips Acts or CADA, the road map is not a proposed law. In many cases, its measures are research projects or promises to introduce future legislation by the end of 2027. </p><h2>Part 4: Open Source Strategy</h2><p>European public administrations spend an <a href="https://www.cigref.fr/wp/wp-content/uploads/2025/05/TECHNOLOGICAL-DEPENDENCE-ON-AMERICAN-SOFTWARE-AND-CLOUD-SERVICES-AN-ASSESSMENT-OF-THE-ECONOMIC-CONSEQUENCES.pdf" rel="noopener noreferrer" target="_blank">estimated €264 billion</a> per year on proprietary IT, with 80 percent going to American companies. In the past several years some European bodies have <a href="https://techcrunch.com/2026/04/27/whats-behind-europes-efforts-to-ditch-u-s-software-in-favor-of-sovereign-tech/" rel="noopener noreferrer" target="_blank">made sporadic moves</a> toward open-source alternatives, perhaps most notably the French civil service’s <a href="https://www.zdnet.com/article/france-leaves-windows-for-linux-desktop/" rel="noopener noreferrer" target="_blank">migration</a> from Windows to Linux.</p><p>Now, the European Commission has unveiled an expensive strategy <a href="https://digital-strategy.ec.europa.eu/en/policies/open-source-strategy" rel="noopener noreferrer" target="_blank">to promote open source in the public sector</a>. In theory, open source could at once save on costs, phase out non-European software, and benefit European open-source developers.</p><p>The Commission’s plan stretches beyond office software and operating systems. It envisions public services partaking in a “vibrant” open-source ecosystem for everything from AI to RISC-V semiconductors to Web 4.0 architecture. It plans to fund open-source startups and developers in key sectors.</p><p>Although this strategy is not in itself a law, CADA includes some open-source measures, like a provision to “encourage” public-sector bodies to use open-source cloud and AI. In theory, this could establish a precedent for governments to choose “open source first.”</p><p><a href="https://opensource.org/blog/author/jordan-maris" rel="noopener noreferrer" target="_blank">Jordan Maris</a>, EU Policy Analyst for the Open Source Initiative, is optimistic about the package. He particularly believes it could be a boon for maintainers of core software. “They will likely receive recognition and opportunities for funding,” he says. “My guess is it will predominantly serve individual developers but some community-led projects could also benefit.” </p><p>Maris also says it can benefit developers of crucial enterprise software like <span>Collabora Online, Euro-Office, and </span><span>Nextcloud. </span><span>Other open-source advocates, however, </span><a href="https://eurostack.eu/blog/ecs-tech-sovereignty-package-update/" target="_blank">argue</a><span> that the open-source measures in CADA do not go far enough. In particular, since CADA’s articles “encourage” public-sector bodies to prioritize open source rather than “require” it, the public sector may instead let inertia take its course.</span></p><p><span>This package is not final. The Chips Act 2.0 and CADA will now proceed through further European lawmaking, involving </span><a href="https://commission.europa.eu/law/law-making-process_en" target="_blank">the European Council and European Parliament</a><span>, a process that inevitably changes the content.</span></p><p>There’s also pressure from <a href="https://www.theguardian.com/technology/2026/apr/17/microsoft-us-tech-firms-lobbied-eu-secrecy-rules-datacentre-emissions" target="_blank">U.S. tech firms</a> and <a href="https://subscriber.politicopro.com/article/eenews/2026/06/03/eu-delays-data-center-sustainability-label-after-heavy-criticism-00946716" target="_blank">some of the EU’s own member states</a> to water down some of the requirements, as <a href="https://eurostack.eu/blog/ecs-tech-sovereignty-package-update/" rel="noopener noreferrer" target="_blank">already happened with some of the open-source measures</a>.</p>]]></description><pubDate>Tue, 23 Jun 2026 10:00:03 +0000</pubDate><guid>https://spectrum.ieee.org/europe-tech-sovereignty-package</guid><category>European-union</category><category>Sovereignty</category><category>Chips</category><category>Cloud-computing</category><category>Open-source</category><category>Grid</category><dc:creator>Rahul Rao</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/photo-collage-of-smart-phones-arranged-in-a-circle-with-a-star-on-each-screen-resembling-the-european-unions-flag.jpg?id=66959124&amp;width=980"></media:content></item><item><title>This Device Takes Photographs With a Single Atom</title><link>https://spectrum.ieee.org/single-atom-camera-quantum-computing</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/pixelated-light-patterns-captured-with-an-atom-camera-including-a-lattice-cometlike-shape-and-two-circles-side-by-side.jpg?id=66947683&width=1245&height=700&coordinates=0%2C62%2C0%2C63"/><br/><br/><p>Today, it’s quite possible to <a href="https://www.newscientist.com/article/2279115-this-is-the-most-detailed-look-at-individual-atoms-ever-captured/" rel="noopener noreferrer" target="_blank">see individual atoms in photographs</a>. It’s one of the great triumphs of imaging. What, then, of the inverse? Can you use a single atom to capture an image?</p><p>Single atoms are probably not replacing smartphone cameras soon, but an atom can be used to measure light. One research group at the Institute for Molecular Science in Okazaki, Japan, has now used this ability to develop what they call an “atom camera,” which can capture patterns of light far too small to see with standard optical microscopes.</p><p>More than a physics demonstration, the atom camera could also be an elegant way to see inside certain quantum computers. The atom camera’s creators are also building quantum computers that use neutral atoms as qubits.</p><p>“We expect the atom camera to serve as a valuable diagnostic tool for this effort in our laboratory, and in other similar efforts worldwide as well,” says <a href="https://ohmori.ims.ac.jp/en/kenjiohmori/" rel="noopener noreferrer" target="_blank">Kenji Ohmori</a>, a physicist at the Institute for Molecular Science.</p><p>Ohmori and colleagues published their work in <a href="https://www.nature.com/articles/s41467-026-73348-x" rel="noopener noreferrer" target="_blank"><em><em>Nature Communications</em></em></a><em> </em>on 29 May. </p><h2>The quantum photographer’s guide</h2><p>The key component of this atom camera is an <a href="https://spectrum.ieee.org/optical-tweezers-can-now-manipulate-matter-on-a-nanoscale" target="_self">optical tweezer</a>, an instrument that traps particles by squeezing them with focused laser beams. The instrument has become a common tool of physicists who handle atoms. A tweezer can catch an atom, then move it around or hold it in place. The researchers chilled a rubidium-87 atom to near absolute zero and <a href="https://news.mit.edu/2021/motional-ground-state-ligo-0618" rel="noopener noreferrer" target="_blank">immobilized it</a> inside an optical tweezer. The atom camera essentially measures how this atom responds to its environment. As light falls on an atom, it imparts energy onto some of the atom’s electrons. This shifts the <a href="https://en.wikipedia.org/wiki/Energy_level" rel="noopener noreferrer" target="_blank">energy states</a> of those electrons. </p><p>By observing these shifts, the researchers could gauge either the light’s intensity or its polarization. They could measure these properties of their tweezer’s light, or they could measure a second pattern of light cast on the atom.</p><p>These patterns are much larger than a single atom, so how do you turn measurement into a full image? Because the atom must be kept still, you have to move the pattern itself across the atom. The researchers dragged a pattern 100 nanometers at a time—up, down, or to the side—and measured the intensity or the polarization of the light at each step.</p><p>In the end, they had a 2D map of measurements—which they could render into a nanoscale “photograph.” They photographed several different patterns using this method.</p><p>The Okazaki researchers aren’t the first to use atoms for measuring light. <a href="https://www.nature.com/articles/35102129" rel="noopener noreferrer" target="_blank">Since the 1990s</a>, physicists have tried atoms to cheat the <a href="https://svi.nl/DiffractionLimit" rel="noopener noreferrer" target="_blank">diffraction limit</a> of visible light: the tiniest feature that typical optics can see. Atoms are significantly smaller than this, so an atom set up in the proper way could theoretically resolve even tinier details.</p><p>As cold-atom physics has grown more sophisticated, more labs have tried their hands (and optical tweezers) at making atoms fit for purpose. In 2022, two groups at the <a href="https://journals.aps.org/prresearch/abstract/10.1103/PhysRevResearch.4.L042026" rel="noopener noreferrer" target="_blank">Institute of Photonic Sciences in Barcelona</a> and at the <a href="https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.128.083201" rel="noopener noreferrer" target="_blank">University of California, Berkeley</a>, separately used rubidium-87 atoms to capture the intensity of oncoming light. The Berkeley group reached a resolution of 300 nm, but they believed their work was only an initial step.</p><p>“We envisioned that the method could be made much more sensitive,” says <a href="https://physics.berkeley.edu/people/faculty/dan-stamper-kurn" rel="noopener noreferrer" target="_blank">Dan Stamper-Kurn</a>, a physicist who was involved in the aforementioned work, but not the Okazaki group.</p><p>In its earlier work, the Berkeley group studied a relatively large shift in energy state. The Okazaki group instead measured a far subtler shift linked to what physicists call a <a href="https://en.wikipedia.org/wiki/Hyperfine_structure" rel="noopener noreferrer" target="_blank">hyperfine transition</a>. This has several advantages. For one, the Okazaki group could measure its light’s polarization, in addition to its intensity. For another, the hyperfine transition is far more sensitive: In theory, the Okazaki group can render features as small as 25 nm. (Smaller than that, <a href="https://spectrum.ieee.org/sidestep-heisenberg-uncertainty" target="_self">quantum uncertainty</a> comes into play.)</p><p>The more precisely you know your atom’s position, the better your resolution. This is why the atom must be kept as still as possible.</p><h2>Qubits calling for photographers</h2><p>What could an “atom camera” capture? Quite a few things, actually, physicists say.</p><p>“There’s a lot of relevance to this, because these so-called optical tweezers are what we use in many experiments nowadays,” says <a href="https://www.zeiher-lab.de/team/johannes-zeiher" rel="noopener noreferrer" target="_blank">Johannes Zeiher</a>, a physicist at the Ludwig-Maximilians-Universität München in Germany, who was also not involved with the Okazaki group.</p><p>Optical tweezers are particularly prized in the world of <a href="https://spectrum.ieee.org/neutral-atom-quantum-computing" target="_self">neutral-atom quantum computers</a>, like the Okazaki group are building. These quantum computers run on atoms such as rubidium-87 chilled to near absolute zero inside a vacuum chamber. Optical tweezers can trap the atoms, which act as qubits, and hold them or move them around. Computing with two neutral atoms might involve precisely positioning them and <a href="https://physicsworld.com/a/neutral-atom-quantum-computers-are-having-a-moment/" rel="noopener noreferrer" target="_blank">firing a laser</a> to illuminate both.</p><p>Such a light beam is almost never uniform. Even a small beam can contain all manner of subtleties, especially quirks of polarization, which can interfere with a qubit and cause it to lose coherence and collapse. It’s crucial, then, for a qubit operator to understand the tiniest details of their light, but physicists today are still searching for a method to reliably do this. </p><p>Traditional optics often aren’t suitable for the task of seeing inside a quantum computer’s vacuum chamber, since they too can easily disturb qubits. The challenge becomes even more tedious as neutral-atom quantum computers gain more qubits and become more complex to control. </p><p>The physicists say that their creation, which can map both intensity and polarization at tiny scales, is an enticing alternative.</p><p>“Rather than bringing a camera from outside the vacuum chamber, why not use the tools already there inside our quantum playground in the vacuum?” says <a href="https://www.ims.ac.jp/en/research/assist/tomita.html" rel="noopener noreferrer" target="_blank">Takafumi Tomita</a>, a physicist at the Institute for Molecular Science, and another of the authors.</p><p><em>This article appears in the August 2026 print issue as “Camera Takes Photos With a Single Atom.”</em></p>]]></description><pubDate>Sun, 21 Jun 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/single-atom-camera-quantum-computing</guid><category>Neutral-atom</category><category>Quantum-computing</category><category>Super-resolution-imaging</category><category>Optical-tweezers</category><dc:creator>Rahul Rao</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/pixelated-light-patterns-captured-with-an-atom-camera-including-a-lattice-cometlike-shape-and-two-circles-side-by-side.jpg?id=66947683&amp;width=980"></media:content></item><item><title>Tensordyne Claims Massive Speed and Power Improvement Over Nvidia</title><link>https://spectrum.ieee.org/tensordyne-inference-claim</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/two-views-of-a-black-rack-mounted-server-chassis-with-stacked-hardware-modules.jpg?id=66906634&width=1245&height=700&coordinates=0%2C62%2C0%2C63"/><br/><br/><p><span>If simulations are to be believed, startup </span><a href="https://www.tensordyne.ai/" target="_blank">Tensordyne’s</a><span> new AI chip could crush the performance of market leader </span><a href="https://www.nvidia.com/en-us/" target="_blank">Nvidia</a><span> in terms of energy efficiency and latency for inferencing. The company just sent the plans for its first chip to be manufactured, with commercial sales of a 72-chip system scheduled for the second half of 2027. Tensordyne claims its 72-chip system can run large LLMs four times as fast using one-fifth the power compared to a 72-Nvidia </span><a href="https://spectrum.ieee.org/mlperf-inference-51" target="_self">GB300</a><span> system. However, real systems won’t be around to back these figures up until the end of the year.</span></p><p>The not-so-secret sauce behind the outsized efficiency of Tensordyne’s new chip, Napier, is how it does matrix multiplication, the main math of AI. It takes advantage of the fact that the logarithm of A times B equals the logarithm of A plus the logarithm of B. </p><p>“We’ve turned multipliers into adders,” explains <a href="https://www.linkedin.com/in/gillesbackhus/" target="_blank">Gilles Backhus</a>, a Tensordyne founder and vice president of AI. Adders are smaller and more energy-efficient logic circuits than those that do multiplication, he says. So Napier can pack more compute into a smaller area and still save on power.</p><h2>New kinds of numbers</h2><p>That such a thing was possible has long been known, but there wasn’t a good way to use it, because converting back and forth between logarithmic numbers and the floating point numbers that describe neural networks took too much time and energy and introduced too many inaccuracies. Not anymore, according to Backhus.</p><p>“So far no one has figured out how to do the linear to logarithm and logarithm to linear conversion as we have,” he says. “And that’s actually the crux of that whole thing. Our engineers have figured out ways to do this very elegantly and very very accurately and cheaply on silicon.”</p><p>The importance of number formats hasn’t been lost on the AI industry. Speaking at <a href="https://hotchips.org/" target="_blank">IEEE Hot Chips</a> in 2023, Nvidia chief scientist Bill Dally attributed the majority of the <a href="https://spectrum.ieee.org/nvidia-gpu" target="_self">improvement in the company’s GPUs</a> at the time to the use of shorter <a href="https://spectrum.ieee.org/nvidia-blackwell" target="_self">number formats</a> and the smaller circuits they require.</p><p>Researchers have also worked on circuits to compute with alternative formats, such as the <a href="https://spectrum.ieee.org/floating-point-numbers-posits-processor" target="_self">logarithm-like posit</a> and more recently its scientific-computing counterpart the <a href="https://spectrum.ieee.org/number-formats-ai-scientific-computing" target="_self">takum</a>. However, these formats have not reached mainstream adoption mostly because their hardware implementation is so different from traditional floating point.</p><h2>Inference Demands Influence Architecture</h2><p>Market trends, including the rise of AI agents, mean inference—the execution of neural network models—is becoming more important than training new large language models (LLMs). Factors like the cost and the speed at which answers are delivered are starting to dominate, and that’s led AI companies to look for system architectures that are a better fit for that. </p><p>Tensordyne executives say they saw this coming and engineered their computers to meet it.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Silver chip with green circuitry on black background" class="rm-shortcode" data-rm-shortcode-id="fe1082d030e9cc9903597e48bc5c4b93" data-rm-shortcode-name="rebelmouse-image" id="41745" loading="lazy" src="https://spectrum.ieee.org/media-library/silver-chip-with-green-circuitry-on-black-background.jpg?id=66906698&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Tensordyne’s Napier AI chip includes 144 gigabytes of HBM, but the real power comes from its unusual math.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Tensordyne</small></p><p>There are two main parts to executing an LLM: prefill and decode. In the prefill stage the model takes in the input text and turns it into tokens, the basic units it can work with, and builds a kind of working memory about the input, called the key-value cache. It’s a computationally heavy task.</p><p>Decode is where the LLM generates its output tokens, the answer or response to your input. Each new token is predicted using the previous token and the key-value cache. This sequential nature can make decode a slower process, and it’s more dependent on memory and network latency than computing power.</p><p>So AI chip makers are starting to build systems with those two different demands in mind. Nvidia is touting a system where a server rack full of B300 GPUs handles prefill and several racks of its<a href="https://spectrum.ieee.org/nvidia-groq-3" target="_self"> Groq 3 processors </a>do the decode. <a href="https://aws.amazon.com/" target="_blank">Amazon Web Services</a> is <a href="https://www.aboutamazon.com/news/aws/aws-cerebras-ai-inference" target="_blank">combining</a> a rack of its Trainium AI chips for prefill with several racks of <a href="https://www.cerebras.ai/" rel="noopener noreferrer" target="_blank">Cerebras’s</a> <a href="https://spectrum.ieee.org/cerebrass-giant-chip-will-smash-deep-learnings-speed-barrier" target="_self">wafer-scale computers</a> for decode. </p><p>Tensordyne says its system can handle both jobs. “We’re optimizing for two hard challenges here at the same time,” says <a href="https://www.linkedin.com/in/r-k-anand/" rel="noopener noreferrer" target="_blank">R.K. Anand</a>, chief product officer and co-founder of Tensordyne. “We’re the first company proving that you can do both without going to multiple vendors and multiple racks.”</p><p>The dense compute needed for prefill comes from the logarithmic math. The needs of decode come from 144-gigabytes of high-bandwidth memory and a custom 1-microsecond-latency network called Tensordyne Napier Link.</p><p>In a “pod” system that fits in one-quarter of a standard rack, Tensordyne packs in 72 Napier chips, 8 Intel Xeon CPUs, and 64 terabytes of solid-state storage. A four-pod rack working on a 2-trillion parameter LLM would deliver 1,300 tokens per-second per-user at a cost of US $11 for 1 million tokens, while consuming 120 kilowatts of power, the company claims, with one pod crunching out prefill and three working on decode. To get similar tokens per-second per-user numbers, a nine-rack Rubin and Groq 3 system would likely consume 1.5 megawatts, according to Tensordyne.</p><p>Whether or not these numbers really hold up will have to wait until later in the year. Tensordyne plans to have a beta version available through the cloud for customers to work with. It expects to begin shipping systems to customers about a year from now.</p>]]></description><pubDate>Mon, 15 Jun 2026 17:31:09 +0000</pubDate><guid>https://spectrum.ieee.org/tensordyne-inference-claim</guid><category>Inferencing</category><category>Ai-hardware</category><category>Nvidia</category><category>Mathematics</category><dc:creator>Samuel K. Moore</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/two-views-of-a-black-rack-mounted-server-chassis-with-stacked-hardware-modules.jpg?id=66906634&amp;width=980"></media:content></item><item><title>Why Orbital Data Centers Are Harder Than Silicon Valley Thinks</title><link>https://spectrum.ieee.org/orbital-data-centers-heat</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/globe-surrounded-by-zeroes-and-ones-on-a-blue-background.png?id=66895710&width=1245&height=700&coordinates=0%2C95%2C0%2C96"/><br/><br/><p><strong>“Space computing, the final</strong> frontier, has arrived,” Nvidia CEO Jensen Huang <a href="https://nvidianews.nvidia.com/news/space-computing" rel="noopener noreferrer" target="_blank">declared</a> at the <a href="https://www.nvidia.com/gtc/" rel="noopener noreferrer" target="_blank">Nvidia GTC</a> conference in March.</p><p>Indeed, the idea of data centers in orbit has gone from science fiction to a serious spending category. Elon Musk’s <a href="https://www.spacex.com/" rel="noopener noreferrer" target="_blank">SpaceX</a> has <a href="https://x.ai/news/xai-joins-spacex" rel="noopener noreferrer" target="_blank">acquired</a> <a href="https://x.ai/" rel="noopener noreferrer" target="_blank">xAI</a> (also Musk’s) and is <a href="https://spacenews.com/spacex-offers-details-on-orbital-data-center-satellites/" rel="noopener noreferrer" target="_blank">planning</a> a constellation of space-based data centers. <a href="https://research.google/" rel="noopener noreferrer" target="_blank">Google</a>, not to be outdone, announced <a href="https://research.google/blog/exploring-a-space-based-scalable-ai-infrastructure-system-design/" rel="noopener noreferrer" target="_blank">Project Suncatcher</a> in partnership with <a href="https://www.planet.com/" rel="noopener noreferrer" target="_blank">Planet</a>, planning to launch two satellites equipped with Google Tensor Processing Unit (TPU) AI chips by early 2027. Startup <a href="https://www.starcloud.com/" rel="noopener noreferrer" target="_blank">Starcloud</a> has already <a href="https://www.pcmag.com/news/data-center-space-race-heats-up-as-starcloud-startup-requests-88000-satellites?test_uuid=04IpBmWGZleS0I0J3epvMrC&test_variant=B" rel="noopener noreferrer" target="_blank">filed</a> a proposal with the Federal Communications Commission for an 88,000-satellite constellation for orbital data centers. As Starcloud’s filing suggests, these companies are all proposing fleets of satellites numbering in the thousands, each housing a rack or multiple racks of AI-grade GPUs, interconnected with each other through free-space optical links and communicating back to Earth via microwave links, either directly or through other satellites.</p><div class="rm-embed embed-media"><iframe height="110px" id="noa-web-audio-player" src="https://embed-player.newsoveraudio.com/v4?key=q5m19e&id=https://spectrum.ieee.org/orbital-data-centers-heat&bgColor=F5F5F5&color=1b1b1c&playColor=1b1b1c&progressBgColor=F5F5F5&progressBorderColor=bdbbbb&titleColor=1b1b1c&timeColor=1b1b1c&speedColor=1b1b1c&noaLinkColor=556B7D&noaLinkHighlightColor=FF4B00&feedbackButton=true" style="border: none" width="100%"></iframe></div><p><span>Proponents </span><a href="https://x.com/patrick_oshag/status/1998440819078898140" target="_blank">tout</a><span> the many wonders of computing in space: abundant solar energy, free cooling, and freedom from Earth-based disturbances like earthquakes, floods, and protesters. But a sober look at the physics of space-based computing paints a much more nuanced picture.</span></p><p>Free cooling is perhaps the biggest misconception. Space is cold, but it also has no atmosphere. That means the best heat-removal mechanisms, conduction and convection, are off the table. The only option is radiation. To prevent a chip from overheating in space, a large, costly surface area is required to dissipate the energy and then radiate it.</p><p>Solar energy is abundant, but collecting it with functional solar panels that maintain perfect alignment toward the sun is a complex task requiring extensive <a href="https://spectrum.ieee.org/satellite-refueling-heats-up" target="_self">attitude control systems</a>. On top of that, ionizing radiation in space from cosmic rays and other sources poses a unique challenge, degrading the solar panels, the radiative coolers, and the chips themselves. Because regular maintenance in space is difficult, redundancy has to be built in at launch, and cost estimates have to account for efficiency degradation over time.</p><p>At <a href="https://www.abiresearch.com/" target="_blank">ABI Research</a>, where I work as an aerospace analyst, we did a rough total-cost-of-ownership comparison between a data center on Earth and one in space. It showed that the cost to launch and run a GPU in space for a year is at least an order of magnitude higher than the same feat in a terrestrial data center. Our model was simple, assuming an Nvidia H100 server rack launched with the requisite-size solar panel and radiator on a spacecraft akin to Starcloud’s <a href="https://spectrum.ieee.org/nvidia-h100-space" target="_self">pilot launch</a>. We assumed SpaceX’s Starship was used at a highly optimistic launch cost per kilogram of US $44, and a terrestrial energy cost of $0.20 per kilowatt hour. This is a simple back-of-the-envelope calculation, but it does signal something real.</p><p>From our perspective, the cost of delivery and space hardening of the payload makes general-purpose space-based data centers difficult to justify economically today, despite the fact that data-center builders in many regions are scrambling for electric power. However, there are niche applications where the much higher costs of computing in space could be justified. Examples include preprocessing data from Earth-observation satellites, real-time detection and tracking of hypersonic missiles, and active collision avoidance in the increasingly crowded low Earth orbit. Even for these, though, contending with fundamental physics will still be a demanding challenge. And a technologically compelling one, too.</p><h2>The Cooling Challenge in Space</h2><p>Cooling is where physics separates the science from the fiction. The governing equation for radiative cooling, the only type of cooling available in space, is known as the Stefan-Boltzmann Law. It states that the amount of power you can radiate is proportional to the area of the radiator times its temperature to the fourth power. For a space systems architect, the implications of this law are brutal. In orbit, the only variable we can control is area. This restriction creates a geometric penalty, or a “physics tax,” for cooling in space: The more power you need to reject, the bigger the area of the radiator you need to bring along from Earth.</p><h3></h3><br/><div class="flourish-embed flourish-chart" data-src="visualisation/28633310?602891"><script src="https://public.flourish.studio/resources/embed.js"></script><noscript><img alt="chart visualization" src="https://public.flourish.studio/visualisation/28633310/thumbnail" width="100%"/></noscript></div><p class="caption">The only cooling method available in space is radiation, and the radiator area required is derived using the Stephan-Boltzmann law. For a single chip drawing 700 watts, like Nvidia’s popular H100 GPU, the area required to keep it at 20 °C is just under 3 square meters, and it goes down to 1 square meter for an operating temperature of 85 °C. However, as the radiator surface is exposed to ionizing radiation, its emissivity decreases, and after 5 years in space the required area increases by about 40 percent. </p><h3></h3><br/><p>To understand how big this baseline area is in practice, I used the Stefan-Boltzmann law to model the heat-rejection area needed to keep a single chip that draws 700 watts of power—such as the H100 GPU chip, an AI stalwart—at a constant 60 °C, usually considered the sweet spot for GPU longevity and stability. I further assumed that the radiator is perfectly facing deep space, at a chilly background temperature of 3 kelvins. By this calculation, a single chip would require 1.4 square meters of radiator surface.</p><p>To put this into perspective, consider that a common AI rack can hold approximately 32 GPUs (four H100 server boards). With CPUs, memory, and networking equipment, this rack would draw around 40 kilowatts of power. This single rack includes 2.5 terabytes of memory—enough capacity to serve over 20,000 concurrent users or run 16 simultaneous instances of Llama 3, an open-source AI model. But to cool this thermal load in a vacuum, that single rack would require an 80-square-meter radiator, roughly the size of a pickleball court. For an aggregate 100-megawatt data center, you’d need at least 2,500 of those radiators.</p><p>And that’s the best-case scenario. Additional problems are hidden in the low Earth orbit environment itself. Space exposes radiators and their coatings to a chemically hostile brew of ultraviolet light and atomic oxygen, quite the opposite of a clean-room environment. Over a LEO satellite’s typical 5-year lifespan, these elements degrade the radiator’s surface properties and lower its ability to shed heat.</p><p>Including this degradation in the model reveals that as the radiator degrades from a “fresh” state to an “end-of-life” state, the physics demands a further penalty. To maintain that same 60 °C operating temperature for the GPU chips, the required surface area jumps from about 1.4 square meters per chip to nearly 2.0 square meters. In other words, the physics tax rises by 40 percent. Therefore, you must launch at least 40 percent more radiator mass, endure higher atmospheric drag, and sacrifice valuable launch volume just to survive the degradation of the thermal coating. This increase adds significantly to the launch cost and further erodes the economics of a space-based data center.</p><h2>The Silicon Challenge in Space</h2><p><strong></strong>Solving the heat problem is only part of the battle. The other significant challenge in low Earth orbit is ionizing radiation, which affects the computing hardware itself. Today’s satellites typically use radiation-hardened processors, which are very reliable but also much more expensive, and they perform poorly compared to commercial off-the-shelf <a href="https://ieeexplore.ieee.org/document/11068401" target="_blank">processors</a>.</p><p>A standard rad-hard chip doesn’t have the processing power to run a modern large language model (LLM). As a result, satellite operators aspiring to launch a data center have no choice but to make a risky compromise: to use hardware meant for terrestrial use. In order to achieve the necessary compute density, orbital data centers must use the same Nvidia H100s or Google TPUs found in terrestrial server farms. The problem is that these chips are “soft” targets in space. High-energy particles can flip bits in memory or cause “latch-ups” in logic that fry the circuit.</p><h3></h3><br/><table border="“0”" style="white-space: unset;" width="100%"><thead><tr><th style="background-color: #000000; color: #FFFFFF; width: 25%;"><br/></th><th style="background-color: #265892; color: #FFFFFF; width: 25%;">SpaceX/xAI</th><th style="background-color: #000000; color: #FFFFFF; width: 25%;">Starcloud</th><th style="background-color: #265892; color: #FFFFFF; width: 25%;">Google Project Suncatcher</th></tr></thead><tbody><tr><td style="background-color: #ecece9; width: 25%;">Status</td><td style="background-color: #d2ebfa; width: 25%;">FCC filing, January 2026; AI1 design, June 2026</td><td style="background-color: #ecece9; width: 25%;">First satellite (H100) launched late 2025; second due October 2026<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Research phase; 2-satellite demo with Planet Labs planned early 2027<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Proposed scale<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Up to 1 million satellites<span></span></td><td style="background-color: #ecece9; width: 25%;">5 GW total across ~100 launches<span></span></td><td style="background-color: #d2ebfa; width: 25%;">81-satellite clusters<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Per satellite power<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Up to 150 kW<span></span></td><td style="background-color: #ecece9; width: 25%;">40 MW per launch container<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Not specified<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Chips<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Custom D3 chip from Terafab consortium or other<span></span></td><td style="background-color: #ecece9; width: 25%;">Off-the-shelf GPUs (Nvidia H100/Blackwell)<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Google Trillium TPU v6e<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Orbit<span></span></td><td style="background-color: #d2ebfa; width: 25%;">500–2,000 km LEO; sun-synchronous shells at 50-km intervals<span></span></td><td style="background-color: #ecece9; width: 25%;">Dawn-dusk sun-synchronous LEO (>99% sunlight)<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Dawn-dusk sun-synchronous LEO (~650 km)<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Cooling<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Liquid circulating through radiators<span></span></td><td style="background-color: #ecece9; width: 25%;">Liquid circulating through radiators about half the size of solar arrays<span></span></td><td style="background-color: #d2ebfa; width: 25%;">No design published<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Connectivity<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Optical links to Starlink mesh, then to ground<span></span></td><td style="background-color: #ecece9; width: 25%;">Laser links to Starlink/Kuiper/Kepler; physical “data shuttle” modules for bulk data</td><td style="background-color: #d2ebfa; width: 25%;">Free-space optical links; radio for pilot mission ground links<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Cost parity expected<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Musk says 2–3 years<span></span></td><td style="background-color: #ecece9; width: 25%;">~$8M per 40-MW cluster over 10 years vs. $167M terrestrial (modeled)<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Mid-2030s when launch hits <$200/kg (per Google’s own paper)<span></span></td></tr><tr><td style="background-color: #ecece9; width: 25%;">Key dependency<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Terafab chip fab; Starship reusability<span></span></td><td style="background-color: #ecece9; width: 25%;">Starship reusability; off-the-shelf GPU radiation tolerance at scale<span></span></td><td style="background-color: #d2ebfa; width: 25%;">Launch cost reduction; thermal management solutions<span></span></td></tr><tr><td colspan="4" style="background-color: #ecece9;">Sources: <a href="https://www.datacenterdynamics.com/en/news/spacex-files-for-million-satellite-orbital-ai-data-center-megaconstellation/" target="_blank">www.datacenterdynamics.com;</a> <a href="http://www.cnbc.com/" target="_blank">http://www.cnbc.com/</a>; <a href="https://www.infoq.com/news/2025/11/google-suncatcher-space/" target="_blank">www.infoq.com</a>; <a href="http://www.datacenterdynamics.com" target="_blank">www.datacenterdynamics.com</a>; <a href="https://services.google.com/fh/files/misc/suncatcher_paper.pdf" target="_blank">services.google.com</a>; <a href="https://starcloudinc.github.io/wp.pdf" target="_blank">starcloudinc.github.io</a>; <a href="https://research.google/blog/exploring-a-space-based-scalable-ai-infrastructure-system-design/" target="_blank">research.google/blog</a>; <a href="https://x.com/SawyerMerritt/status/2064108916611420273" target="_blank">x.com</a></td></tr></tbody></table><p class="caption">Three big proposals for orbital data centers vary in satellite size, number, and cooling plans.</p><h3></h3><br><p>One possible option is to shield the computers from radiation with thick, absorbent panels. However, the shielding would add significantly to the already heavy satellites. The other option is to compensate for the radiation damage with redundancy. Indeed, edge computing architects are moving toward software-defined resilience, where instead of one perfectly hardened computer, operators fly a cluster of imperfect, commercial ones whose total cost could be as low as one-tenth to one-hundredth that of the rad-hard model.</p><p>This redundant approach is used in many spacecraft, including <a href="https://cacm.acm.org/news/how-nasa-built-artemis-iis-fault-tolerant-computer/" target="_blank">Artemis II</a>, which recently carried astronauts around the moon, as well as SpaceX’s flight computers and the Hewlett Packard Enterprise edge servers for the International Space Station. By running three (or more) instances of the same calculation on three different nodes and comparing the answers, the system can detect a corrupted processor. If a node fails, the “orchestrator” reboots it while the others continue the mission. While this ensures resiliency, it also means that some fraction of the compute capacity is dedicated to redundancy, further increasing the costs.</p><h2>The Energy Challenge in Space</h2><p>An often-touted advantage of space-based data centers is the seemingly unlimited supply of free, clean energy from the sun. Solar energy in orbit is indeed abundant, at 1,361 watts per square meter. Of course, capturing that free energy is made possible only by the very costly launching of large solar panels into orbit. And those solar panels also degrade over time due to radiation exposure, typically losing 1 to 3 percent efficiency per year.</p><p>Let’s say a solar array collects 1 MW of power to run an AI cluster. The laws of physics demand that the satellite must eventually radiate 1 MW of waste heat. Because the square area needed to generate the solar power—<a href="https://www.energydawnice.com/solar-panel-output-per-square-meter/" rel="noopener noreferrer" target="_blank">around 400 W/m2</a>—and to reject the heat—around 450 W/m2—are nearly equivalent, every square meter of power generation now demands approximately another square meter of cooling. The radiator needs to be a structural equal, not merely a passive coating on a surface used for something else.</p><p>As Elon Musk recently <a href="https://www.youtube.com/watch?v=IgifEgm1-e0" rel="noopener noreferrer" target="_blank">noted</a> in Davos, the most efficient radiator is one that never sees the sun. By orienting the spacecraft so the solar panels face the sun and the radiators face the deep vacuum of space, efficiency skyrockets for both. But there’s a catch: Maintaining this perfect three-way alignment—panels to sun, radiator to the void, antennas to Earth—requires complex, high-torque attitude control systems. So this configuration means more payload and more computing power. Plus, these control systems are complex components with many failure modes, which is not optimal in a situation where maintenance is difficult.</p><h2>The Killer Apps for Computing in Space</h2><p>Given all these challenges of deploying massive radiators for satellites in the hostile environment of space, why build data centers in space at all?</p><p>While training or inference on LLMs in space doesn’t seem economical today, there are other, very compelling applications for computing in space. Here are two: solving the downlink bottleneck from Earth-observation satellites and enabling collision-preventing maneuvers in the increasingly crowded low Earth orbit.</p><p>The latest Earth-observation satellites, equipped with hyperspectral and synthetic aperture radar sensors, are used for a range of important reconnaissance missions, such as battlefield intelligence, tracking the global shadow fleet of ships carrying contraband, and assessing earthquakes or infrastructure failures down to the millimeter. These systems can generate hundreds of terabytes of raw data per day that must be transmitted to Earth. However, the radio-frequency “pipes” used to downlink the data are congested, and the ground infrastructure cannot absorb the sheer volume of raw data.</p><p>Another immediate, mission-critical application for in-space computation is protecting the orbital environment. With over 17,000 satellites in orbit, the overwhelming majority of which are in low Earth orbit, avoiding collisions between these satellites is crucial. As NASA astrophysicist <a href="https://en.wikipedia.org/wiki/Donald_J._Kessler" rel="noopener noreferrer" target="_blank">Donald Kessler</a> pointed out back in 1978, a <em>single</em> space collision could cause a cascading effect that renders the entirety of LEO unusable.</p><p class="ieee-inbody-related">RELATED: <a href="https://spectrum.ieee.org/kessler-syndrome-space-debris" target="_self">Have We Reached a Space-Junk Tipping Point?</a></p><p>According to SpaceX’s recent annual report, the Starlink constellation executes a collision avoidance maneuver every 2 minutes on average. Each maneuver already <a href="https://spacexstock.com/25000-collision-avoidance-maneuvers-lessons-from-starlink/" rel="noopener noreferrer" target="_blank">relies</a> on onboard AI systems but still requires most of the processing to happen on the ground.</p><h3></h3><br/><img alt="A rendering of the Starlink satellite system depicted as bright dots surrounding the Earth." class="rm-shortcode" data-rm-shortcode-id="413f7488561cf1957b75df3d60150db8" data-rm-shortcode-name="rebelmouse-image" id="ff99a" loading="lazy" src="https://spectrum.ieee.org/media-library/a-rendering-of-the-starlink-satellite-system-depicted-as-bright-dots-surrounding-the-earth.png?id=66879236&width=980"/><h3></h3><br/><p>As low Earth orbit gets increasingly populated, collision avoidance will have to break the traditional ground-loop model. In the megaconstellation era of space, the OODA (observe, orient, decide, act) loop must happen onboard, thereby reducing the analysis turnaround from minutes to milliseconds.</p><p>The problem is that the flight computers standard on satellites are not built for this level of processing. The complex probability models required for maneuvering cannot currently be implemented by onboard computers in conjunction with their navigation systems. Clearly, more powerful computers are needed.</p><p>This is the true economic justification for moving compute to space: to move insight generation there. By placing high-performance computing adjacent to the sensors, we can process terabytes of data in orbit and downlink only the relevant data in real time, and we can do the computations necessary to avoid satellite collisions in real time.</p><h2>The Future of Computing in Space</h2><p><strong></strong>So, assuming that some form of computing is inevitable in low Earth orbit in the foreseeable future, how will the heat be handled? The industry is currently experimenting with two main classes of solutions to cope with the Stefan-Boltzmann law.</p><p>One creative option is to use<strong> origami-inspired radiators,</strong> the kind used for the James Webb telescope. Companies are developing flexible, high-conductivity composite radiators that fold into a tight cube for launch and unfurl into enormous yet lightweight thermal wings in orbit.</p><p>Another possibility is to use<strong> liquid-droplet radiators.</strong> This concept proposes removing the rigid radiator structure completely and instead spraying a stream of coolant oil directly into the vacuum of space. The fluid travels through an open loop, exposed to the near-absolute zero of the void, maximizing radiative surface area before being caught by a collector and pumped back into the ship. It sounds like science fiction, but as the heat loads climb into the megawatts, liquid-droplet cooling may be the only way to cheat the mass limits of this exponential reality.</p><h3>Options for Future Radiator Design</h3><br/><img alt="Diagram of droplet-based heat exchanger system with labeled components and web-like graphs." class="rm-shortcode" data-rm-shortcode-id="a07a5b1926272e2c747f1de69ea6eda8" data-rm-shortcode-name="rebelmouse-image" id="ca3f4" loading="lazy" src="https://spectrum.ieee.org/media-library/diagram-of-droplet-based-heat-exchanger-system-with-labeled-components-and-web-like-graphs.png?id=66895778&width=980"/></br><p><strong> </strong>Our rough total-cost-of-ownership model uses optimistic versions of current numbers, such as launch cost, chip cost, and power use. A critic might point out that future technology will improve, both in efficiency, purpose-built designs, and costs.</p><p> Sure, the technology is bound to improve. But the critical factor isn’t just launch cost; it’s the computing power per unit mass and electric-power economics. Radiators and solar arrays can consume 65 to 70 percent of total satellite mass, and space-grade photovoltaics run orders of magnitude more expensive than terrestrial equivalents.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="Spiral polygonal grid resembling a twisted spiderweb on a light background" class="rm-shortcode" data-rm-shortcode-id="0809489b27553697e7814fdf4e3009ed" data-rm-shortcode-name="rebelmouse-image" id="e2ced" loading="lazy" src="https://spectrum.ieee.org/media-library/spiral-polygonal-grid-resembling-a-twisted-spiderweb-on-a-light-background.gif?id=66895750&width=980"/> <small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Chris Philpot</small></p><p>Even as launch costs fall, the mass and cost burden of power generation and thermal management will remain a fundamental problem.</p><p> Current space-grade solar panels rely on germanium substrates, whose supply is concentrated in China. It will be extremely difficult to scale up availability of these substrates. A transition to radiation-tolerant perovskite solar panels or a similar alternative could change the economics significantly, but that possibility is five years away or more. The technology will get cheaper, but the bottlenecks of power and thermal architecture will remain.</p><p><strong> </strong>Recognizing the thermal reality of cooling in space forces us to shift how we view satellite operations. We are moving away from the “launch and forget” era toward an era of “autonomous logistics.” As our thermal model demonstrated, the harsh environment of space steadily attacks the hardware. UV radiation degrades thermal coatings; cosmic rays degrade silicon. In a traditional satellite model, when the radiator degrades or the memory fails, the satellite becomes space junk. For a multimillion-dollar data center, that disposal model is potentially ruinous.</p><p> To make the economics of orbital computation work, the infrastructure must be serviceable and the rockets to launch them reusable. The orbital domain will require automated servicing vehicles capable of swapping out degraded radiator panels and upgrading fried servers. In these ways, the future of the orbital data centers is dependent on the innovations of an emergent in-space economy.</p><p> There’s a good argument to be made that the need for space-based computation is less of a hype cycle and more of an enabler for the new space economy. Look no further than SpaceX’s recent regulatory filings proposing a constellation of up to a million satellites in low Earth orbit. At such a scale, routing all raw data back to Earth is physically impossible; the network itself must become the data center.</p><p> However, the winners in this sector will be determined by the systems architects who most cleverly accommodate the thermodynamics and the companies with sufficient vertical integration to take on the massive costs of operating data centers in orbit. Ultimately, the physics tax is universal. Whether managing heat rejection in the vacuum of low Earth orbit or managing power density in a hyperscale facility in Northern Virginia, the constraint is never the silicon. It’s the thermodynamics. <span class="ieee-end-mark"></span></p>]]></description><pubDate>Thu, 11 Jun 2026 13:00:02 +0000</pubDate><guid>https://spectrum.ieee.org/orbital-data-centers-heat</guid><category>Orbital-data-centers</category><category>Radiative-cooling</category><category>Thermal-management</category><category>Solar-energy</category><category>Type-cover</category><dc:creator>Andrew Cavalier</dc:creator><media:content medium="image" type="image/png" url="https://spectrum.ieee.org/media-library/globe-surrounded-by-zeroes-and-ones-on-a-blue-background.png?id=66895710&amp;width=980"></media:content></item><item><title>Timing Trick Cuts Energy Used in LLM Training by Up to 14 Percent</title><link>https://spectrum.ieee.org/llm-training-energy-saving-trick</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/abstract-illustration-of-a-pixelated-cube-leaking-vibrant-colors-onto-a-dark-grid.jpg?id=66884338&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p><a href="https://openai.com/" rel="noopener noreferrer" target="_blank">OpenAI</a>’s fourth <a href="https://spectrum.ieee.org/what-is-deep-learning" target="_self">large language model</a> (LLM), <a href="https://openai.com/index/gpt-4-research/" rel="noopener noreferrer" target="_blank">GPT-4</a>, took an <a href="https://medium.com/data-science/the-carbon-footprint-of-gpt-4-d6c676eb21ae" rel="noopener noreferrer" target="_blank">estimated</a> 50 gigawatt-hours to train, or the equivalent of 5,000 <a href="https://www.eia.gov/tools/faqs/faq.php?id=97&t=3" rel="noopener noreferrer" target="_blank">American homes</a>’ yearly power consumption. That was in 2023. Since then, the computational resources used to train frontier LLMs have only <a href="https://epoch.ai/trends#training-runs" rel="noopener noreferrer" target="_blank">increased</a>, though direct <a href="https://spectrum.ieee.org/ai-energy-consumption" target="_self">power usage</a> numbers are hard to come by.</p><p>Now, a research group at the <a href="https://www.utwente.nl/en/" rel="noopener noreferrer" target="_blank">University of Twente</a> in the Netherlands has <a href="https://arxiv.org/abs/2601.08539" rel="noopener noreferrer" target="_blank">shown</a> that you can save up to 14 percent of the energy used in LLM training without sacrificing speed by cleverly adjusting the clock frequency of the GPU during computation. <a href="https://www.linkedin.com/in/jeffrey-spaan-a3723561/" rel="noopener noreferrer" target="_blank">Jeffrey Spaan</a>, Ph.D. candidate at University of Twente and lead author on the article, presented the results at the <a href="https://www.computingfrontiers.org/2026/index.html" rel="noopener noreferrer" target="_blank">Computing Frontiers</a> conference in Catania, Sicily, last month.</p><p>“My research is about finding computing waste,” Spaan says. “It’s similar to underutilization of the hardware, but instead of optimizing the software for the hardware, we try to optimize the hardware for the software.”</p><h2>Making the GPU tick </h2><p>Spaan and his collaborators accomplished this by using a technique known as dynamic voltage and frequency scaling (<a href="https://www.sciencedirect.com/topics/computer-science/dynamic-voltage-and-frequency-scaling" rel="noopener noreferrer" target="_blank">DVFS</a>). Every chip—including the GPUs commonly used for training frontier models—uses at least one clock to orchestrate computations. Each operation in the chip is triggered by a clock pulse. The frequency with which that clock ticks controls how fast the chip operates and how much power it draws.</p><p>Modern GPUs have two clocks, one for the computational core and one for the memory. When the core is hard at work crunching numbers, the clock frequency is kept high to ensure speedy calculation. However, with DVFS, the memory clock can slow down in that time, allowing for less power draw. In principle, it’s possible to just turn off the memory part of the chip, but GPUs designs don’t enable software control for that off switch, and it would take too long to turn back on mid-calculation anyway. Similarly, when the core is waiting for data to be loaded from memory, the core clocking frequency can be slowed to a crawl while the memory clock frequency ramps up.</p><p>DVFS has been a well-known technique that goes back to at least the 1990s. But Spaan says other researchers haven’t been able to usefully apply it to LLM training because their methods either slowed down calculations too much or were not fine-grained enough to improve energy usage. </p><p>Previous DVFS attempts adjusted the frequency at each iteration of the training process. In LLM training, each iteration consists of two parts: the forward pass, in which data is run forward through the layers of the model with the weights as they are; and backpropagation, in which the weights are adjusted layer by layer based on the results of the forward pass. So prior work kept one value of the frequency for the forward pass and adjusted to another for backpropagation. </p><p>Spaan and coworkers tuned the clock frequencies on a shorter timescale. GPU workloads are broken down into tiny computational nuggets known as <a href="https://modal.com/gpu-glossary/device-software/kernel" rel="noopener noreferrer" target="_blank">kernels</a>. For example, a single vector-vector multiplication can make up a single kernel. The kernels are fed to the GPU to be processed many times in parallel. In Spaan’s implementation, the computation of a single layer of a deep neural network is broken up into approximately 40 kernels. By adjusting the clocking frequencies on a per-kernel level, the team was able to find much greater energy savings.</p><p>The GPU also does DVFS automatically when the chip’s internal systems detect higher or lower demand, Spaan notes. “Some people might therefore think: We’ll just let the GPU handle it,” he says. “However, because the GPU doesn’t have the foresight we have of what kernels will run, it has to work with an on-the-fly best-effort guess and can therefore never attain the same savings.” That’s where the manual adjustments come in.</p><h2>Less energy, same time</h2><p>The team performed their experiment by training GPT-3-XL, a 1.3 billion parameter model, on an <a href="https://www.nvidia.com/en-us/geforce/graphics-cards/30-series/rtx-3080-3080ti/" rel="noopener noreferrer" target="_blank">Nvidia RTX 3080 Ti</a> GPU. To save time, they focused on training a single layer of the model. In this setting, they found a set of frequency adjustments that gave them 14 percent energy savings while slowing the training time by only 0.6 percent. Performance of the model depends on both computing speed and energy usage. </p><p>There is one challenge: Ramping down the clock frequency is much faster than turning a core off and on, but it’s still not instantaneous. In their experiment, the researchers evaluated one kernel at a time, not taking into account the frequency switching speed. So 14 percent energy savings is a best-case scenario. How much of an issue it would be in practice, Spaan says, depends heavily on the GPU being used. Newer hardware, like the Blackwell GPUs, have much <a href="https://images.nvidia.com/aem-dam/Solutions/geforce/blackwell/nvidia-rtx-blackwell-gpu-architecture.pdf" rel="noopener noreferrer" target="_blank">faster</a> switching speeds than older versions and should be able to harness the full energy savings.</p><p>Now, the team is developing a tool that would be able to implement optimal frequency scaling automatically for a particular workload. Spaan hopes their method will be attractive enough to industry leaders to merit adoption. “We optimize for saving energy without losing performance,” Spaan says. “In the real world, performance is the holy grail.”</p>]]></description><pubDate>Wed, 10 Jun 2026 11:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/llm-training-energy-saving-trick</guid><category>Training</category><category>Ai-energy</category><category>Llms</category><category>Clock-speeds</category><category>Processor-clock</category><dc:creator>Dina Genkina</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/abstract-illustration-of-a-pixelated-cube-leaking-vibrant-colors-onto-a-dark-grid.jpg?id=66884338&amp;width=980"></media:content></item><item><title>This Operating System Reveals a Chip’s Dark Secrets</title><link>https://spectrum.ieee.org/fractal-os-operating-system-security</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/conceptual-illustration-of-a-computer-chip-floating-against-a-techno-grid-background.jpg?id=66879542&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p>Modern operating systems are packed with defenses against <a data-linked-post="2674029717" href="https://spectrum.ieee.org/unitree-robot-exploit" target="_blank">security vulnerabilities</a>. But what if those defenses could be removed? Doing so would offer a clear view of the chip running the OS. It would also expose hardware vulnerabilities the OS normally obscures.</p><p>A new hand-coded OS, <a href="https://fractal-os.com/" rel="noopener noreferrer" target="_blank">Fractal</a>, provides that clear view. Built from scratch by researchers at MIT’s <a href="https://www.csail.mit.edu/" rel="noopener noreferrer" target="_blank">Computer Science and Artificial Intelligence Laboratory</a> (CSAIL), Fractal is designed to probe the architecture of the chip that runs it. To prove that point, the OS, presented in May at the <a href="https://sp2026.ieee-security.org/" rel="noopener noreferrer" target="_blank">2026 IEEE Symposium on Security and Privacy in San Francisco</a>, was used to uncover a previously unknown vulnerability in Apple’s M1 chip.</p><p><a href="https://jprx.io/" rel="noopener noreferrer" target="_blank">Joseph Ravichandran</a>, the CSAIL Ph.D. student who programmed Fractal, says the OS was inspired by obstacles faced while researching <a href="https://pacmanattack.com/" rel="noopener noreferrer" target="_blank">Pacman</a>, an Arm CPU vulnerability disclosed in 2022.</p><p>“We paved the way with techniques such as custom kernel patches and kernel extensions,” Ravichandran explains—but these were only a partial solution. “The dream was always to have a completely custom operating system which would make these hacks unnecessary.”</p><h2>Probing Chip Data Storage & Movement</h2><p>Researchers exploring <a data-linked-post="2652904010" href="https://spectrum.ieee.org/darpa-hacks-its-secure-hardware-fends-off-most-attacks" target="_blank">hardware vulnerabilities</a> need to know exactly how data is stored and moved across a chip. They deduce this by coding tests that provoke desired behavior from a chip and then analyzing the results to reconstruct how the chip executed the code.<br/><br/>However, a conventional OS like Windows or MacOS will have defenses and features that obfuscate code execution and memory management. “I’ve built a number of lab exercises for our secure hardware design course,” Ravichandran says. “Seeing the struggles that students go through, and living those struggles myself in my research, I realized there just has to be a better way.”</p><p>Fractal is the obvious solution to the problem. Instead of patching or exploiting a conventional OS, Fractal entirely replaces a device’s original OS with a customized alternative focused on security research. </p><p>As you might expect, however, coding an OS is no small feat. Fractal was coded from scratch with a combination of programming languages including assembly, C, and C++. Ravichandran began work in June 2024 and finished the first version of the OS at the end of that year, after which it went through months of testing. Debugging was the most difficult step, as building a custom OS for hardware not designed to support it eliminated debugging tools from the equation.<br/><br/>“When getting Fractal to run on <a href="https://developer.apple.com/documentation/apple-silicon" rel="noopener noreferrer" target="_blank">Apple Silicon</a>, for the longest time the only output I had was the power light on the front of the machine,” Ravichandran says. “This light told me whether my code was running, and the light stayed on; or if the machine had crashed for some reason, and the light turned off.”</p><h2>Fractal OS Features for Security Research</h2><p>Fractal provides researchers with three key features.</p><p>The first, headline feature is multi-privilege concurrency. On a conventional OS, comparing a chip’s behavior across privilege levels—which control a program’s access to system resources—is extremely difficult. Switching levels also shifts the memory layout, the CPU’s branch-predictor state, and more, all of which adds variables that skew test results. Fractal can run a test concurrently across privilege levels while holding other parameters identical, which leads to a much cleaner test result.</p><p>The second feature is cooperative multitasking, an alternative to a conventional OS feature called preemptive multitasking. Preemptive multitasking is an important feature for a modern OS, as it’s used to juggle the dozens or hundreds of tasks which might be active at once—but it can also pause a test if the OS decides another task matters more, which adds noise to the test result. Fractal’s cooperative multitasking, when enabled, allows a user to dictate the order in which code executes with no interruptions.</p><p>The final feature is Fractal’s memory system, called gmap. In a conventional OS, a program reaches memory through virtual addresses that the OS maps to real hardware. This mapping can change between tests. Gmap instead mirrors memory locations across threads and tasks, eliminating yet another variable. </p><p>The common threads across these features are control and clarity. “Fractal’s aim is to tell you simply what the hardware does as accurately as possible,” Ravichandran says. “Using the information learned from Fractal, researchers will be better equipped to understand how the hardware itself behaves independent of the OS.”</p><h2>Discovering Phantom Speculation on M1</h2><p>To show what Fractal could do, Ravichandran aimed it at Apple’s M1, a victim chosen primarily because it was the hardware on hand. </p><p>Fractal made it possible to find the first evidence that Apple Silicon is affected by a form of <a href="https://comsec.ethz.ch/wp-content/files/phantom_micro23.pdf" rel="noopener noreferrer" target="_blank">Phantom speculation</a>, which in some cases can let an attacker momentarily direct a chip down a path an attacker chose. Phantom was known to be present in Advanced Micro Devices (AMD) and Intel hardware but was never proven to be present in Apple’s M1—until now.</p><p>The practical effect of the vulnerability is likely limited. Fractal found that while Phantom fetches can occur on Apple’s M1, the instructions are never executed. Ravichandran declined to speculate on how the vulnerability might be used in the wild and said that the vulnerability was disclosed to Apple.</p><p>Though primarily tested on a Mac Mini equipped with Apple’s M1, Fractal also runs on many Intel and AMD PCs, Raspberry Pis, and some more recent Apple Silicon devices like the Mac Mini with Apple M4. Fractal is freely available to download as an open source OS under the MIT license. Ravichandran has posted the kernel to <a href="https://github.com/jprx/fractal" rel="noopener noreferrer" target="_blank">Github</a> and the full experimental setup on <a href="https://zenodo.org/records/19557478" rel="noopener noreferrer" target="_blank">Zenodo</a>, with additional details available on <a href="https://fractal-os.com/" rel="noopener noreferrer" target="_blank">Fractal’s website</a>.</p><p>Ravichandran is eager to see how other researchers make use of Fractal to explore other microarchitectures. “Right now, my goal is to get this system out into the world so other researchers can benefit from it,” he says. “My hope is that Fractal becomes a community project with contributions from other research labs who benefit from this approach.”</p>]]></description><pubDate>Tue, 09 Jun 2026 11:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/fractal-os-operating-system-security</guid><category>Operating-systems</category><category>Security</category><category>Apple</category><category>Amd</category><category>Intel</category><dc:creator>Matthew S. Smith</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/conceptual-illustration-of-a-computer-chip-floating-against-a-techno-grid-background.jpg?id=66879542&amp;width=980"></media:content></item><item><title>Nvidia’s AI Hardware Comes to Windows in RTX Spark PCs</title><link>https://spectrum.ieee.org/nvidia-rtx-spark-windows-pc</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/3d-rendering-of-a-pc-chip.jpg?id=66865922&width=1245&height=700&coordinates=0%2C62%2C0%2C63"/><br/><br/><p>At Computex 2026, an annual computer trade show held in Taipei, Taiwan, Nvidia made a long anticipated announcement—a version of the company’s Blackwell GB10 superchip for Windows PCs, called RTX Spark. <a href="https://www.windowscentral.com/hardware/nvidia/nvidia-n1x-opencl-leak-cuda-cores-rtx-5070" rel="noopener noreferrer" target="_blank">Originally rumored to launch in 2025</a>, it was finally introduced at this year’s show.</p><p>It came with full support from Microsoft, which announced two new devices powered by RTX Spark: the <a href="https://www.microsoft.com/en-us/surface/devices/surface-laptop-ultra" rel="noopener noreferrer" target="_blank">Surface Laptop Ultra</a> and the <a href="https://www.microsoft.com/en-us/surface/devices/surface-rtx-spark-dev-box" rel="noopener noreferrer" target="_blank">Surface RTX Spark Dev Box</a>. Asus, Dell, Lenovo, HP, and MSI also announced Windows PCs with RTX Spark.</p><p>If this is triggering déjà vu, that’s for good reason. In June 2024, Qualcomm and Microsoft partnered to launch AI-focused Copilot+ PCs. <a href="https://spectrum.ieee.org/qualcomm-snapdragon-x2" target="_blank">Qualcomm’s Arm-based chips</a> provided an alternative to x86-based chips from AMD and Intel used across dozens of budget and mid-range Windows laptops. It was met with mixed commercial success, however, and Intel remains the dominant supplier of chips for Windows laptops. But that doesn’t mean RTX Spark will follow the same path, as Nvidia’s involvement is an important part of the equation. </p><p>“Nvidia just has more clout and more industry weight to push and make things happen that Qualcomm couldn’t do early on, and that even Microsoft struggled with,” says <a href="https://www.linkedin.com/in/ryanshrout/" rel="noopener noreferrer" target="_blank">Ryan Shrout</a>, president at <a href="https://signal65.com/" rel="noopener noreferrer" target="_blank">Signal65</a>, a third-party testing firm. “They can get game developers on board and get software developers in the emerging AI space to pay attention.”</p><h2>What is RTX Spark?</h2><p>At its core, <a href="https://www.nvidia.com/en-us/products/rtx-spark/" rel="noopener noreferrer" target="_blank">RTX Spark</a> is an iteration of the hardware found in the <a href="https://www.nvidia.com/en-us/products/workstations/dgx-spark/" rel="noopener noreferrer" target="_blank">DGX Spark</a> mini-workstation, which was released in late 2025. Officially badged N1X, the silicon is Nvidia’s Blackwell GB10 “superchip,” a system-on-a-chip with 20 Arm CPU cores; 6,144 GPU cores; and support for up to 128 gigabytes of LPDDR5X memory. </p><p>There are some small differences between the mini-workstation and PC system, and the most significant is power consumption. The DGX Spark was designed for GB10 to operate with a power consumption up to 140 watts without overheating. RTX Spark laptops are likely to use less power, which may lower performance, though the details will depend on each PC maker’s particular implementation and remain to be seen.</p><p>RTX Spark will also <a href="https://spectrum.ieee.org/ai-models-locally" target="_blank">include a neural processing unit</a> (NPU) that qualifies the system for Microsoft’s Copilot+ certification. The NPU is used for some background AI features, like Windows Recall. However, the GPU will remain in the driver’s seat for active AI tasks, including large language models (LLMs) and image generation.</p><p>Though RTX Spark laptops took the spotlight, the news is also relevant to desktop workstations. Currently, DGX Spark ships with a custom version of Linux called DGX OS, not Windows. Nvidia says RTX Spark desktops with Windows are coming in the third quarter of 2026. <a href="https://www.nvidia.com/en-us/products/workstations/dgx-station-for-windows/" rel="noopener noreferrer" target="_blank">Windows is also coming to Nvidia’s DGX Station</a>, the full-sized desktop iteration of Nvidia’s hardware. </p><p>The launch of RTX Spark is, of course, in part an AI play, and that is taking the lion’s share of attention. But <a href="https://www.linkedin.com/in/anshel-sag-7484127/" rel="noopener noreferrer" target="_blank">Anshel Sag</a>, principal analyst at <a href="https://moorinsightsstrategy.com/" rel="noopener noreferrer" target="_blank">Moor Insights & Strategy</a>, thinks Spark is just as relevant for professional work and gaming. “I think the AI play is mostly to appease investors,” he says. “Creators and gamers are also excited about RTX Spark, and someone like me who does all three is even more excited, because having a machine that can do all three well has been a challenge.”</p><h2>Nvidia’s advantage may lie in software </h2><p>Though Nvidia refers to the GB10 as a “superchip,” it’s similar to other high-performance system-on-a-chip designs, such as Apple’s M-series silicon and AMD’s Ryzen AI Max. All three include a CPU, GPU, and NPU. All three support large amounts of DRAM. And all three have a unified memory architecture (meaning the system memory is a shared resource accessible to the CPU, GPU, and NPU). </p><p>The existing DGX Spark also provides a baseline for performance expectations. RTX Spark will likely deliver GPU performance similar to an RTX 5070 mobile GPU which, if correct, would put it ahead of Apple and AMD’s competing systems. On the other hand, GB10’s CPU cores <a href="https://www.phoronix.com/review/nvidia-gb10-cpu/6" rel="noopener noreferrer" target="_blank">aren’t as quick as the CPU cores</a> found in leading competitors. </p><p>Nvidia’s biggest edge might stem not from hardware performance, but from software. The company’s GPUs are essentially the industry standard across gaming and professional work, <a href="https://www.pcworld.com/article/3079686/nvidia-dominates-pc-graphics-cards-eating-94-of-the-market.html" rel="noopener noreferrer" target="_blank">with estimates placing Nvidia’s GPU market share above 90 percent</a>. That in turn has made Nvidia the target for most software that benefits from a GPU.</p><p>“Nobody doubts that Nvidia is the leader in GPU capability and the software stack around it,” says Shrout. Sag agrees, explaining that Nvidia has the advantage of “extremely mature drivers.” </p><h2>Microsoft touts AI, but Windows on Arm remains a question</h2><p>Nvidia announced RTX Spark was in lockstep with Microsoft, which held its Build developer conference in San Francisco while Computex was taking place across the Pacific in Taipei.</p><p>Repeating the Copilot+ PC launch, Microsoft’s vision of Windows on the RTX Spark leans heavily on AI. But unlike Copilot+ PCs—<a href="https://spectrum.ieee.org/microsoft-copilot" target="_self">which used the NPU to accelerate AI features integrated into the Windows user experience</a>, such as quickly recalling anything you’ve opened or translating live video calls—the pitch for Windows running on RTX Spark seems more focused on using the Spark’s GPU to accelerate LLMs.</p><p>Microsoft announced an “early preview” of Windows SDK called <a href="https://blogs.windows.com/windowsdeveloper/2026/06/02/windows-platform-security-for-ai-agents/" rel="noopener noreferrer" target="_blank">Microsoft Execution Containers (MXC)</a>, which sandboxes AI agents, allowing them to work autonomously while isolating them from functions the user doesn’t want the agent to access. </p><p>Still, the real test for both Nvidia and Microsoft remains the same challenge Microsoft and Qualcomm faced: establishing Windows on Arm PCs as an alternative to Windows PCs powered by x86 chips from Intel and AMD. Whether RTX Spark will succeed in this remains to be seen.</p><p>“Even with all of the talk from Nvidia and Microsoft about the future of the PC and revolutionizing the PC, everybody understands that it needs to be a great general-purpose PC first,” says Shrout.</p>]]></description><pubDate>Sat, 06 Jun 2026 12:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/nvidia-rtx-spark-windows-pc</guid><category>Nvidia</category><category>Pcs</category><category>Windows</category><category>Arm</category><category>Ai-hardware</category><dc:creator>Matthew S. Smith</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/3d-rendering-of-a-pc-chip.jpg?id=66865922&amp;width=980"></media:content></item><item><title>NSF Experiments With New Kind of Science Funding</title><link>https://spectrum.ieee.org/nsf-x-labs</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/conceptual-illustration-of-a-futuristic-atomic-particle-core-on-a-digital-hud-data-display.jpg?id=66853198&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p>Uncle Sam wants you to solve big <a href="https://www.nature.com/articles/d41586-022-00018-5" rel="noopener noreferrer" target="_blank">scientific and engineering bottlenecks</a> outside the hallowed walls of academia. On 14 May, the U.S. National Science Foundation (NSF) issued a <a href="https://www.nsf.gov/tip/updates/nsf-announces-15b-nsf-x-labs-initiative-pursue-generational" rel="noopener noreferrer" target="_blank">solicitation</a> inviting what it calls “X-Labs,” or independent research organizations, to apply for a total of US $1.5 billion over 10 years. The structure of the X-labs solicitation is new for the United States government and closely matches an emerging private funding model for what are known as focused-research organizations (FROs), which various think tanks and philanthropies have <a href="https://fas.org/publication/focused-research-organizations-to-accelerate-science-technology-and-medicine/" rel="noopener noreferrer" target="_blank">proposed</a> and <a href="https://issues.org/focused-research-organizations-fro-marblestone-gamick-wang-fridman/" rel="noopener noreferrer" target="_blank">tested</a> during the last six years.</p><p>A focused-research organization is a team of scientists, engineers, and other technology developers that works on a well-defined problem with a target duration of three to seven years and on a budget in the tens of millions of dollars. Some examples have sought to build an <a href="https://spectrum.ieee.org/bci-ultrasound" target="_self">ultrasound-based brain-computer interface</a>, <a href="https://spectrum.ieee.org/ocean-carbon-removal" target="_self">quantify marine CO<sub>2</sub> removal</a>, and <a href="https://spectrum.ieee.org/ai-proof-verification" target="_self">improve formal verification in mathematics</a>. The funding for these FROs required a team approach to science larger and more agile than a typical academic lab but with a more academic appetite for scientific risk than a commercial venture might have. In some ways, they echo work done by the Defense Advance Research Projects Agency (DARPA), which is known for helping bridge high-risk research and early-stage commercialization of many technologies. </p><p>“The NSF’s X-Labs announcement is a welcome signal that the global research community is serious about finding new ways to fund ambitious, high-risk science,” says <a href="https://www.linkedin.com/in/pippy-james/" target="_blank">Pippy James</a>, deputy CEO of the <a href="https://aria.org.uk/about-aria/" target="_blank">Advanced Research + Invention Agency (ARIA)</a>, a United Kingdom government funding body in London that uses a similar model to the X-Labs.</p><p>The NSF’s first two X-Lab research areas are <a href="https://sam.gov/workspace/contract/opp/f58da497f6ad4bd9ab7ca021eee479e2/view" rel="noopener noreferrer" target="_blank">scientific instrumentation for sensing and imaging</a> and <a href="https://sam.gov/workspace/contract/opp/cdce081fa4aa4bcaa70003db71919a36/view" rel="noopener noreferrer" target="_blank">interconnects and integrated photonics for quantum systems</a>, and the solicitation says the agency will announce additional topics within weeks. </p><p>The funding is structured <a href="https://sam.gov/workspace/contract/opp/0918909712164c78af1ef29055a02f7b/view" rel="noopener noreferrer" target="_blank">in phases</a>, with $1.5 million per project in the first year, then up to $50 million per project over the next two to three years for selected projects, with a third, more open-ended phase after that. That first-year funding is more than seven times as much as for <a href="https://nsf-gov-resources.nsf.gov/files/04_fy2025.pdf?VersionId=p8rlqMsPAwAgX9xJuzDBHV5bmXdImVme" rel="noopener noreferrer" target="_blank">the typical NSF project</a> of around $200,000.</p><p>“Compared to incremental, project-based grants, larger institutional grants and longer-horizon grants let teams take on harder, more infrastructure-heavy problems with the agility to pivot as they learn,” says <a href="https://www.jenngustetic.me" target="_blank">Jenn Gustetic</a>, director of metascience and R&D policy at the <a href="https://ifp.org" rel="noopener noreferrer" target="_blank">Institute for Progress</a> (IFP), a Washington, D.C. think tank that made a <a href="https://ifp.org/how-x-labs-can-unleash-ai-driven-scientific-breakthroughs/" rel="noopener noreferrer" target="_blank">proposal</a> last year for how the U.S. government could support more independent research organizations.</p><p>The NSF solicitation also requires applicants to demonstrate “substantial” independence from any non-X-Lab institutions such as a university or company, which the NSF defined in part to mean the ability to make decisions on research direction, partnerships, and staff in days rather than weeks. It would be difficult for a full-time researcher at a university to qualify, for example, which opens the door to industry researchers or academics willing to take extended leave. </p><h2>What should new money for science look like?</h2><p>“People have been kind of wanting to do [focused research organizations] in a fairly bipartisan way since 2020,” says <a href="https://www.adammarblestone.org" target="_blank">Adam Marblestone</a>, an early proponent who now directs <a href="https://www.convergentresearch.org" rel="noopener noreferrer" target="_blank">Convergent Research</a>, a Cambridge, Mass., nonprofit that has spent almost $400 million building <a href="https://www.convergentresearch.org/ecosystem" rel="noopener noreferrer" target="_blank">a dozen FROs</a>. Some larger goal-directed, rather than principal-investigator-centered, funding has existed for decades in other federal agencies in the form of the Advanced Research Projects Agencies for defense, intelligence, energy, and most recently health. ARPA program managers often took a more <a href="https://emergingtechpolicy.org/federal-rd-funding/#funding-models-and-mechanisms" rel="noopener noreferrer" target="_blank">hands-on and flexible approach</a> than typical three-year National Institutes of Health (NIH) or NSF grant managers could. On 2 June, the IFP published an <a href="https://atlasofinnovation.org/" rel="noopener noreferrer" target="_blank">Atlas of Innovation</a> comparing many different research funding structures. </p><p>The NSF announcement comes against a backdrop of administration requests for dramatic cuts to the agency’s budget, though Congress has generally <a href="https://www.aip.org/fyi/fy2025-nsf-budget-and-appropriations" rel="noopener noreferrer" target="_blank">appropriated stable amounts</a>. NSF has, however, not disbursed all its appropriated funding, because the Trump administration has been feuding with many universities, accusing them of discrimination, and suing them. Most recently, NSF stopped new funding for several prominent universities, <em><em>Nature</em></em> <a href="https://www.nature.com/articles/d41586-026-01667-6" rel="noopener noreferrer" target="_blank">reported</a>. MIT’s president in May said that the university has <a href="https://president.mit.edu/writing-speeches/video-transcript-message-president-kornbluth-about-funding-and-talent-pipeline" rel="noopener noreferrer" target="_blank">won 10 percent less federal money</a> than the previous year.</p><p>The big-ticket nature of the X-labs might make administrators and principal investigators at those universities worry about whether it will impact their own funding. “I don’t think it’s a zero-sum game,” says <a href="https://fas.org/expert/erica-goldman/" target="_blank">Erica Goldman</a>, director of policy entrepreneurship at the <a href="https://fas.org" rel="noopener noreferrer" target="_blank">Federation of American Scientists</a>, a Washington, D.C. science-policy think tank, “but the way the timing of the announcements have come out and the rhetoric out there make it very hard to see that.”</p><p>“NSF X-Labs is structured to complement the existing system, not displace it—adding an independent institutional type alongside universities, national labs, small businesses and corporate R&D,” the IFP’s Gustetic says. The X-Labs annual sticker price represents less than 2 percent of the agency’s overall budget of $8.75 billion in 2026.</p><p>The emerging field of <a href="https://scienceplusplus.org/metascience/index.html" rel="noopener noreferrer" target="_blank">metascience</a>, which investigates how best to do science, has been debating how governments should build the proper pipelines for converting blue-sky research into returns for all taxpayers. Metascientists differ over how FROs should fit into the research system. Some argue that governments <a href="https://www.nature.com/articles/d41586-021-01878-z" rel="noopener noreferrer" target="_blank">can’t expect to apply the vaunted DARPA model to everything</a>. Others write that FROs are a great idea and that the federal government <a href="https://www.macroscience.org/p/metascience-is-ignoring-the-national?utm_source=substack&utm_medium=email" rel="noopener noreferrer" target="_blank">already has a version of them</a> in the form of the Department of Energy’s National Labs, which have spun off science platforms such as the Human Genome Project and the Protein Data Bank.</p><p>NSF media affairs head <a href="https://www.linkedin.com/in/englandmichael/" target="_blank">Mike England</a> told <em>IEEE Spectrum</em> that “X-labs creates space and provides funding for new institutions to achieve breakthroughs in scientific discovery, research, and translation, and ultimately helps create new platform technologies.” In addition, on 27 May NSF <a href="https://sam.gov/workspace/contract/opp/4998d1c8f414490fb5590752d607f21b/view" rel="noopener noreferrer" target="_blank">requested information</a> for a new funding idea adjacent to X-Labs it calls <a href="https://www.nsf.gov/funding/initiatives/tech-accelerators" rel="noopener noreferrer" target="_blank">Tech Accelerators</a>. These would use NSF money and accelerator expertise to fund and guide “deep-tech” commercialization efforts in agriculture, materials, ocean, and scientific instrumentation.</p><p>Other elements of government are also exploring how to incorporate the FRO funding model. In December 2025, U.S. Representative Josh Harder (D-Calif.) introduced a <a href="https://www.congress.gov/bill/119th-congress/house-bill/6572/all-actions-without-amendments" rel="noopener noreferrer" target="_blank">bill</a> that would apply the X-labs model to the NIH. England says that NSF is having conversations with other government agencies about the model and welcomes more agencies to explore it. </p><p>“We don’t have great evidence comparing how different funding mechanisms perform—individual project grants, milestone-based contracts, prize challenges, etc.” Gustetic says. “X-Labs is a chance to actually learn something about which institutional designs work for which kinds of problems.”</p><p>Universities will likely have to adapt to the new model. Mid-career academics may well want to take time away from their university homes to participate in an X-Lab or other FRO project, says <a href="https://www.monicadus.com/team" target="_blank">Monica Dus</a>, director of the <a href="https://research.umich.edu/office-of-national-labs/" rel="noopener noreferrer" target="_blank">Office of National Laboratories</a> at the University of Michigan and a holder of NSF grants. Institutions will need to figure out how to cover teaching duties in their absence and how to assess commercial experience for tenure or other internal promotions. “Universities should adapt to make sure the research does really reach the people it is meant for,” she says.</p><p>Academics may also need to change their approach to succeed, Convergent’s Marblestone says. “When we go to academics at Convergent, it takes a few conversations to plan it, because they don’t always know how they’d manage $50 million and a professional engineering team. You really need a CEO.”</p><a href="https://fas.org/expert/daniel-correa/" target="_blank">Daniel Correa</a>, CEO of the Federation of American Scientists, which published a <a href="https://fas.org/publication/focused-research-organizations-to-accelerate-science-technology-and-medicine/" rel="noopener noreferrer" target="_blank">2020 call for FROs</a>, is optimistic about the NSF’s ability to get results from X-Labs. “The team at NSF did a lot of due diligence talking to folks on the outside, not just policy people but people that are building these labs, and integrated some of the key elements into the contours of the solicitation,” he says.]]></description><pubDate>Thu, 04 Jun 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/nsf-x-labs</guid><category>Nsf</category><category>Higher-education</category><category>Darpa</category><category>Science-policy</category><dc:creator>Lucas Laursen</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/conceptual-illustration-of-a-futuristic-atomic-particle-core-on-a-digital-hud-data-display.jpg?id=66853198&amp;width=980"></media:content></item><item><title>The Classical Advances Needed to Make Quantum Computers Tick</title><link>https://spectrum.ieee.org/quantum-calibration-decoding</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/photo-collage-of-server-wires-overlapping-with-a-quantum-computers-superconducting-lines.jpg?id=66852633&width=1245&height=700&coordinates=0%2C469%2C0%2C469"/><br/><br/><p>Quantum computers promise to one day solve problems beyond the most powerful supercomputers imaginable. But it’s often underappreciated how much classical computing it takes just to operate these machines. As qubit counts rise, innovations in this supporting infrastructure will be essential if they’re to live up to their promise.</p><p>To prepare for the scale of quantum computers the industry is working toward, many companies are also gearing up the classical hardware, and software, required to support them. In April, Nvidia <a href="https://developer.nvidia.com/ising?size=n_6_n" rel="noopener noreferrer" target="_blank">announced</a> new AI-based software to accelerate the classical tasks that enable quantum computers. Sydney-based quantum software company <a href="https://q-ctrl.com/" rel="noopener noreferrer" target="_blank">Q-CTRL</a> has developed an<a href="https://q-ctrl.com/technology/quantum-computer-autocalibration" rel="noopener noreferrer" target="_blank"> automatic calibration algorithm</a> for quantum computers, and is now <a href="https://q-ctrl.com/blog/scaling-quantum-autonomy-with-nvidia-ising" rel="noopener noreferrer" target="_blank">leveraging</a> Nvidia’s agent-based system. Other companies, including <a href="https://www.ibm.com/quantum?utm_content=SRCWW&p1=Search&p4=318569493295&p5=p&p9=196351357812&gclsrc=aw.ds&gad_source=1&gad_campaignid=23423681724&gbraid=0AAAAAD-_QsScZCuULMxdFOkQ5b_2MNwwg&gclid=Cj0KCQjw_vnQBhCxARIsADcZyxJVWxymnYXSvyFK8eNpTpku6HCqSfpon3KvvZKLBk9mYwws0RkQCVkaAtf_EALw_wcB" rel="noopener noreferrer" target="_blank">IBM Quantum</a>, Cambridge, England–based <a href="https://www.riverlane.com/" rel="noopener noreferrer" target="_blank">Riverlane</a>, which develops quantum-error correction, and <a href="https://quantumai.google/quantumcomputer" rel="noopener noreferrer" target="_blank">Google Quantum AI</a>, are developing similar tools. </p><h2>The Role of Classical in Quantum </h2><p>Digital computer chips are marvels of engineering, operating flawlessly out of the box and capable of trillions of operations without error. The quantum bits, or qubits, at the heart of a quantum computer, by contrast, are temperamental and unreliable, requiring regular calibration and complex <a href="https://spectrum.ieee.org/quantum-error-correction" target="_self">error-correcting schemes</a> to keep them on track.</p><p>Calibration and error-correction are fundamentally classical, not quantum, problems, and they require dedicated classical hardware to solve. As quantum computers get bigger, the scale of those resources will need to rise in lockstep. That means that for the foreseeable future, quantum computers are going to be <a href="https://spectrum.ieee.org/ibm-quantum-computer-2668978269" target="_self">hybrid devices</a> with a healthy dose of classical computing on the side.</p><p>“The cheapest and fastest way to execute most computer programs is to run them on a classical computer—even if a quantum computer is available,” says <a href="https://www.linkedin.com/in/adamzalcman/" rel="noopener noreferrer" target="_blank">Adam Zalcman</a>, a quantum software engineer at Google Quantum AI. “This is true of most of the information processing involved in running a quantum computer itself.... Therefore, I expect that every practical and efficient quantum-computer architecture will incorporate fast classical devices.”</p><h2>Tuning Quantum Hardware</h2><p>While the transistor has cemented its place as the foundational component of classical chips, the qubits at the heart of a quantum computer come in many flavors—superconducting circuits, <a href="https://spectrum.ieee.org/longlasting-qubits" target="_self">trapped ions</a>,<a href="https://spectrum.ieee.org/neutral-atom-quantum-computing" target="_self"> neutral atoms</a>, even individual <a href="https://spectrum.ieee.org/quantum-computers" target="_self">photons</a>. Using them for computation requires a painstaking calibration process to turn the “bare metal” of the underlying hardware into a qubit that can be controlled to run quantum circuits, says <a href="https://www.linkedin.com/in/james-guilmart/" rel="noopener noreferrer" target="_blank">Jay Guilmart</a>, lead product manager at Q-CTRL.</p><p>Calibration has two stages. The first, known as “bring up,” determines the frequency at which each qubit resonates, how long it holds its quantum state, its sensitivity to control pulses, and the strength of its interactions with neighboring qubits. All of these factors determine its error propensity and response to control signals.</p><p>Done by hand, the process still requires someone with a Ph.D. and can take days or even weeks, says Guilmart. This isn’t a scalable solution and so there’s a growing drive to automate the process. This is challenging because every step relies on results from the previous step. So rather than relying on a predefined script, Q-CTRL has therefore built intelligent calibration software that examines the result of each measurement, diagnoses failures, and adjusts the approach before retrying. </p><p>“After each step, we analyze that data and we say, are we okay to proceed to the next step? Do we have to go back to the previous step? Do we have to re-recreate this step?” says Guilmart.</p><p>Calibration is also not a one-and-done process: key parameters drift over time, gradually degrading performance. Q-CTRL’s software performs “runtime recalibration” to nudge things back into place, but there’s a limit to how much on-the-fly adjustment is practical. </p><p>“If I’m running a recalibration, I’m not running a circuit,” he says. “Even though I’m maintaining some high system state and high fidelities, if it takes all of my uptime it’s worthless.”</p><h2>Decoding Errors in Real Time</h2><p>Even a well-calibrated quantum computer remains fault-prone, which is why companies are investing heavily in quantum error correction (QEC). This typically involves encoding quantum information across large numbers of physical qubits in their shared state—a “<a href="https://spectrum.ieee.org/logical-qubit" target="_self">logical qubit</a>“—so that errors in individual qubits can be detected and compensated for without destroying the encoded information.</p><p>Because measuring a qubit directly collapses its quantum state, errors are detected via parity checks, which query whether pairs of qubits share the same state. This produces a series of measurements known as a “syndrome,” which classical algorithms called decoders analyze to locate errors.</p><p>The process must happen extremely quickly. While many errors can be logged and corrected mathematically after an operation, some must be fixed immediately before the algorithm can proceed. Superconducting and silicon spin qubits can hold their quantum states only for microseconds or milliseconds, so errors must be decoded and corrected within that window.</p><p>These tight requirements mean decoders typically run on specialized silicon like field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs) optimized for speed, says Jerry Chow, CTO of quantum-centric supercomputing at <a href="https://www.ibm.com/quantum?utm_content=SRCWW&p1=Search&p4=318569493295&p5=p&p9=196351357812&gclsrc=aw.ds&gad_source=1&gad_campaignid=23423681724&gbraid=0AAAAAD-_QsScZCuULMxdFOkQ5b_2MNwwg&gclid=Cj0KCQjw_vnQBhCxARIsADcZyxIcIyEy4jC6XdELM49EwyoDo5PSWNjYhr0GAJeokVSKFwzOXynFRmUaAiPJEALw_wcB" rel="noopener noreferrer" target="_blank">IBM</a>. “You need to be able to keep up and you need to be able to effectively decode on the fly,” he says. “The best way to do that is through very tightly integrated FPGA or ASIC decoder capabilities.”</p><h2>To AI or Not to AI</h2><p>There is growing interest in using AI to simplify quantum hardware control. In April, Nvidia released two models targeting calibration and decoding. The first uses a vision-language model to analyze calibration-measurement outputs—typically plotted as graphs—and passes that evaluation to an AI agent that decides how to tweak the processor. The second uses a convolutional neural network to identify the simpler, localized errors that make up the bulk of faults. More complex errors are passed to a traditional algorithmic decoder, but the first pass reduces computational load enough to deliver a 2x speedup.</p><p>The attraction of AI for decoding, says <a href="https://www.linkedin.com/in/samstanwyck/" rel="noopener noreferrer" target="_blank">Sam Stanwyck</a>, director of quantum product at Nvidia, is that while models are time-consuming to train, they are extremely fast at inference—and thanks to parallelization across many chips, that speed holds even as qubit counts grow.</p><p>But offloading to a GPU still introduces significant latency, says <a href="https://www.riverlane.com/team/marco-ghibaudi" rel="noopener noreferrer" target="_blank">Marco Ghibaudi</a>, vice president of engineering at Riverlane. “You can have a really fat pipe, but it’s really long,” he says. “Our job [approach] has always been to try to remove as many unnecessary steps and shorten the pipe, and then make every section of the pipe as fast as possible.”</p><p>IBM’s Chow agrees that GPU latency currently makes them infeasible for real-time decoding. He’s also cautious about AI for calibration, given its computational expense. The approach holds promise for understanding the physics of novel architectures or new kinds of circuits. But for well-characterized devices where you’re simply looking for small deviations, simpler physics-informed techniques can be considerably cheaper.</p><p>The two approaches aren’t mutually exclusive, however, says Google’s Zalcman. Neural networks excel at discovering hidden patterns in syndrome data that help identify complex errors algorithmic decoders sometimes miss. Google is therefore developing a hardware architecture that can incorporate both traditional and AI-based decoders, including its AlphaQubit 2 model.</p><p>In the long run, Andi Gu, a Harvard Ph.D. student working on AI decoders, thinks “the bitter lesson” will come for decoding. This refers to AI pioneer Richard Sutton’s argument that general-purpose learning methods consistently outperform handcrafted algorithms over time. “If you make the model large enough and you throw enough training data at it, it will learn to capture the hidden correlations better than any other handwritten algorithm,” says Gu.</p><p>Latency remains a barrier, but his group is researching ways to make AI decoders more efficient and smaller so that they can fit on an FPGA, cutting response times. This can degrade accuracy though, so finding the right balance is still a work in progress.</p><p>Regardless of which approach wins out, one thing is certain—future quantum computers will require massive classical support. Decoding is a continuous, computationally expensive process whatever technique you use, says Gu, so you will need a “healthy chunk” of classical hardware dedicated to that task.</p><p>Calibration compute overheads will similarly “blow up” as devices scale to thousands or millions of qubits, says Q-CTRL’s Guilmart. Current techniques are unlikely to scale, he adds, so new approaches will be needed. “We’re going to have to rearchitect and do things differently when we get to even 1,000 qubits,” he says. “So no one’s winning the battle today.”</p>]]></description><pubDate>Wed, 03 Jun 2026 20:06:00 +0000</pubDate><guid>https://spectrum.ieee.org/quantum-calibration-decoding</guid><category>Quantum-computers</category><category>Quantum-error-correction</category><category>Internal-calibration</category><category>Nvidia</category><category>Quantum-computing</category><dc:creator>Edd Gent</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/photo-collage-of-server-wires-overlapping-with-a-quantum-computers-superconducting-lines.jpg?id=66852633&amp;width=980"></media:content></item><item><title>New Server Hopes to Break Through AI’s “Memory Wall”</title><link>https://spectrum.ieee.org/huge-memory-ai-server</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/3d-rendering-of-an-ai-server.jpg?id=66838211&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p>Memory is arguably the most serious constraint on modern AI large language models (LLMs). <a href="https://arxiv.org/pdf/2403.14123" rel="noopener noreferrer" target="_blank">According to one influential paper</a>, LLM token generation is an inherently memory-bound task, meaning the rate at which models output text is limited by how quickly data can be read in from memory. The severity of this bottleneck grows with model size. This creates a “memory wall” that holds back LLM inference performance.<br/><br/>AI hardware startup <a href="https://majestic-labs.ai/" rel="noopener noreferrer" target="_blank">Majestic Labs</a> is taking a direct—and comprehensive—approach to solving this problem. It’s developing a new AI server, Prometheus, with up to 128 terabytes of memory. That’s over 60 times more than Nvidia’s <a href="https://resources.nvidia.com/en-us-dgx-systems/dgx-b300-datasheet" rel="noopener noreferrer" target="_blank">DGX B300 server</a>, a cutting-edge AI processing rack. </p><p><a href="https://www.linkedin.com/in/rabii/" rel="noopener noreferrer" target="_blank">Sha Rabii</a>, co-founder and president of Majestic Labs, believes that this drastic increase in memory will provide his company an edge. While he acknowledges that “Nvidia’s done a phenomenal job creating a system that can scale out,” he argues that it becomes less economical as models grow and “ends up greatly over-provisioning on compute and starving on memory.”</p><h2>DRAM-Centric Architecture for LLM Memory</h2><p>Majestic Labs plans to surmount the “memory wall” with an architecture that fundamentally differs from competitors’. </p><p>Nvidia’s current servers have fast <a href="https://spectrum.ieee.org/hbm-on-gpu-imec-iedm" target="_self">high-bandwidth memory</a> (HBM), which is typically used to read in an LLM’s model weights. In addition, there’s an often larger but slower pool of dynamic random access memory (DRAM), which handles LLM and server overhead. Majestic instead goes all in on DRAM (specifically LPDDR6) in a unified architecture. </p><p>Rabii says that most memory interfaces are designed to operate over a short physical distance—sometimes only a few millimeters. That limits how much memory can be placed. “You get this shoreline at the compute die where you can put your HBM. If you wanted to put more, you can’t,” Rabii explains. </p><p>To solve that, Majestic uses a proprietary memory interface constructed from miniature copper cables that’s effective up to a meter. This is paired with custom memory aggregation chips that sit physically next to memory modules and coordinate memory across the server. </p><p>“It’s an endpoint for that high-speed interface and fans out to many, many commodity DRAM chips,” explains Rabii. In addition to addressing large pools of memory, Majestic says this design offers memory bandwidth up to 25.6 terabytes per second. </p><h2>Ignite AI Processor for LLM Acceleration</h2><p>More memory is good, but it needs to be paired with AI acceleration, something akin to Nvidia’s GPU. Majestic’s solution to this is Ignite, a custom AI processing unit that serves as the server’s compute engine. The Prometheus server contains 12 Ignite chips. </p><p>Ignite combines data-center-class ARM application cores with RISC-V vector and tensor cores on a single die, all sharing the same memory space. The ARM cores act as an on-chip host processor to orchestrate the AI model. The RISC-V cores carry out the actual LLM processing. The result is a single chip that handles multiple aspects of LLM inference demands without handing off between processors. Majestic Labs has yet to reveal specific metrics for Prometheus’ compute performance.</p><p>Rabii acknowledges that software is important as well, given that many AI frameworks are already entrenched. “We’re trying to reduce friction as much as possible in every aspect of our customer adoption, whether it’s physical or software,” he says. Prometheus will support PyTorch, vLLM, and OpenAI’s Triton inference frameworks without requiring code modifications. That means existing models compatible with these frameworks can run as-is.</p><h2>Prometheus Server Design and Pricing</h2><p>All of this combines in the server itself, which is <a href="https://en.wikipedia.org/wiki/Open_Rack" rel="noopener noreferrer" target="_blank">Open Compute Project-compliant</a>. Up to four servers can fit in a server rack; power draw is expected to total up to 120 kilowatts per rack; and heat will be managed with <a href="https://spectrum.ieee.org/data-center-liquid-cooling" target="_self">cold-plate liquid cooling</a>. The server’s memory design is modular, which means servers purchased with less than the maximum of 128 TB of memory can be upgraded at a later date. </p><p>Despite the breadth of the project, Majestic wants to position Prometheus on price, too—which might be a surprise given how much memory each server can contain. Majestic argues that this will be possible because it uses DRAM instead of HBM. Pricing has not yet been announced, as Prometheus is expected to ship in 2027.</p><p>“Our customers’ capital expenditure will come down by, depending on the workload, 10 to 50 times, and the power consumption comes down by a similar amount,” Rabii claims.</p>]]></description><pubDate>Mon, 01 Jun 2026 15:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/huge-memory-ai-server</guid><category>Memory</category><category>Server</category><category>Ai-accelerators</category><category>Performance</category><dc:creator>Matthew S. Smith</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/3d-rendering-of-an-ai-server.jpg?id=66838211&amp;width=980"></media:content></item><item><title>Precision Agriculture Tech Can Address New Fertilizer Shortages</title><link>https://spectrum.ieee.org/fertilizer-shortage-precision-agricultur</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/close-up-of-a-probe-equipped-with-a-spectrometer-and-environmental-sensors.jpg?id=66826391&width=1245&height=700&coordinates=0%2C62%2C0%2C63"/><br/><br/><p>The ongoing instability in the Middle East has put fertilizer availability at the center of global food security concerns. Up to 30 percent of the global fertilizer trade typically passes through the Strait of Hormuz, along with major flows of liquefied natural gas, a key feedstock for its production. Delayed shipments are rippling through agricultural supply chains, and the United Nation’s Food and Agriculture Organization <a href="https://www.fao.org/newsroom/detail/strait-of-hormuz-crisis--fao-director-general-outlines-risks--actions-and-policy-responses/en" target="_blank">has warned</a> that the price of urea, a widely used nitrogen fertilizer, had increased by 52 percent in the United States and by 60 percent in Brazil by mid-April. </p><p>“Traditionally, because fertilizers are relatively cheap, farmers often apply the maximum allowed amount,” says <a href="https://www.athanasiadis.info/" rel="noopener noreferrer" target="_blank">Ioannis Athanasiadis</a>, a professor at <a href="https://www.wur.nl/en" rel="noopener noreferrer" target="_blank">Wageningen University</a> in the Netherlands who works on AI for agriculture and food systems. “It acts as insurance against uncertain weather conditions.” But for farmers already squeezed by the cost of fuel, machinery, and seeds, volatile fertilizer prices are making waste increasingly expensive.</p><p><a href="https://spectrum.ieee.org/john-deere-and-the-birth-of-precision-agriculture" target="_self">Precision agriculture</a> has already helped farmers reduce chemical use and save money, with computer-vision systems able to identify weeds and trigger herbicide nozzles only where needed. But fertilizer is a tougher challenge. Nitrogen, the key nutrient in many fertilizers, is invisible, highly mobile in soil, and can be washed below the root zone before crops absorb it.</p><p>“The difficulty is that you never actually know how much nitrogen the plant and the soil have,” says <a href="https://www.linkedin.com/in/chris-padwick-75b5761" rel="noopener noreferrer" target="_blank">Chris Padwick</a>, a technical fellow at <a href="https://www.bluerivertechnology.com/" rel="noopener noreferrer" target="_blank">Blue River Technology</a>, a California-based company that develops computer-vision technologies for agriculture.</p><h2>Precision Fertilizer Technologies</h2><p>Along with its parent company <a data-linked-post="2658609901" href="https://spectrum.ieee.org/5g-network" target="_blank">John Deere</a>, Blue River developed a precision fertilizer technology called <a href="https://www.deere.com/en/technology-products/precision-ag-technology/precision-upgrades/planter-upgrades/exactshot-upgrade/" rel="noopener noreferrer" target="_blank">ExactShot</a>, which can be deployed only at the time of planting. The system detects each seed as it goes into the soil and sprays a few drops of starter fertilizer directly onto it, instead of applying fertilizer continuously along the row. Blue River says the system can cut starter fertilizer use by more than 60 percent and could save more than 93 million gallons annually across the U.S. corn crop.</p><p>The harder task comes later in the plant’s life, when crop needs depend on weather, soil type, previous applications, and what has already happened in that patch of field. Many sprayers for precision herbicide applications can be fitted with attachments in the shape of an inverted-Y that drag hoses near corn plants, dribbling liquid nitrogen close to the row during the growing season. But without reliable information on which parts of the field actually need nitrogen, the application remains nonselective.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" style="float: left;"> <img alt="3D rendering of a wheeled spreader deploying drops of fertilizer onto individual seeds underground. " class="rm-shortcode" data-rm-shortcode-id="b9ada09f67c4f38e01670cb8e7914871" data-rm-shortcode-name="rebelmouse-image" id="4a11c" loading="lazy" src="https://spectrum.ieee.org/media-library/3d-rendering-of-a-wheeled-spreader-deploying-drops-of-fertilizer-onto-individual-seeds-underground.jpg?id=66826439&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">John Deere’s ExactShot technology detects each seed as it is planted and applies a few drops of starter fertilizer.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Blue River Technology</small></p><p>Padwick says Blue River is testing whether its crop imaging systems could also become “digital scanners” for plant health, using broader spectral coverage to analyze vegetation as sprayers pass close to the canopy. But getting insights isn’t the same as accurately interpreting them. Yellowing leaves or reduced chlorophyll may point to a nutrient deficiency, but they can also indicate drought stress, disease, or insect damage. That is why some companies are moving below the canopy and into the soil, where direct measurements can provide a more objective picture of what nutrients are available.</p><p>Elsewhere in the United States, Iowa-based <a href="https://n-sense.us/" target="_blank">N-Sense</a> is betting on a mobile machine for soil analysis. Its prototype soil-nitrate sensor can be pulled through the field by a truck to measure nitrate concentration in real time. The system uses a ruggedized miniature Fourier-transform infrared spectrometer operating in the mid-infrared, coupled with a diamond interface. Soil is pressed against one end of the diamond while infrared light passes through the other, allowing the instrument to detect nitrate while the diamond protects the optical surface from abrasion.</p><p>“Nitrate is particularly difficult to detect,” says <a href="https://www.linkedin.com/in/david-laird-91669617b" target="_blank">David Laird</a>, N-Sense’s president and CEO. “In the ultraviolet, many things in the soil are responsive, so it is very difficult to separate the nitrate signal. But in the mid-infrared, we are able to isolate the nitrate band and get a strong signal.”</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="A truck pulling a soil nitrate sensor across a field of crops." class="rm-shortcode" data-rm-shortcode-id="fd9103f523ea13d224460d6094c1bd96" data-rm-shortcode-name="rebelmouse-image" id="4d500" loading="lazy" src="https://spectrum.ieee.org/media-library/a-truck-pulling-a-soil-nitrate-sensor-across-a-field-of-crops.jpg?id=66826434&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">N-Sense’s sensor measures nitrate in real time as it moves through a crop field.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">N-Sense</small></p><p>The sensor feeds nitrate data into machine learning software that also taps into soil-survey data, satellite imagery, and yield data to generate fertilizer prescriptions that can be uploaded directly to a tractor.</p><p>“You do not want to look at nitrogen in isolation,” says Laird. “The soil may have low nitrogen content, but if water availability is what is limiting productivity, adding nitrogen will not help.”</p><p>In one field tested last year, Laird says the company achieved about a 30 percent reduction in total nitrogen fertilizer applied.</p><h2>Real-Time Soil Analysis</h2><p>In Potsdam, Germany, an agricultural tech company called <a href="https://www.stenon.io/en" target="_blank">Stenon</a> has developed <a href="https://www.stenon.io/en/technology" target="_blank">FarmLab</a>, a mobile soil-analysis device designed to give farmers real-time measurements directly in the field. The handheld probe is pushed into the soil and combines optical spectroscopy, which reads how soil absorbs and reflects light, with impedance-based electrical measurements, which send a small electrical signal through the ground to capture properties affected by moisture, salts, and nutrient ions. Environmental sensors capture the temperature and humidity, and there is also a GPS tag that associates each reading with a location. Cloud computing and machine learning turn the raw signals into usable soil data. The goal is to infer key soil parameters, including nitrate, mineral nitrogen, moisture, and other indicators that can guide fertilizer decisions.</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" rel="float: left;" style="float: left;"> <img alt="A soil analysis device resembling an electric shovel." class="rm-shortcode" data-rm-shortcode-id="ab6d58ef184cf1763b7974942363743c" data-rm-shortcode-name="rebelmouse-image" id="6b820" loading="lazy" src="https://spectrum.ieee.org/media-library/a-soil-analysis-device-resembling-an-electric-shovel.jpg?id=66826446&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Stenon’s FarmLab uses optical spectroscopy, electrical impedance sensing, and machine learning to generate soil nutrient maps for precision fertilization.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Stenon</small></p><p>The company’s founder and CEO, <a href="https://de.linkedin.com/in/niels-grabbert-a6645698" target="_blank">Niels Grabbert</a>, says the idea came when Europe began enforcing the <a href="https://environment.ec.europa.eu/topics/water/nitrates_en" target="_blank">Nitrates Directive</a>, a law aimed at protecting groundwater and surface water from agricultural nitrate pollution. Back then, farmers were required to reduce nitrogen losses but lacked real-time information on the nitrogen present in their fields.</p><p>“Depending on the country and on what parameters you are testing for, it can take anywhere from two to eight weeks before you receive soil-testing results,” says Grabbert. “That means farmers do not know in real time how much nutrition the soil itself can provide.”</p><p>FarmLab is meant to replace sparse lab testing with faster, denser field data. On a 100-hectare farm, an agronomist could take one reading every two hectares, then use the software to turn those GPS-tagged measurements into nutrient maps and fertilizer rates that can be sent to farm machinery or management platforms.</p><p>Grabbert says the technology can reduce fertilizer use by around 20 percent on average while increasing yields by 2 to 8 percent, depending on the crop and production system.</p><p>For Dutch professor Athanasiadis, these systems point in the right direction, but they are not enough on their own. “There are no magic solutions,” he says. “We need sensors, robotics, AI, government support, and farmer participation all working together.”</p>]]></description><pubDate>Thu, 28 May 2026 15:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/fertilizer-shortage-precision-agricultur</guid><category>Robotics</category><category>Artificial-intelligence</category><category>Machine-vision</category><category>Iran</category><category>Precision-agriculture</category><category>Climate-tech</category><dc:creator>Maurizio Arseni</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/close-up-of-a-probe-equipped-with-a-spectrometer-and-environmental-sensors.jpg?id=66826391&amp;width=980"></media:content></item><item><title>Junctionless Transistors Show a New Path to 3D Chips</title><link>https://spectrum.ieee.org/3d-chips</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/two-asian-mens-faces-reflected-in-a-silicon-wafer.jpg?id=66822290&width=1245&height=700&coordinates=0%2C156%2C0%2C157"/><br/><br/><p><span>Chipmakers are struggling to shrink the amount of area a transistor takes up, so researchers are trying to build layers of devices on top of each other. However, many experimental 3D chips rely on exotic materials and perform poorly compared with regular silicon devices. But researchers at the University of Illinois Urbana-Champaign have found a new way to build 3D circuits from silicon. The secret is a process that lets them roll multiple layers of nanometers-thin silicon onto a wafer at relatively low temperatures.</span></p><p>Today’s <a href="https://spectrum.ieee.org/quantum-sensors-2674296517" target="_self">3D microchips</a>, such as the <a href="https://spectrum.ieee.org/amd-mi300" target="_blank">AMD MI300 series</a>, stack prefabricated layers on top of each other and connect them with the help of <a href="https://spectrum.ieee.org/next-gen-chips-will-be-powered-from-below" target="_self">metal pillars</a> known as <a href="https://spectrum.ieee.org/amd-3d-stacking-intel-graphcore" target="_self">through-silicon vias</a>. However, the challenge of properly aligning the connections between these layers limits how many links can be made and therefore how useful 3D stacking can be.</p><p>By contrast, in <a href="https://spectrum.ieee.org/the-rise-of-the-monolithic-3d-chip" target="_self">monolithic 3D chips</a>, layers of devices are fabricated directly on top of each other. This enables alignment of these layers with nanometer-scale precision, and with orders of magnitude denser connectivity than today’s 3D chips.</p><p>However, experimental monolithic 3D chips require transistors and other devices in the upper layers to be fabricated at 400 °C or less to preserve the wiring that connects their components together. Such 3D chips have been made using a variety of materials, but their performance and reliability all proved much worse than the metal-oxide-semiconductor field-effect transistors (MOSFETs) found in virtually all conventional microchips, erasing most of the gains offered by a monolithic 3D design.</p><p>Now scientists have created monolithic 3D chips from silicon at less than 200 ℃. “For years, people assumed monolithic 3D would require exotic new materials such as <a href="https://spectrum.ieee.org/modern-microprocessor-built-using-carbon-nanotubes" target="_self">carbon nanotubes</a>, <a href="https://spectrum.ieee.org/3d-cmos" target="_self">metal-oxide semiconductors</a>, or <a href="https://spectrum.ieee.org/cdimensions-2d-semiconductors" target="_self">2D semiconductors,</a>“ says <a href="https://matse.illinois.edu/people/profile/qingcao2" target="_blank">Qing Cao</a>, an associate professor of materials science and engineering at the University of Illinois Urbana-Champaign. “Demonstrating that silicon can do the job means this technology can plug directly into existing manufacturing ecosystems, which dramatically accelerates its path toward real impact.”</p><h2>Low-temperature junctionless transistors</h2><p>Instead of the <a href="https://spectrum.ieee.org/the-highk-solution" target="_self">MOSFETs</a> used in most chips, the new 3D chips rely on <a href="https://ieeexplore.ieee.org/document/10877552" target="_blank">junctionless transistors</a>. Regular MOSFETs are made using both <em>n</em>-type semiconductors, which are doped to contain an excess of electrons, and <em>p</em>-type semiconductors, which are doped to produce a deficit of electrons. Charges enter a transistor through its source terminal, travel down a channel, and exit out the drain terminal. In MOSFETs, if the the source and drain are made of<em> p</em>-type silicon, the channel will be made of <em>n</em>-type, and vice versa. The <a href="https://spectrum.ieee.org/the-tunneling-transistor" target="_self"><em>p</em>-<em>n</em> junctions</a> where these semiconductor types meet interrupt the flow of current. When a gate electrode applies voltage to the channel, current can flow across. </p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Circuit diagram for a 3D chip." class="rm-shortcode" data-rm-shortcode-id="4c4d4eaf13be3226978705151cdac5b3" data-rm-shortcode-name="rebelmouse-image" id="76f20" loading="lazy" src="https://spectrum.ieee.org/media-library/circuit-diagram-for-a-3d-chip.jpg?id=66822309&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Each layer of a new kind of 3D contains so-called junctionless transistors. The bottom layer is made from silicon with excess mobile electrons, the top from silicon with excess holes. The transistors are linked together vertically to form complementary logic.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Bao Lam, Yung Man Yu, et al.</small></p><p>In contrast, in junctionless transistors, the source, channel and drain are all completely either <em>p</em>-type or <em>n</em>-type, and so operate without <em>p</em>-<em>n</em> junctions. When a voltage is applied to the gates, they switch on, allowing current to flow. <a href="https://www.mdpi.com/2079-9292/9/7/1174" target="_blank">First proposed in 1925</a>, they were not built until 2010 due to limits in fabrication technology; they require highly and uniformly doped channels at most about 10 nanometers thick. In MOSFETs, chipmakers use high heat to make sure <a href="https://en.wikipedia.org/wiki/Dopant_activation" target="_blank">dopants are located precisely where they are needed to be in the silicon crystal </a>to create <em>p</em>-<em>n</em> junctions. Junctionless transistors don’t need these high temperatures. <br/><br/>“Junctionless devices also use a simpler process flow, which can reduce costs and improve yield,” Cao says.</p><p>The new 3D chips are made by laying down uniformly doped single-crystal silicon membranes each 10 nm or less thick using a wafer-scale <a href="https://www.nature.com/articles/s41528-021-00116-w" rel="noopener noreferrer" target="_blank">roll-transfer-printing</a> process. “Because the membranes are so thin and flexible, they conform to the underlying surface, avoiding the voids and warpage that often plague wafer bonding between rigid wafers,” Cao says.</p><p>That the nano-membranes can transfer onto surfaces that are not necessarily perfectly flat “is important because the current method typically used in industry requires sub-1-nanometer roughness for the surfaces to be bonded together and extremely flat—only a few microns of variations across the wafer,” says <a href="https://www.ee.iitb.ac.in/web/people/veeresh-deshpande/" rel="noopener noreferrer" target="_blank">Veeresh Deshpande</a>, an associate professor of electrical engineering at the Indian Institute of Technology Bombay, who did not participate in this study. “The proposed method simplifies the process complexity and allows stacking several tiers of transistors, both for advanced computing and memory like DRAM.”</p><p>Cao and his colleagues fabricated three levels of junctionless transistors on a 75-millimeter silicon wafer, with each tier composed of 625 transistors over a 1,600-square-mm area. From these transistors they constructed a variety of logic gates and circuits—including inverters, NAND and NOR gates, and <a href="https://spectrum.ieee.org/sram-intel-tsmc" target="_self">static random access memory (SRAM)</a> cells—using vertical connections between the layers that were aligned with sub-10-nm accuracy.</p><p>The researchers were able to form circuits made up of transistors distributed over all three layers of the 3D chips. That led to a six-transistor SRAM cell with a footprint as little as one-third the size of its 2D layout.</p><p>A transistor’s switching speed depends on its current density, and the junctionless transistors showed a current density that could exceed 650 milliamperes per micrometer, which is comparable to older commercial silicon MOSFETs. More advanced MOSFETs do show current densities exceeding 1,000 mA per micrometer, but Cao and his colleagues say that future engineering could further improve the performance of their devices.</p><p>“The key implication is that vertical stacking may not have to come with a severe transistor-performance penalty,” says <a href="https://www.matse.psu.edu/directory/saptarshi-das" rel="noopener noreferrer" target="_blank">Saptarshi Das</a>, a professor of engineering science and mechanics at Pennsylvania State University, who did not take part in this research. “If scalable, this could open a practical path to denser, more energy-efficient chips with much shorter interconnects.”</p><h2>Roll-transfer processes</h2><p>The silicon wafers Cao’s team used are much smaller than the 300-mm ones most fabs use today. But transferring and stacking silicon membranes even across a 75-mm wafer without cracks, wrinkles, or defects “required a series of engineering innovations,” Cao says. These included adding <a href="https://en.wikipedia.org/wiki/Surfactant" rel="noopener noreferrer" target="_blank">surfactants</a> during certain etching steps to reduce surface tension; adding polymer support layers for mechanical stability and surface protection; and adopting a roll-lamination process to apply uniform pressure during transfer.</p><p>“We began in 2019,” Cao says. “By 2024, we realized we had solved the fundamental barriers. The following year and a half was spent refining the process and demonstrating multilayered devices at wafer scale and 3D logic circuits.”</p><p>Beyond computing, integrating silicon with other materials in monolithic 3D devices may open up new applications “that were previously out of reach.” Cao says. “For example, vertically stacking different types of single-crystalline semiconductors could enable ultrasensitive X-ray-detector panels or compact multispectral imaging systems.”</p><p class="shortcode-media shortcode-media-rebelmouse-image rm-float-left rm-resized-container rm-resized-container-25" data-rm-resized-container="25%" rel="float: left;" style="float: left;"> <img alt="STEM micrograph showing three tiers of stacked junctionless transistor arrays separated by approximately 90 nanometers." class="rm-shortcode" data-rm-shortcode-id="fa76d859b20d7865c30a6822c51e9de2" data-rm-shortcode-name="rebelmouse-image" id="0a95f" loading="lazy" src="https://spectrum.ieee.org/media-library/stem-micrograph-showing-three-tiers-of-stacked-junctionless-transistor-arrays-separated-by-approximately-90-nanometers.jpg?id=66822314&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">A new 3D chip has three layers of silicon transistors separated by about 90 nanometers of dielectric.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Bao Lam, Yung Man Yu, et al.</small></p><p>One challenge monolithic devices will face is yield. “When you stack devices vertically, the traditional assumption is that every transistor in every layer must work perfectly, which can reduce overall chip yield,” Cao says. “We are working with circuit designers on defect-tolerant architectures that can absorb imperfections with minimal area and power overhead.”</p><p>Another hurdle is the way these 3D chips increase power density, concentrating heat. “We are collaborating with circuit and architecture teams on solutions such as dynamic voltage and frequency scaling and AI-assisted on-chip power regulation to actively manage heat,” Cao says.</p><p>Cao suggests the new approach is initially only promising for research and low-volume prototyping applications. “Once the benefits of monolithic 3D integration are clearly established, we can work toward high-volume manufacturing,” Cao says. “We simply want to be realistic and avoid over-claiming before the technology has been validated in those settings with full cost analysis.”</p><p>The scientists now want to partner with semiconductor foundries to demonstrate and refine the technology in a manufacturing environment, Cao says. Ultimately, “because our approach is silicon based and compatible with foundry processes, it has a realistic path to adoption,” he notes. “It will be especially valuable for AI workloads that are increasingly limited by communication bottlenecks, which is directly addressed by this technology by bringing compute layers physically closer together.”</p>Cao and his colleagues detailed <a href="https://www.nature.com/articles/s41586-026-10496-6" target="_blank">their findings</a> in the 28 May <em><em>Nature</em></em><span>.</span>]]></description><pubDate>Wed, 27 May 2026 15:00:02 +0000</pubDate><guid>https://spectrum.ieee.org/3d-chips</guid><category>3d-chips</category><category>Junctionless-transistors</category><category>3d-integration</category><dc:creator>Charles Q. Choi</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/two-asian-mens-faces-reflected-in-a-silicon-wafer.jpg?id=66822290&amp;width=980"></media:content></item><item><title>South Africa Has AI Leverage. Its Draft Policy Leaves It Unused</title><link>https://spectrum.ieee.org/south-africa-ai-policy</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/aerial-view-of-an-industrial-mining-complex-with-reddish-brown-processing-facilities-contrasted-by-a-distant-green-landscape.jpg?id=66784945&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p><em><em>This article is adapted by the author with permission from </em><a href="https://www.techpolicy.press/" rel="noopener noreferrer" target="_blank"><em>Tech Policy Press</em></a><em>. Read the </em><a href="https://www.techpolicy.press/south-africa-has-ai-leverage-its-draft-policy-leaves-it-unused/" rel="noopener noreferrer" target="_blank">original article</a><em>.</em></em></p><p>South Africa is not just another developing country struggling to govern artificial intelligence; it is the exception with leverage, and the window to act on it is closing. It holds <a href="https://www.statista.com/statistics/273624/platinum-metal-reserves-by-country/" rel="noopener noreferrer" target="_blank">approximately 88 percent of global platinum-group metal reserves</a>, critical inputs to parts of the semiconductor and data-center supply chains that make AI infrastructure possible. It hosts the <a href="https://www.arizton.com/market-reports/south-africa-data-center-market-investment-analysis" rel="noopener noreferrer" target="_blank">largest data-center market</a> on the continent. Its <a href="https://africadca.org/en/data-centres-in-africa-focus-report-2024" rel="noopener noreferrer" target="_blank">existing hyperscaler relationships</a> give it procurement leverage that <a href="https://spectrum.ieee.org/ai-for-good" target="_blank">most African states will never have</a>. And a major <a href="https://techcentral.co.za/draft-ai-policy-south-africa-too-dependent-on-us-china/280253/" rel="noopener noreferrer" target="_blank">geopolitical contest</a> over AI infrastructure is being fought on its soil right now, between Chinese and American technology companies competing for control of the systems that will underpin an entire continent’s public sector.</p><p>In physics, leverage requires three things: a fulcrum, a lever arm, and the ability to apply force. The Bushveld Complex, <a href="https://pubs.usgs.gov/periodicals/mcs2025/mcs2025-platinum-group.pdf" rel="noopener noreferrer" target="_blank">the world’s largest platinum-group metal deposit</a>, is the fulcrum: a mineral endowment that gives South Africa a position in the semiconductor supply chain that no other African state holds. The <a href="https://www.sanews.gov.za/south-africa/minister-announces-withdrawal-draft-ai-policy" rel="noopener noreferrer" target="_blank">since-withdrawn</a> <a href="https://www.gov.za/sites/default/files/gcis_document/202604/54477gen3880.pdf" rel="noopener noreferrer" target="_blank">draft policy</a> is the lever arm. The unresolved “OPTION” provisions in the policy are where force would be applied. Without a policy that specifies what South Africa wants in return for market access, the lever arm sits unused, and the weight of two of the world’s largest technology ecosystems settles exactly where those ecosystems want it to settle.</p><p>This makes South Africa a global test case. Not because its proposed means of governance is exemplary, but because it is the one developing country with enough structural leverage to negotiate <a href="https://spectrum.ieee.org/responsible-ai" target="_blank">genuinely different terms</a>, and the one that is choosing, through inaction, not to. The recent <a href="https://techcentral.co.za/malatsi-moves-to-rescue-south-africas-botched-ai-policy/281299/" rel="noopener noreferrer" target="_blank">announcement</a> of a new panel to <a href="https://www.reuters.com/world/africa/south-africa-targets-january-2027-revised-ai-policy-after-earlier-withdrawal-2026-05-26/" target="_blank">update the draft policy by January 2027</a> is an important opportunity. But the deeper failure is not that an AI policy contained bad references. It is that no verification process caught them before the document entered the public domain. That is a systems problem, not merely a political one. It points to a missing layer in how governments are adopting AI.</p><h2>The contest already underway</h2><p>Last year, Huawei <a href="https://www.bloomberg.com/news/features/2025-10-22/china-s-deepseek-pushes-into-africa-making-ai-accessible-to-millions" rel="noopener noreferrer" target="_blank">pitched an emerging-product bundle</a> to tech executives across the continent. Huawei was now bundling access to DeepSeek’s large language model with its own cloud and storage infrastructure. The price differential was stark—in some cases by more than 90 percent.</p><p>At the same time, Microsoft announced plans to spend <a href="https://news.microsoft.com/source/emea/features/microsoft-invests-zar-5-4bn-in-south-africa/" rel="noopener noreferrer" target="_blank">ZAR 5.4 billion ($300 million)</a> by the end of 2027 on cloud and AI infrastructure in South Africa, building on a prior ZAR 20.4 billion investment. Google, Amazon Web Services, and Oracle already have cloud regions in the country. According to one analysis, the country’s data-center market was valued at US <a href="https://www.arizton.com/market-reports/south-africa-data-center-market-investment-analysis" rel="noopener noreferrer" target="_blank">$2.16 billion in 2024, the largest in Africa</a>.</p><p>These are not commercially neutral investments. Huawei’s infrastructure reach has been explicitly linked to <a href="https://www.congress.gov/crs-product/IF11735" rel="noopener noreferrer" target="_blank">Chinese strategic objectives</a>, including a <a href="https://www.csis.org/analysis/watching-huaweis-safe-cities" rel="noopener noreferrer" target="_blank">documented track record</a> of providing governments with surveillance infrastructure through its Safe Cities network. U.S. hyperscaler investment comes with its own dependency structure: closed models, pricing set unilaterally, and terms of access that no African government has meaningfully shaped. South Africa is being asked to choose between these dependency models without a policy that specifies what it wants in return.</p><h2>The leverage it has</h2><p>There is a particular irony in South Africa’s position. The country whose mines supply platinum-group metals essential to semiconductor manufacturing, and through them to AI compute, has drafted a policy that treats it as a consumer of AI systems rather than a stakeholder in their governance. South Africa digs up the minerals that make AI possible. It has no say over the AI built from them.</p><p>The <a href="https://cset.georgetown.edu/publication/the-ai-triad-and-what-it-means-for-national-security-strategy/" rel="noopener noreferrer" target="_blank">AI triad framework</a> covers algorithms, compute, and data. South Africa has no frontier model development capacity. South Africa holds significant data assets in financial services, health care, and agriculture, with no clear framework for their sovereign management. <a href="https://elements.visualcapitalist.com/charted-the-minerals-powering-the-ai-boom/" rel="noopener noreferrer" target="_blank">South Africa possesses PGM (Platinum Group Metals) leverage</a> of global significance on the compute axis, currently being transferred without meaningful condition. It also has <a href="https://datacatalog.worldbank.org/search/dataset/0039068/south-africa-solar-irradiation-and-pv-power-potential-maps" rel="noopener noreferrer" target="_blank">exceptionally high solar irradiance</a> and <a href="https://datacatalog.worldbank.org/search/dataset/0039068/south-africa-solar-irradiation-and-pv-power-potential-maps" rel="noopener noreferrer" target="_blank">significant renewable-energy potential</a>. A country that can offer both critical mineral inputs and the energy to power the infrastructure those minerals help build occupies a negotiating position of unusual strength.</p><p>The Draft Policy proposes no minimum terms for hyperscaler investment, no data sovereignty requirements, no technology transfer conditions and no compute visibility mechanism. Multiple provisions are explicitly left unresolved, marked “OPTION,” including the most consequential choices about how governance will function. Infrastructure decisions made now determine what is renegotiable later, and the answer is: very little.</p><h2>Three futures, one default</h2><p>The three infrastructure futures on offer each create a structurally different form of dependency, and only one creates sovereign capability. The Huawei-hosted DeepSeek integration offers low cost and open-source weights, but with data stored on infrastructure potentially accessible under Chinese legal frameworks, creating surveillance dependency in a pattern <a href="https://carnegieendowment.org/2019/09/17/global-expansion-of-ai-surveillance-pub-79847" rel="noopener noreferrer" target="_blank">already documented</a> across Africa. The second is U.S. closed-model dependency: higher capability, more reliable data protection, but complete API dependency on developers abroad. The third is locally hosted open-weight infrastructure: models governed under <a href="https://www.gov.za/sites/default/files/gcis_document/202406/50741gen2533.pdf" rel="noopener noreferrer" target="_blank">South African data-sovereignty rules</a>, on infrastructure subject to minimum terms, developed with South African data. As <a href="https://www.interconnects.ai/p/open-models-in-perpetual-catch-up" rel="noopener noreferrer" target="_blank">Nathan Lambert at Interconnects</a> has observed, open-weight models are likely the only realistic way to get sovereign AI off the ground as a real effort, enabling local communities and economies to integrate meaningfully with the technology. But this requires procurement conditions, not goodwill.</p><h2>What binding governance looks like</h2><p>The <a href="https://www.governance.ai/research-paper/governing-through-the-cloud" rel="noopener noreferrer" target="_blank">GovAI “Governing Through the Cloud” framework</a> identifies four roles compute providers should accept as conditions of operating at scale: securers (protecting model weights and training data), record keepers (maintaining infrastructure usage logs), verifiers (confirming customer compliance with safety standards) and enforcers (restricting access when violations occur). These are operational requirements, not theoretical categories—specific, enforceable, and well within the bargaining power of a market of South Africa’s size and mineral position.</p><p>A <a href="https://itlawco.com/sa-national-ai-policy-submission-2026/" rel="noopener noreferrer" target="_blank">detailed policy analysis</a> submitted to the Department of Communications and Digital Technologies (DCDT) identifies the specific provisions the final policy must contain: mandatory minimum terms for foreign compute infrastructure investments above ZAR 500 million (~$30 million); a compute reporting threshold; a National AI Safety Institute mandate covering defensive monitoring of AI capability accumulation; and National AI Champion Sector designations to create data assets for domestic model development. Each provision converts a structural advantage into a governance instrument before that advantage is foreclosed by market reality. Just as modern software security increasingly depends on knowing what components are inside a system—model provider, training data, compute environment, evaluation methods, update cadence, human review points, and failure-reporting procedures—public-sector AI governance requires a clear account of the stack before deployment, not after a problem surfaces. A public institution that cannot verify the sources in its own AI policy is unlikely to be ready to verify the AI systems it procures, deploys, or regulates.</p><h2>Why this is the continental test case</h2><p>South Africa’s choices will establish a regional precedent for what is commercially negotiable in AI infrastructure. If South Africa negotiates data-sovereignty guarantees and technology-transfer conditions as requirements for hyperscaler investment, it creates a replicable model. If Microsoft’s $300 million investment and Huawei’s infrastructure expansion proceed on standard commercial terms, as they are currently, it normalizes extractive AI infrastructure across the continent. The lesson is not specific to Africa. Governments everywhere are producing AI strategies while lacking AI assurance infrastructure. South Africa is an early warning, not an isolated case.</p><p>The public comment period closed when the policy was withdrawn. But a parallel process remains live: the <a href="https://www.treasury.gov.za/public%20comments/ProcReg/Draft%20General%20Public%20Procurement%20Regulations%202026%20for%20consultation%20ito%20section%2063(3)%20of%20Act.pdf" rel="noopener noreferrer" target="_blank">National Treasury’s Draft General Public Procurement Regulations</a>—the legal instrument that will govern every government AI contract—closes for comment on June 15. Those regulations contain no AI-specific provisions.</p><p>South Africa has more AI leverage than any country on the continent. Some argue, with force, that <a href="https://www.dailymaverick.co.za/article/2026-04-19-sa-risks-missing-critical-global-ai-window-through-well-intentioned-policy-misalignment/" rel="noopener noreferrer" target="_blank">governance requirements risk deterring the infrastructure investment</a> South Africa urgently needs: compute capacity, reliable energy, venture capital, and talent retention. That concern deserves a direct answer. Minimum procurement terms, compute reporting thresholds, and technology transfer conditions are not barriers to investment. They are the conditions under which investment serves the host country rather than extracting from it. Infrastructure built without minimum terms produces dependency. Infrastructure built with them produces leverage. To serve the public interest, its AI policy must use it.</p>When late last month News24 <a href="https://www.news24.com/business/tech/govts-draft-ai-policy-cites-fictitious-references-experts-believe-are-ai-hallucinations-20260424-1085" rel="noopener noreferrer" target="_blank">reported</a> AI-hallucinated references in the draft AI policy, Minister of Communications and Digital Technologies Solly Malatsi <a href="https://www.sanews.gov.za/south-africa/minister-announces-withdrawal-draft-ai-policy" rel="noopener noreferrer" target="_blank">withdrew the draft policy</a>. That was a <a href="https://www.linkedin.com/pulse/why-withdrawing-south-africas-draft-ai-policy-wrong-call-adams-4arzf/?trackingId=p1G8Vk1DBwSwD550j8ym2A%3D%3D" rel="noopener noreferrer" target="_blank">mistake</a> that could cost South Africa and the rest of the continent the initiative on this urgent issue. His more recent constitution of an <a href="https://techcentral.co.za/malatsi-moves-to-rescue-south-africas-botched-ai-policy/281299/" rel="noopener noreferrer" target="_blank">independent panel</a> is a belated step in the right direction, if it can turn South Africa’s leverage into policy. The panel—chaired by Professor Benjamin Rosman of the Wits Machine Intelligence and Neural Discovery Institute, and including Professors Vukosi Marivate and Alison Gillwald of Research ICT Africa and Dr. Jabu Mtsweni of the Council for Scientific and Industrial Research—has the technical and governance credibility to produce a stronger document. A <a href="https://www.reuters.com/world/africa/south-africa-targets-january-2027-revised-ai-policy-after-earlier-withdrawal-2026-05-26/" target="_blank">revised draft</a> is due to be ready for public comment by January 2027. South Africa remains without a formal AI governance framework in the interim.]]></description><pubDate>Wed, 27 May 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/south-africa-ai-policy</guid><category>Ai</category><category>Artificial-intelligence</category><category>Microsoft</category><category>South-africa</category><category>Huawei</category><category>Ai-policy</category><dc:creator>Nathan-Ross Adams</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/aerial-view-of-an-industrial-mining-complex-with-reddish-brown-processing-facilities-contrasted-by-a-distant-green-landscape.jpg?id=66784945&amp;width=980"></media:content></item><item><title>What It Takes to Preserve Floppy Disks</title><link>https://spectrum.ieee.org/floppy-disk-data-preservation-archives</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/person-in-floppy-disk-sweater-sits-behind-scattered-floppy-disks-on-table.png?id=66763716&width=1245&height=700&coordinates=0%2C141%2C0%2C141"/><br/><br/><p><a data-linked-post="2667647674" href="https://spectrum.ieee.org/3m-floppy" target="_blank">Floppy disks</a> are several decades old—many of the disks are degrading and the data stored on them is at risk of being lost. In response, <a href="https://www.cdh.cam.ac.uk/about/people/leontien-talboom/" rel="noopener noreferrer" target="_blank">Leontien Talboom</a>, a technical analyst at Cambridge University Libraries and Archives, led a roughly year-long project preserving <a href="https://spectrum.ieee.org/3m-floppy" target="_self">floppy disks</a> called “<a href="https://www.lib.cam.ac.uk/future-nostalgia" rel="noopener noreferrer" target="_blank">Future Nostalgia</a>,” which concluded in January.</p><h3>Leontien Talboom</h3><br/><p><a href="https://www.cdh.cam.ac.uk/about/people/leontien-talboom/" rel="noopener noreferrer" target="_blank">Leontien Talboom</a> is a technical analyst at Cambridge University Libraries and Archives, where she transfers material from a wide range of storage media to make them accessible to archivists. </p><p><em><em>IEEE Spectrum</em></em> spoke to Talboom about her work <a href="https://www.digipres.org/the-floppy-guide/" rel="noopener noreferrer" target="_blank">preserving data</a> from Cambridge’s collection of floppy disks and <a href="https://www.repository.cam.ac.uk/items/154ad280-7c47-49eb-9cbf-24b6762f6c1c" rel="noopener noreferrer" target="_blank">collecting knowledge</a> about the disks themselves.</p><p><strong>Why is it important to preserve floppy disks now?</strong></p><p><strong>Leontien Talboom: </strong>Two reasons. First, the physical media is starting to degrade. Floppy disks are made from plastic, but they’ve got a magnetic layer of iron oxide, and that’s deteriorating. A lot of floppy disks are found in attics or garages, which means they also suffer from mold.</p><p>Second, a lot of people who developed floppy disks and systems that use floppy disks are starting to retire or pass away, which means that a lot of tacit knowledge is disappearing.</p><p><strong>Whom did you go to for that tacit knowledge?</strong></p><p><strong>Talboom: </strong>I went to the retro computing community. Their work is more around preserving these machines to keep them running [than] the data that lives on the floppy disk. But they know their stuff about floppy disks.</p><p>For example, they know that in a lot of the older disks, the inside of the disk—the doughnut—gets stuck to the top. So if you flex the casing, the doughnut falls down again. If I hadn’t known that, I would have assumed that those disks in our collection were broken or corrupt.</p><p><strong>What is the most difficult part of working with floppy disks?</strong></p><p><strong>Talboom: </strong>Accessing the files can be quite challenging if we don’t understand the file system. Within libraries and archives, we get a lot of material from machines that are not as well loved. Many of the personal computers that you had at home, such as the <a href="https://amstrad.com/product-category/computer/" rel="noopener noreferrer" target="_blank">Amstrad</a> or <a href="https://www.bbc.com/news/articles/cpvzp80jv07o" rel="noopener noreferrer" target="_blank">ZX Spectrum</a> or <a href="https://computerhistory.org/blog/the-bbc-micro/" rel="noopener noreferrer" target="_blank">BBC Micro</a>, are very well documented. But a bunch of our material comes from business or research systems. They’re not as nostalgic for people, so there’s not as big a community preserving this type of material.</p><p><strong>Do you have a favorite type of floppy disk?</strong></p><p><strong>Talboom: </strong>Five and a quarter. The weirder the system, the more frustrating and fun it is. I quite like doing that detective work.</p><p>The Amstrad disk has also really stolen my heart. The popularity of floppy disks is very geographically dependent. Our library, for example, has these Amstrad 3-inch disks. But if you go to the U.S., they’re really uncommon. They weren’t able to manufacture enough of these drives, and [3.5-inch disks] took over at a certain point. But they’re really cute.</p><p><strong>What’s the best method for sustainably storing data?</strong></p><p><strong>Talboom: </strong>The main thing is actively looking after it. A lot of the floppy disks we get in the library haven’t been accessed for 20 or 30 years, which means that you need certain special hardware to actually read them, and then work with emulators or other tools to make these file formats accessible.</p><p>Now that we’ve done that work and transferred it, we can monitor it and make sure it’s not suffering from anything like bit rot. We can also make decisions around migrating it to other file formats or working on specific file systems or unknown file formats in more detail.</p><p><em>This article appears in the June 2026 print issue as “Leontien Talboom.”</em></p>]]></description><pubDate>Tue, 26 May 2026 13:00:00 +0000</pubDate><guid>https://spectrum.ieee.org/floppy-disk-data-preservation-archives</guid><category>Archives</category><category>5-questions</category><category>Data-preservation</category><category>Type-departments</category><dc:creator>Gwendolyn Rak</dc:creator><media:content medium="image" type="image/png" url="https://spectrum.ieee.org/media-library/person-in-floppy-disk-sweater-sits-behind-scattered-floppy-disks-on-table.png?id=66763716&amp;width=980"></media:content></item><item><title>Pavona Launches Open-Hardware Ecosystem for Secure Chips</title><link>https://spectrum.ieee.org/pavona-open-source-hardware</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/3d-rendering-of-several-layers-comprising-a-single-computer-chip.jpg?id=66785309&width=1245&height=700&coordinates=0%2C187%2C0%2C188"/><br/><br/><p><span>Open-source software is ubiquitous: </span><a href="https://www.linux.org/" target="_blank">Linux</a><span> is the dominant operating system on servers and supercomputers worldwide; </span><a href="https://wordpress.com/" target="_blank">Wordpress</a><span> powers over 40 percent of all websites, among other major projects. Open-source hardware has </span><a href="https://lists.debian.org/debian-announce/1997/msg00026.html" target="_blank">existed</a><span> since the late 1990s, but it hasn’t seen nearly the same level of interest or adoption as its software-focused cousin.</span></p><p><a href="https://www.linkedin.com/in/dominic-rizzo-b353a628/" target="_blank">Dominic Rizzo</a>, CEO and founder of the startup <a href="https://www.zerorisc.com/" target="_blank">zeroRISC</a>, aims to change that. Today, the nonprofit global security standards consortium <a href="https://globalplatform.org/" target="_blank">GlobalPlatform</a> launched <a href="https://www.pavona.org" target="_blank">Pavona</a>, where Rizzo will be a governing board chair. The goal of Pavona is to facilitate the adoption of open hardware into all kinds of applications, including tiny IoT devices and massive data centers, by making the elements modular, standardized, and trusted.</p><p>Pavona is a new open-hardware ecosystem. It provides a starting kit of hardware modules, coupled with reference designs, a set of software tools to streamline adoption in different types of chips, and software tooling to ease integration. It also has a governance structure aimed at lowering the barrier to entry for adding new open-hardware designs and collaborating on development.</p><p>“I think it’s foundational,” says <a href="https://en.wikipedia.org/wiki/Andrew_Huang_(hacker)" target="_blank">Andrew “bunnie” Huang</a>, hacker and founder of <a href="https://baochip.com/" target="_blank">Baochip</a>, which is a founding member of Pavona. “We are now at the point where we finally have enough of a nugget of something open that we can spread it around. The outcome of this experiment is going to determine the shape of how we interact with hardware and open source for a long time.”</p><h2>How open-source hardware differs from open-source software</h2><p><span><strong></strong>The main reason open-source hardware hasn’t seen as much of a boom as software is almost too obvious to name: hardware needs to be manufactured, and manufacturing costs money. “Hardware, when it’s built, requires atoms,” Huang says, “which requires logistics and payment.”</span></p><p>At bottom, manufacturing itself is closed source. Because of this, open-sourcing hardware is inherently layered: While the chip fabrication, physical design kit, and foundry process remain closed, the layers on top of that, such as the design verification, system architecture, instruction-set architecture, and firmware, may be open source.</p><p>The Pavona ecosystem isn’t meant to deepen the penetration of open source through the layers. Instead, it’s meant to take the available open-source layers and facilitate their adoption and repurposing into as broad an application set as possible. “A lot of the work we’re putting into Pavona has to do with the infrastructure and the architecture that connects all this stuff together,” Rizzo says, “so it becomes much more like Legos, so you can use it in one configuration for a small IoT device and in another configuration for some large data-center system-on-a-chip.”</p><p>Part of making the hardware components more modular is software. Rizzo and his team built what they call an architectural composition engine that serves as a wrapper around the hardware, allowing it to interact with different types of computing cores, be they ARM or RISC-V. This way, a company can integrate the open hardware into their existing architecture without changing the software stack.</p><h2>Pavona begins with security chip OpenTitan</h2><p>Pavona’s starting kit of open-hardware designs includes <a href="https://spectrum.ieee.org/open-titan-chip" target="_self">components of OpenTitan</a>, a chip that provides a “hardware root-of-trust,” a chip-level source of security that serves as a foundation for all secure operations in a computer. They also include extensions of the OpenTitan design that <a href="https://www.zerorisc.com/blog/accelerating-post-quantum-cryptography-on-opentitan-based-designs-flexible-hardware-for-a-secure-future" target="_blank">incorporate</a> efficient cryptography that’s safe against possible future attacks from a large-scale quantum computer.</p><p>According to OpenTitan’s proponents, security hardware benefits from openness more than other chips, because if anyone can inspect and verify the design, and there is an active community of people stress-testing the hardware, it can become more trustworthy, and therefore more secure. It also makes the process of proving compliance with various regulatory requirements more straightforward.</p><p>Rizzo is counting on three factors to drive adoption of these open-security chips. The first is the AI boom, which has caused a massive increase in demand for chips of all kinds, not only the GPUs but also less well-known components like networking cards, monitors, and more. The second is the regulatory push toward transitioning to <a href="https://spectrum.ieee.org/post-quantum-cryptography-standards-nist" target="_self">postquantum security</a>, which both the <a href="https://bidenwhitehouse.archives.gov/briefing-room/statements-releases/2022/05/04/national-security-memorandum-on-promoting-united-states-leadership-in-quantum-computing-while-mitigating-risks-to-vulnerable-cryptographic-systems/" target="_blank">U.S</a>. and <a href="https://digital-strategy.ec.europa.eu/en/news/eu-reinforces-its-cybersecurity-post-quantum-cryptography" target="_blank">European</a> governments have legislated to happen by the end of 2030. And third is new regulatory requirements in the <a href="https://digital-strategy.ec.europa.eu/en/policies/cyber-resilience-act" target="_blank">European Cyber Resilience Act</a>, which adds new security verification and reporting requirements for products sold in the European market.</p><p>“I think those three things together are all driving people in this direction of using secure, open-source silicon,” Rizzo says.</p><p>Security hardware may be just the beginning. Pavona is designed to make it as easy as possible to pull in new hardware modules. One need not be a paying member of Pavona to contribute new designs. “We absolutely are rejecting gatekeeping,” Rizzo says.</p><p>To increase trust from both individual contributors and large companies, Rizzo and his team developed a governance structure based on large open-source projects from the software world, such as <a href="https://www.yoctoproject.org/about/project-overview/" target="_blank">Yocto</a>. Contributing-member companies get representation on Pavona’s governing board. However, an independent technical committee makes the high-level technical decisions. This separation of managerial and technical oversight is meant to increase trust and transparency. “People get very discouraged when they feel like, ‘Hey, I made a contribution, and then someone made a decision in a hallway somewhere and told us later.’ So this is more consensus based, it’s more discussion based. And so those discussions have to be open,” Rizzo says.</p><p><a href="https://ide.mit.edu/people/frank-nagle/" target="_blank">Frank Nagle</a>, the Linux Foundation’s advising chief economist and a research scientist at MIT, <a href="https://ide.mit.edu/people/frank-nagle/" target="_blank"></a>says compliance with standards and transparent governance are the keys to adoption of open-source technologies. “Having that type of structure in place will hopefully give it a fighting chance and allow it to reach scale, without people being concerned that it’s controlled by any one company.”</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="A flow chart containing several colored boxes representing parts of a computer chip" class="rm-shortcode" data-rm-shortcode-id="cc95bbba8452d217b00e6a053fe7dd97" data-rm-shortcode-name="rebelmouse-image" id="84aac" loading="lazy" src="https://spectrum.ieee.org/media-library/a-flow-chart-containing-several-colored-boxes-representing-parts-of-a-computer-chip.jpg?id=66785377&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Pavona’s architectural-composition engine allows hardware to interact with different types of computing cores, so a company can integrate open hardware into its existing architecture without changing the software stack.</small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Dominic Rizzo</small></p><h2>The open-hardware future</h2><p>Nagle argues that an underappreciated benefit of open source is that it allows private companies to work together, collaborating on core technology while still competing on specialized implementations.</p><p>“My favorite example of this I heard from a car manufacturer,” Nagle says. “The seat in your car has a little button that slides your seat backward and forward. Nobody’s buying one car rather than another car because that little toggle is better. But if you didn’t have one of those in your car, then somebody might not buy your car.”</p><p>Many technologies fall into the same category as the car seat’s button—technologies that are necessary but not a differentiator of the product. Security chips are a great example: Every piece of hardware needs security; however, few have it as their main function. These are the parts that benefit from open source, Nagle explains.</p><p>Collaborating on such hardware may enable cost savings for chip manufacturers and their customers, making the AI boom more economically sustainable.</p><p>Perhaps even more important, open sourcing some hardware development can lower the barrier to entry for new people to enter the field. To aid in this quest, Pavona also provides multiple “getting started” guides, software emulation tools, and FPGA code that anyone can download onto a board and get up and running in under 10 minutes.</p><p>“I want to get more people involved,” says bunnie Huang. “Particularly young people, particularly new people. Because we need a more robust ecosystem, more new ideas to ensure that we have the ability to maintain these technologies we depend upon.”</p>]]></description><pubDate>Mon, 25 May 2026 14:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/pavona-open-source-hardware</guid><category>Open-source-hardware</category><category>Open-source</category><category>Hardware-security</category><category>Embedded-security</category><dc:creator>Dina Genkina</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/3d-rendering-of-several-layers-comprising-a-single-computer-chip.jpg?id=66785309&amp;width=980"></media:content></item><item><title>Reclaiming Social Engineering for Good</title><link>https://spectrum.ieee.org/social-engineering-good</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/a-photo-illustration-of-a-person-inside-a-swirling-tunnel-of-colorful-digital-shapes-and-screens.jpg?id=66742827&width=1245&height=700&coordinates=0%2C260%2C0%2C261"/><br/><br/><p>“Social engineering” sounds like something out of a conspiracy thriller, charged with totalitarian control and fringe paranoia. More mundanely, it’s come to be associated with phishing and other scams, in which fraudsters manipulate people into disclosing personal information. </p><p>Yet the concept is older and more benign: it is the deliberate shaping of human behavior, often at scale. It predates silicon—and became pervasive, and ungoverned, especially once its practitioners learned to hide it. Authoritarian regimes and more recently scammers and big companies have profited from it. To defend ourselves from bad actors, and to benefit from social engineering’s good side, we need to reclaim the name, and <a href="https://spectrum.ieee.org/why-engineers-must-try-to-save-the-world" target="_blank">govern it prudently</a>.</p><h2> The roots of engineering</h2><p>In 1894, Dutch entrepreneur Jacques van Marken urged companies to hire “social engineers” to manage human systems such as insurance, education, and profit sharing for workers as carefully as they did mechanical ones. Fifteen years later, reformer William H. Tolman published <em>Social Engineering</em>, describing how U.S. industrialists optimized workers’ conditions alongside manufacturing methods. If industrialists could shape steel and electricity on demand, why not society itself?</p><p> By the 1920s, that confidence had spread. The architect Le Corbusier declared that dwellings were “machines for living in,” imagining cities as orderly lattices where people moved like parts on a conveyor belt. Civilization would run like a Swiss watch.</p><p>The idea soon darkened. Authoritarian regimes pushed it to extremes, promising to fashion “<a href="https://www.jstor.org/stable/20719929" rel="noopener noreferrer" target="_blank">the New Man</a>.” In Nazi Germany, engineer Fritz Todt founded Organization Todt, a vast state engineering enterprise that emerged from the autobahn highway system and later operated concentration camps using slave labor. </p><p>In the Soviet Union, leaders adopted U.S. scientific management techniques to plan factory-worker movements and classify populations through centralized records, feeding both rapid industrialization drives and the gulag system of forced labor. The same tools and managerial methods used to build highways and enact five-year plans worked for repression and mass control.</p><p>By the 1950s, “social engineering” had become a contaminated phrase. The revelations of Nazi and Soviet abuses, along with Cold War <a href="https://en.dialektika.org/society-politics/politics/karl-popper-and-the-social-engineering-utopian-vs-piecemeal/" rel="noopener noreferrer" target="_blank">critiques of grand social planning</a> turned the term from a progressive slogan into a warning label. Banishing the words pushed the practice underground, making it harder to recognize when it resurfaced in new forms—such as organizational psychology and systems management that still relied on classification and behavioral influence techniques but under softer, less loaded labels.</p><h2>Social engineering’s more subtle spread</h2><p>In the postwar years, the new social-engineering lexicon included “human factors” and “urban planning,” all promising integration rather than command. As computing advanced, the language shifted again: “customer journey mapping” to track interactions, “user experience” to script them. Engineering, which began as a means of reshaping physical space, set its sights on shaping behavior. Digital design features embedded in our smartphones now target our attention and desire.</p><p> Language helps conceal these modern forms of social engineering. “Data analytics” sounds neutral beside “surveillance.” “Personalization” flatters individuality while still sorting users into predictable categories. “Behavioral nudges” guide decisions without the sense of intrusion. We attach “social” as a favorable modifier to sciences, capital, and media, yet recoil when it meets “engineering.”</p><p> That discomfort is a clue. Engineering implies control, and control prompts us to ask who directs whom, toward what ends, and with whose permission.</p><p> Not all social engineering these days is hidden. Hackers don’t need to break a firewall if someone hands over their password. Romance scammers cultivate intimacy the way farmers cultivate crops. They succeed not through force but by exploiting trust. If even these obvious attacks work, the invisible kind, with roots in social engineering, are a shoo-in. </p><p>Most of the social engineering we encounter is proprietary and beyond our control. Firms build recommendation algorithms tuned to boost engagement and profit with no hearings or right of appeal. Browser and cookie defaults decide what data we surrender. A single autoplay toggle can cost users hours and build unhealthy habits. These are acts of engineering as deliberate as laying a road or redrawing an electoral district. They create a kind of curated itch by which boredom never settles, and satisfaction never arrives. The results are predictable—users click on targeted ads, make purchases, form habits, and lock in opinions. </p><p>Consent has transformed along with it. Once straightforward and revocable, it is now subtle and persistent, buried in defaults or opaque terms of service too quickly accepted. You remain free to opt out, much as you are free to refuse roads or electricity. Consent has become the preselected setting of modern life.</p><p>When social engineering operated more in the open, citizens could contest it, at least in societies with responsive government. Today’s invisible version diffuses accountability so thoroughly that scrutiny becomes hard to direct. Despite recent <a href="https://www.judiciary.senate.gov/committee-activity/hearings/social-media-and-the-teen-mental-health-crisis" rel="noopener noreferrer" target="_blank">congressional hearings</a> on social media’s impact on youth mental health and juries agreeing that <a href="https://spectrum.ieee.org/social-media-trial" target="_self">firms are knowingly designing algorithms that cause harm</a>, pinpointing responsibility remains elusive. When the mechanism is buried inside a system used by billions, we cannot easily point to a single decision-maker or trace the precise moment of manipulation. </p><p>Today’s social engineering is less overt and theatrical than its predecessors. Earlier versions arrived on public posters and loudspeakers for mass audiences. Today’s version is more intimate, delivered through personal devices and constant feeds tailored to the individual. The model succeeds because participation feels like freedom, not control. </p><p>Not all social engineering is dystopian. Well-kept parks foster community, accessible buildings extend dignity, vaccines and seatbelts save lives. Even in the digital realm, positive examples exist: browser extensions that automatically block hidden trackers, search engines that refuse to build personalized surveillance profiles, and decentralized social platforms that give users greater control over their own data and feeds. </p><p> The term “social engineering” still unsettles, though. But “asocial” engineering, which ignores human consequences entirely, is worse. Recognition of the human dimension to engineering is the beginning of repair. Only by seeing the machinery clearly and naming it honestly can we decide who engineers what and why. The machinery will not dismantle itself. Once named, it becomes subject to choice. That negotiation of purpose, power, and process are the defining political questions of any real democracy. We cannot ensure that social engineering serves and sustains society so long as we dodge the words.</p>]]></description><pubDate>Mon, 25 May 2026 13:00:01 +0000</pubDate><guid>https://spectrum.ieee.org/social-engineering-good</guid><category>Social-engineering</category><category>User-experience</category><category>Policy</category><category>Security</category><dc:creator>Guru Madhavan</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/a-photo-illustration-of-a-person-inside-a-swirling-tunnel-of-colorful-digital-shapes-and-screens.jpg?id=66742827&amp;width=980"></media:content></item><item><title>Bolt Challenges Nvidia With a Focus on Cutting-Edge Graphics</title><link>https://spectrum.ieee.org/bolt-graphics-zeus-gpu</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/bolt-graphicss-zeus-gpu-comes-in-as-a-pcie-card-for-pcs-and-workstations-and-in-a-multi-gpu-version-for-server-racks.jpg?id=66764156&width=1245&height=700&coordinates=0%2C156%2C0%2C157"/><br/><br/><p><br/></p><p>Darwesh Singh thinks Nvidia has a weakness.</p><p>The last decade of Nvidia’s history was among the most consequential stories in technology ever. The company’s stock price has increased over 200-fold since 2016, and <a href="https://epoch.ai/data-insights/ai-chip-production" rel="noopener noreferrer" target="_blank">deployed Nvidia AI compute capacity has surged to 225 times</a> greater than the first quarter of 2021, according to data tracked by Epoch AI.</p><p>Yet Nvidia may in some ways be a victim of its own success. Its dominance in AI has led to GPU designs that prioritize tensor units and low precision math. These decisions make sense for AI, but less so for some creative, scientific, and industrial work.</p><p><a href="https://www.linkedin.com/in/darweshsingh/" target="_blank">Singh’s</a> five-year-old startup, <a href="https://bolt.graphics/about-us/" rel="noopener noreferrer" target="_blank">Bolt Graphics</a>, sees an opportunity to build a GPU specifically for these use cases. <a href="https://www.linkedin.com/in/jill-mueller-allied-asid-191511107/" rel="noopener noreferrer" target="_blank">Jill Mueller,</a> Bolt’s chief marketing officer, puts it bluntly. Nvidia has “a fundamental lack of understanding of their customer,” she says. “They just throw stuff at you, and there you go.”</p><p>Bolt aims for this potential weak spot with Zeus, a GPU that will be sold as both a PCIe (peripheral component interconnect express) card for desktop workstations and, for those who require more performance, a rack-mountable server containing four Zeus GPUs (for up to 96 per rack).</p><h2>While Nvidia goes low-precision, Bolt goes high</h2><p><a href="https://www.linkedin.com/in/feldgoise/" rel="noopener noreferrer" target="_blank">Jacob Feldgoise</a>, senior data research analyst at <a href="https://cset.georgetown.edu/" rel="noopener noreferrer" target="_blank">Georgetown University’s Center for Security and Emerging Technology</a>, has also noticed a shift in Nvidia’s recent hardware.</p><p>“AI is sucking the computational units used for high-precision workloads out of that hardware,” he says. “If you look at Nvidia’s highest performance GPUs, generation to generation, a greater share of the hardware has been allocated to <a href="https://spectrum.ieee.org/nvidia-gpu" target="_blank">low-precision compute</a>, as opposed to high-precision compute, which is generally needed for scientific computing.”</p><p>Precision refers to how many bits a GPU uses to represent each number. High-precision formats like FP64 (64-bit floating point) preserve more digits and a wider range, while FP16 and INT8 sacrifice precision for speed. Recently, Nvidia introduced a new 4-bit number format, <a href="https://developer.nvidia.com/blog/introducing-nvfp4-for-efficient-and-accurate-low-precision-inference/" rel="noopener noreferrer" target="_blank">NVFP4</a>, to accelerate AI workloads, which generally tolerate low-precision math.</p><p>But some tasks require precision. Singh cited geographical information systems, such as <a href="https://www.esri.com/en-us/arcgis/geospatial-platform/overview" rel="noopener noreferrer" target="_blank">Esri’s ArcGIS</a>, as an example. When rendering the planet on a GPU, low-precision arithmetic applied to large coordinate values can introduce errors that cause objects to drift.</p><p>Because Zeus, unlike so many other GPUs, is not designed primarily for AI, its design makes FP64-native vector cores a focus and allocates a large share of silicon to them.</p><p>“[Nvidia and AMD] make a conscious trade-off to allocate more die space to matrix multiplication and tensor units and less towards fixed function hardware,” Singh says. ”We decided to allocate the die space a bit differently.”</p><h2>Rasterization is out, path tracing is in</h2><p>A focus on FP64 isn’t the only way Bolt differs from the norm. Zeus is also built to render graphics with path tracing instead of <a href="https://spectrum.ieee.org/story-behind-pixars-cgi-software" target="_blank">rasterization</a>.</p><p>Rasterization is the traditional method of high-performance 3D rendering. It projects 3D triangles onto a pixel grid and uses mathematical abstractions to determine the correct color for each pixel. Path tracing instead does the equivalent of shooting rays from a camera to simulate how light should bounce and interact. It delivers more accurate lighting but is computationally expensive.</p><p>As with high-precision math, Bolt believes it can find an edge by placing more emphasis on path tracing than do today’s GPUs. Rasterization is supported by Zeus but significantly scaled back; Singh estimates that Zeus’s raster performance is about half that of a comparable Nvidia card.</p><p>Bolt’s fresh arrival to the GPU arena also allows the company to take a clean sheet approach unburdened by legacy support. This differs from Nvidia and AMD, which must integrate path tracing alongside rasterization in a way that can support numerous existing applications and application programming interfaces (APIs).</p><p>Bolt claims that a server rack with 28 Zeus GPUs will deliver real-time path traced performance equivalent to 280 Nvidia RTX 5090 GPUs. The aim is for this configuration of Zeus hardware to support real-time path tracing that simulates up to 20 “bounces”—a reflection or collision of the simulated light—at 4K resolution and 30 frames per second. This is a high degree of accuracy required for professional rendering workloads; for comparison, even the most graphically attractive path traced games simulate just a few bounces.</p><h2>Can a startup really launch a new GPU?</h2><p>There’s a logic to Bolt’s approach. Nvidia and AMD are focused on AI, but GPUs are still useful for many tasks besides AI. However, Bolt will need to overcome two key technical hurdles.</p><p>The first is production. Cutting-edge silicon production is in short supply, and leaders like Nvidia have most leading-edge production capacity tied up. The Zeus GPU will instead be fabricated on TSMC’s older N5 process node. Bolt is betting that an older process node will keep Zeus competitive with Nvidia on price.</p><p>Bolt may also find it challenging to convince users that an unproven GPU is a safe bet. Driver support for software is always a headache in the GPU arena—<a href="https://www.youtube.com/watch?v=MjYSeT-T5uk" rel="noopener noreferrer" target="_blank">just ask Intel</a>—and the use cases that might benefit Zeus’s high precision and path tracing will also require reliable drivers.</p><p>Bolt plans to address this by launching with support only for specific applications. “We know that PC gaming is a huge segment,” Singh says. “But our approach is we want to target professional, creative, and high-performance compute first.” The company is working with software companies including <a href="https://www.blender.org/about/" rel="noopener noreferrer" target="_blank">Blender</a>, <a href="https://www.autodesk.com" rel="noopener noreferrer" target="_blank">Autodesk</a>, and <a href="https://www.sidefx.com/" rel="noopener noreferrer" target="_blank">SideFX</a>.</p><p>Bolt <a href="https://www.prnewswire.com/news-releases/bolt-graphics-completes-tape-out-of-test-chip-for-its-high-performance-zeus-gpu-a-major-milestone-in-reducing-computing-costs-by-17x-302750442.html" rel="noopener noreferrer" target="_blank">announced the tape-out of the first Zeus test chips on 22 April 2026</a>, and it is now focused on bringing the GPU to production by the fourth quarter of 2027.</p><p><em>This article appears in the July 2026 print issue as “Bolt Wants to Put the Graphics Back Into GPUs.”</em></p>]]></description><pubDate>Thu, 21 May 2026 13:00:02 +0000</pubDate><guid>https://spectrum.ieee.org/bolt-graphics-zeus-gpu</guid><category>Computer-graphics</category><category>Gpus</category><category>Nvidia</category><dc:creator>Matthew S. Smith</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/bolt-graphicss-zeus-gpu-comes-in-as-a-pcie-card-for-pcs-and-workstations-and-in-a-multi-gpu-version-for-server-racks.jpg?id=66764156&amp;width=980"></media:content></item><item><title>The Future of Physical AI Isn’t Smarter Robots, It’s Smarter Interfaces</title><link>https://spectrum.ieee.org/wetour-robotics-physical-ai-human-interfaces</link><description><![CDATA[
<img src="https://spectrum.ieee.org/media-library/hands-controlling-speaker-light-bulb-and-drone-against-minimalist-white-walls.jpg?id=66718902&width=1245&height=700&coordinates=160%2C0%2C160%2C0"/><br/><br/><p><em>This sponsored article is brought to you by <a href="https://wetourrobotics.com/" target="_blank">Wetour Robotics</a>.</em></p><p>A field technician on a wind turbine, harness clipped, both hands on a wrench, needs to send a command to the diagnostic device hanging at her belt. A logistics worker on a loading dock, gloves on, eyes on the pallet, needs to redirect a connected lift. A person using an assistive mobility device on a crowded street wants to nudge it forward without taking out a phone or speaking aloud. None of these moments call for a smarter robot. They call for a smarter way to be heard by the machines that already exist.</p><h2>The industry has been building from one side</h2><p>The past three years of Physical AI have been a story of remarkable progress on the robot side of the loop. Companies like Boston Dynamics, Figure, and Unitree have advanced actuators, locomotion, and dexterity to a level that would have seemed implausible a decade ago. Google DeepMind’s Gemini Robotics has redefined what vision-language-action models can do in unstructured settings. The trajectory of the hardware and the foundation models is real, and it is accelerating.</p><p>But there is another side to this loop, and it has been treated as a solved problem for too long. The interface between humans and machines has defaulted, for 40 years, to three input modalities: screens, buttons, and voice. Each of those assumes the user can stop, look down, and translate intent into structured commands. That assumption breaks the moment the work moves into a real environment. On a turbine. On a dock. On a sidewalk. In any setting where hands are occupied, eyes are committed, or speaking is impractical, the conventional interface stack quietly fails.</p><p class="pull-quote">Spatial Intent Fusion is the simultaneous processing of three streams of human-centered information, namely spatial position, visual context, and gestural intent: Your body is the interface.<br/></p><p>The bottleneck on the human side of the loop is becoming as important as the one on the machine side. And solving it requires a different question. Not how do we make the robot more capable, but how do we let the human participate in the computing system as naturally as the robot already does.</p><h2>Wetour Robotics’ bet: put the human back into the computing loop</h2><p><a href="https://wetourrobotics.com/" target="_blank">Wetour Robotics</a> is betting that the next architectural leap in Physical AI is not about making the robot more capable. It is about making the human a first-class node in the computing network, with the same kind of low-latency, high-fidelity participation that connected devices already enjoy.</p><p>Wetour Robotics’ engineers frame the problem this way: a wristband that recognizes a gesture is not enough. A camera that recognizes a scene is not enough. The information a human carries about what they are about to do is distributed across multiple channels, including where their body is in space, what their eyes are attending to, and what their muscles are preparing to do, and any single channel observed in isolation is ambiguous. Reconstructing intent reliably means fusing those channels at the operating system level, with latency low enough that the loop feels closed rather than mediated.</p><p>This approach has a name. Wetour Robotics calls it Spatial Intent Fusion: the simultaneous processing of three streams of human-centered information, namely spatial position, visual context, and gestural intent, fused into a single real-time command for any connected physical device. It is the technical implementation behind a simpler positioning statement the company uses externally: your body is the interface.</p><p class="shortcode-media shortcode-media-rebelmouse-image"> <img alt="Sleek silver rectangular electronic device labeled \u201cORCHESTRA\u201d on a light gray background." class="rm-shortcode" data-rm-shortcode-id="bb58b16b7b8b65030fe32d2ff82e4ee2" data-rm-shortcode-name="rebelmouse-image" id="1af08" loading="lazy" src="https://spectrum.ieee.org/media-library/sleek-silver-rectangular-electronic-device-labeled-u201corchestra-u201d-on-a-light-gray-background.png?id=66718892&width=980"/> <small class="image-media media-caption" placeholder="Add Photo Caption...">Orchestra is a portable intelligent hub running the operating system that handles sensor fusion, intent inference, command translation, and safety arbitration. The reference compute platform is NVIDIA Jetson Orin Nano Super, which provides enough on-device inference capacity to keep the entire control loop at the edge, with no cloud dependency on the critical path. </small><small class="image-media media-photo-credit" placeholder="Add Photo Credit...">Wetour Robotics</small></p><h2>The architecture: three layers, four engines, one loop</h2><p>Orchestra is not a single device but a layered platform, designed from the start to be sensor-flexible and actuator-agnostic. The architecture decomposes into three perception layers and four coordination engines.</p><p><strong>Orchestra</strong> itself is the local compute and orchestration core: a portable intelligent hub running the operating system that handles sensor fusion, intent inference, command translation, and safety arbitration. The reference compute platform is NVIDIA Jetson Orin Nano Super, which provides enough on-device inference capacity to keep the entire control loop at the edge, with no cloud dependency on the critical path. Edge inference is non-negotiable for this application. Full-chain latency from biosignal acquisition to actuator command is held under 100 milliseconds, the envelope inside which closed-loop control feels natural rather than laggy.</p><p><strong>VisionLink</strong> handles visual and spatial perception. Cameras feed into vision models that identify objects, estimate distances, and track environmental context. VisionLink is designed not as a passive recognition layer but as a real-time command generator: its outputs feed directly into Orchestra OS to be fused with biosignal data.</p><p><strong>Conductor</strong> is the biosignal pipeline. It ingests raw surface electromyographic (sEMG) data from a wrist-worn device, classifies temporal patterns into discrete gestures or continuous control signals, and outputs actuator commands. The technically interesting property of sEMG for this use case is that the signal precedes visible motion. Motor unit action potentials appear at the skin surface roughly 50 to 80 milliseconds before a finger completes the corresponding gesture. Wetour Robotics calls this property pre-motion intent sensing, and it is what allows Orchestra to anticipate user intent rather than react to it.</p><p>On top of the three perception layers, Orchestra OS runs four coordination engines. The <strong>Perception Engine</strong> ingests and normalizes raw sensor streams. The <strong>Intent Engine </strong>performs Spatial Intent Fusion across modalities, resolving what the user is trying to do given where they are, what they are looking at, and what their hand is signaling. The <strong>Orchestration Engine</strong> translates intent into device-specific command sequences for any connected actuator. The <strong>Safety Engine</strong> arbitrates conflicting commands, enforces operational envelopes, and gates execution against runtime safety conditions.</p><p class="shortcode-media shortcode-media-youtube"> <span class="rm-shortcode" data-rm-shortcode-id="cadc408927185275af6d15b314d998a0" style="display:block;position:relative;padding-top:56.25%;"><iframe frameborder="0" height="auto" lazy-loadable="true" scrolling="no" src="https://www.youtube.com/embed/WOUjWM4hIko?rel=0" style="position:absolute;top:0;left:0;width:100%;height:100%;" width="100%"></iframe></span></p><h2>The trade-offs we’re honest about</h2><p>No system that bridges the human body and the digital world is finished. Three engineering challenges remain open, and the company addresses each with a deliberate trade-off rather than a claim of having fully solved it.</p><p><strong>Baseline stability of sEMG under motion.</strong> In a stationary user, continuous gesture recognition from sEMG is reliable. Once the user is walking, climbing, or otherwise moving, motion artifacts and electrode drift degrade the signal in ways that are difficult to fully compensate for. Rather than overpromise on continuous control in dynamic settings, Orchestra defaults to a smaller set of robust discrete gestures in complex operating environments, and reserves continuous control modes for contexts where the signal-to-noise ratio supports them.</p><p><strong>Miniaturization of edge AI compute.</strong> Running the Orchestra control loop entirely at the edge requires real on-device inference, which has historically meant trading off between compute capacity, battery life, and form factor. Wetour Robotics’ approach has been a compact carrier board paired with a thermal design and a battery module sized for all-day wearability. The result is a hub that travels with the user rather than tethering them to a desk, and that performs the full perception-to-actuation loop without offloading to the cloud.</p><p><strong>Heterogeneity of third-party device protocols.</strong> The actuator side of the loop is a fragmented landscape. Different manufacturers expose different command interfaces, different communication stacks, and different safety conventions, and a Physical AI operating system has to integrate with all of them. Wetour Robotics uses an AI-agent layer to negotiate connection and protocol translation adaptively, so that Orchestra OS can ingest data from a wide range of devices, run them through neural network models that infer human intent, and emit the right command on the right protocol for the device on the other end.</p><h2>Why this matters, and why it helps the rest of the field</h2><p>The history of computing is a history of interface revolutions. Command lines gave way to graphical user interfaces, which gave way to touch, which gave way to voice. Each transition expanded who could participate in the system and what they could do with it. The next transition is not about a new screen or a new microphone. It is about treating the human body itself as a participant in the computing network, capable of contributing intent at the same speed and fidelity that any other connected node can.</p><p class="pull-quote">The history of computing is a history of interface revolutions. The next transition is not about a new screen or a new microphone — it is about treating the human body itself as a participant in the computing network.</p><p>This path is not a competitor to the work being done on humanoid robots, foundation models for embodied AI, and dexterous manipulation. It is the missing complement to that work. The hardest open problem for humanoid systems is the data: every natural interaction between a human and the physical world is a potential training signal, and most of those interactions are currently invisible to any computing system. As more humans become first-class nodes in the loop, those interactions become observable, structured, and ultimately useful for training the next generation of embodied AI, including the humanoid robots being developed today.</p><p>In other words: putting the human back into the computing loop is not just about better interfaces for individual users. It is about generating the kind of grounded, in-the-wild human-machine interaction data that the broader Physical AI ecosystem will need to keep advancing. The robot side and the human side of the loop are not two competing futures. They are two halves of the same one.</p><p>That is what Wetour Robotics means when it says: <em>Your body is the interface.</em></p><p>Learn more at <a href="https://wetourrobotics.com/" target="_blank">wetourrobotics.com</a>.</p>]]></description><pubDate>Thu, 21 May 2026 10:00:02 +0000</pubDate><guid>https://spectrum.ieee.org/wetour-robotics-physical-ai-human-interfaces</guid><category>Interfaces</category><category>Physical-ai</category><category>Robot-hardware</category><category>Smarter-robots</category><dc:creator>Wetour Robotics</dc:creator><media:content medium="image" type="image/jpeg" url="https://spectrum.ieee.org/media-library/hands-controlling-speaker-light-bulb-and-drone-against-minimalist-white-walls.jpg?id=66718902&amp;width=980"></media:content></item></channel></rss>