Search This Blog
Powered by Blogger.

Blog Archive

Labels

Footer About

Footer About

Labels

Load More
Trendy Right Now

Popular Posts

Showing posts with label data center GPUs. Show all posts
data security
Ai Data AI technology CPU Cyber Security Data Center data center GPUs Data protection data security

AI Datacenter Boom Triggers Global CPU and Memory Shortages, Driving Price Hikes

 

Spurred by growing reliance on artificial intelligence, computing hardware networks are pushing chip production to its limits - shortages once limited to memory chips now affect core processors too. Because demand for AI-optimized facilities keeps climbing, industry leaders say delivery delays and cost increases may linger well into the coming decade. 

Now coming into view, top chip producers like Intel and AMD face difficulty keeping up with processor needs. Because of tighter supplies, computer and server builders get fewer chips than ordered - slowing assembly processes down. This gap pushes shipment timelines further out while lifting prices by roughly one-tenth to slightly more than an eighth. With supply trailing behind, companies brace for longer waits and steeper costs. Heavy demand has pushed key tech suppliers like Dell and HP to report deeper shortages lately. Server parts now take months rather than weeks to arrive - delays once rare are becoming routine. 

Into early 2026, experts expect disruptions to grow worse, stretching stress across business systems and home buyers alike. With CPU availability shrinking, pressure grows on a memory market already strained. Because of rising AI-driven datacenter projects, need for DRAM and NAND has jumped sharply - shifting production lines from devices like smartphones and laptops. This shift means newer tech such as DDR5 costs more than before, making upgrades less appealing. People now hold onto older machines longer, especially those running DDR4, simply because replacing them feels too costly. 

Nowhere is the strain more visible than in everyday device markets. Higher expenses for parts translate directly into steeper price tags on laptops, along with slower release cycles. Take Valve - their Linux-powered compact desktop hit pause, held back by material shortages. On another front, Micron stepped away from selling memory modules to regular users, focusing instead on large-scale computing and artificial intelligence needs. Shifts like these reveal where attention now lies within the sector. 

Facing growing challenges, legacy chip producers watch as new players step in. Not far behind, Arm launches its debut self-designed CPU, built specifically for artificial intelligence tasks. Demand was lacking - now it's shifting. Big names like Meta, Cloudflare, OpenAI, and Lenovo are paying attention, drawn by fresh potential. Change arrives quietly, then spreads. 

Facing ongoing shortages, market projections point to extended disruptions through the 2030s - altering how prices evolve while shifting the rhythm of technological advances in chips and computing systems.
Read more »
Technology
AI model accuracy data center GPUs ECC protection GPUHammer tool NVIDIA GDDR6 memory Rowhammer GPU attacks Technology

NVIDIA Urges Users to Enable ECC to Defend GDDR6 GPUs Against Rowhammer Threats

  

NVIDIA has issued a renewed advisory encouraging customers to activate System Level Error-Correcting Code (ECC) protections to defend against Rowhammer attacks targeting GPUs equipped with GDDR6 memory.

This heightened warning follows recent research from the University of Toronto demonstrating how practical Rowhammer attacks can be on NVIDIA’s A6000 graphics processor.

“We ran GPUHammer on an NVIDIA RTX A6000 (48 GB GDDR6) across four DRAM banks and observed 8 distinct single-bit flips, and bit-flips across all tested banks,” the researchers explained. “The minimum activation count (TRH) to induce a flip was ~12K, consistent with prior DDR4 findings.”

Using these induced bit flips, the researchers performed what they described as the first machine learning accuracy degradation attack leveraging Rowhammer on a GPU.

Rowhammer exploits a hardware vulnerability where repeatedly accessing a memory row can cause adjacent memory cells to change state, flipping bits from 1 to 0 or vice versa. This can lead to denial-of-service issues, corrupted data, or even potential privilege escalation.

System Level ECC combats such risks by introducing redundant bits that can automatically detect and correct single-bit memory errors, ensuring data remains intact.

NVIDIA emphasized that enabling ECC is particularly critical for workstation and data center GPUs, which handle sensitive workloads like AI training and inference, to prevent serious computational errors.

The company’s security bulletin confirmed that researchers “showed a potential Rowhammer attack against an NVIDIA A6000 GPU with GDDR6 Memory” in scenarios where ECC had not been turned on.

The GPUHammer technique developed by the academic team successfully induced bit flips despite GDDR6’s higher latency and faster refresh rates, which generally make Rowhammer attacks more challenging compared to older DDR4 memory.

Researcher Gururaj Saileshwar told BleepingComputer that their demonstration could drop an AI model’s accuracy from 80% to below 1% with just a single bit flip on the A6000.

In addition to the RTX A6000, NVIDIA strongly recommends enabling ECC on the following GPU product lines:

Data Center GPUs:
  • Ampere: A100, A40, A30, A16, A10, A2, A800
  • Ada: L40S, L40, L4
  • Hopper: H100, H200, GH200, H20, H800
  • Blackwell: GB200, B200, B100
  • Turing: T1000, T600, T400, T4
  • Volta: Tesla V100, Tesla V100S
Workstation GPUs:
  • Ampere RTX: A6000, A5000, A4500, A4000, A2000, A1000, A400
  • Ada RTX: 6000, 5000, 4500, 4000, 4000 SFF, 2000
  • Blackwell RTX PRO (latest workstation line)
  • Turing RTX: 8000, 6000, 5000, 4000
  • Volta: Quadro GV100
Embedded/Industrial:
  • Jetson AGX Orin Industrial
  • IGX Orin
Newer GPUs—including Blackwell RTX 50 Series, Blackwell Data Center chips, and Hopper Data Center GPUs—feature built-in on-die ECC protection that requires no manual configuration.

To verify whether ECC is active, administrators can use an out-of-band method through the Baseboard Management Controller (BMC) and Redfish API to check the “ECCModeEnabled” status. NVIDIA’s NSM Type 3 and SMBPBI tools also allow ECC configuration, but these require NVIDIA Partner Portal access.

Alternatively, ECC can be checked or enabled in-band using the nvidia-smi command-line tool from the system CPU.

Saileshwar noted that enabling these safeguards could reduce machine learning inference performance by around 10% and reduce available memory capacity by 6.5% across workloads.

While Rowhammer remains a significant security concern, its exploitation in real-world scenarios is complex. An attack requires highly specific conditions, intensive memory access, and precise control, making it difficult to carry out reliably, especially in production environments.
Read more »
Subscribe to: Comments (Atom)