UPDATED. 2024-06-20 07:03 (목)
Samsung unveils new HBM-PIM aimed at AI
Samsung unveils new HBM-PIM aimed at AI
  • Noh Tae Min 기자
  • 승인 2023.08.31 10:36
  • 댓글 0
이 기사를 공유합니다

Chips have double the performance of HBM
Image: Samsung
Image: Samsung

Samsung unveiled new chips that combine memory and processor chips at Hot Chips 2023 conference on Tuesday.

The chips, high bandwidth memory (HBM)-processing in memory (PIM) and LPDDR-PIM, are aimed at future AI applications, the tech giant said.

Applying these chips for generative AI applications will yield double the accelerator performance and power efficiency compared to conventional HBM, Samsung said.

The study used AMD’s MI-100 GPU and Samsung, for mixture of experts (MOE) verification, built an HBM-PIM cluster.

The company used 96 units of MI-100 with HBM-PIM. The MOE model showed double the acceleration rate of HBM and three times the power efficiency, according to Samsung.

In an HBM-PIM, some of the processing capabilities of the CPU is allocated to the memory, which reduces the amount of data transfer between CPU and memory.

As AI uses massive amounts of data and causes memory bottlenecks, this concept of chip is designed to mitigate that.

Samsung also showcased LPDDR-PIM where PIM is applied to mobile DRAM so that calculations can be also done on the device end.

The tech giant said the chip has a bandwidth of 102.4GB and has 72% less power consumption compared to conventional DRAMs.


댓글삭제
삭제한 댓글은 다시 복구할 수 없습니다.
그래도 삭제하시겠습니까?
댓글 0
댓글쓰기
계정을 선택하시면 로그인·계정인증을 통해
댓글을 남기실 수 있습니다.

  • 515, Nonhyeon-ro, Gangnam-gu, Seoul, Republic of Korea 4F, Ahsung Bldg.
  • 대표전화 : 82-2-2658-4707
  • 팩스 : 82-2-2659-4707
  • 청소년보호책임자 : Stan LEE
  • 법인명 : The Elec Inc.
  • 제호 : THE ELEC, Korea Electronics Industry Media
  • 등록번호 : 서울, 아05435
  • 등록일 : 2018-10-15
  • 발행일 : 2018-10-15
  • 발행인 : JY HAN
  • 편집인 : JY HAN
  • THE ELEC, Korea Electronics Industry Media Prohibiting unauthorized duplication,publishing,modification and distribution the material on this Site for any purpose.
  • Copyright © 2024 THE ELEC, Korea Electronics Industry Media. All rights reserved. mail to powerusr@thelec.kr
ND소프트