Huaqiu PCB
Highly reliable multilayer board manufacturer
Huaqiu SMT
Highly reliable one-stop PCBA intelligent manufacturer
Huaqiu Mall
Self-operated electronic components mall
PCB Layout
High multi-layer, high-density product design
Steel mesh manufacturing
Focus on high-quality steel mesh manufacturing
BOM ordering
Specialized Researched one-stop purchasing solution
Huaqiu DFM
One-click analysis of hidden design risks
Huaqiu Certification
Certification testing is beyond doubt
Media: In view of the widespread use of ChatGPT, it has triggered a rapid increase in the demand for AI computing power, causing NVIDIA’s AI chips to exceed supply and create a large-scale shortage. Now, Nvidia seems to be facing more challenges.
LPU 10 times faster than Nvidia GPU
In the past two days, an American artificial intelligence company called Groq has received widespread tracking and attention. The main reason is that its self-developed LPU chip has great advantages in artificial intelligence. A breakthrough in reasoning skills.
By optimizing the architecture and reducing memory bottlenecks, Groq’s LPU chip demonstrates high efficiency in large model Burundins Escort processing And low-latency features, the speed is far higher than that of NVIDIA GPU, the generation rate is close to 500 tokens per second, while GPT-4 is only 40 tokens.
Therefore, Groq LPU is known as [the fastest in historyLarge model technology].
The working principle of Groq LPU is different from that of Nvidia’s GPU. It adopts an architecture called Temporal Instruction Set Computer (Temporal Instruction Set Computer). The memory used is static random access memory (SRAM), which is faster than that used by GPU. High-bandwidth memory (HBM) is about 20 times faster.
According to Groq’s first public benchmark test in January 2024, the Meta Llama 2-70B model powered by Groq LPU has an inductive performance 18 times faster than other top cloud computing providers. BI Escorts
artificialanalysis.aBurundins Escorti also show that Groq’s Burundi Sugar throughput rate can be said to be [far ahead].
To sum up, Groq’s architecture is based on small memory and large computing power, so the limited internal affairs that can be processed correspond to extremely high computing power Burundins Escort‘s power and attractionBurundins Sugardaddy cause its speed to be very fast.
Some analysts say that during the period when A100 and H100 are in absolute shortage, LPU may become a major model Burundins Sugardaddy A new choice for merchants.
Grop is even more expensive to deploy than Nvidia
Now Groq is shocking the AI industry with its lightning speed.
However, apart from the shock, many industries After calculation, people found that the price behind this speed may be too high.
Groq’s LPU chip abandoned HBI Escorts. BM, relies solely on SRAM for calculations.
Although this method does bring impressive calculation speeds, its cost-effectiveness has been questioned.
It is worth tracking that although Groq is still in use. The speed is excellent, but the cost behind Burundi Sugar Daddy is quite high
based on the operating cost in the next three years. , Groq’s hardware purchase cost is as high as 11.44 million US dollars, while operating costs are at least 762,000 US dollars.
According to this estimate, under the same throughput, Groq’s hardware cost is approximately 40 times that of H100, and its energy consumption cost is . 10 times.
If three years of operation are considered, the purchase cost of GroqBurundi Sugar hardware is US$1.144 million and the operating cost is US$76.2. Ten thousand.
On the other hand, for an 8-card H100 box, the hardware purchase cost is 300,000 US dollars, and the operating cost is about 72,000 or slightly lower.
Because the Groq memory capacity is relatively small (230MB). , when running the Llama-270b model, 305 Groq cards are needed to meet the demand, while only 8 cards are needed to use H100.
Therefore, judging from the current price, under the same throughput, Groq’s hardware The cost is 4Burundi Sugar and the energy consumption cost is 10 times.
In other words, Groq’s high-speed performance is the best. On the basis of unlimited single-card throughput capacity.
In order to achieve the same throughput as H100, Groq needs to use more graphics cards.
In this context, [speed] has become a factor of Groq. A double-edged sword.
.png” />
Groq’s slogan [Catch up with Nvidia within three years]
Recently, a user who claimed to be a Groq employee said when interacting with network users that Groq is committed to becoming the fastest new technology in the world. Night-scale model hardware, and vowed to surpass NVIDIA within three years.
However, as of the opening of US stocks on February 20, NVIDIA’s stock price fell by 4.35% in a single day, the largest single-day decline since October last year, and its market value. It lost 78 billion US dollars (approximately 560 billion yuan) overnight.
Although Groq is fast, its price is higher and it cannot currently compete with Nvidia’s SRAM technology, which has a large area and high power consumption. It has long been integrated into system-level chips (SoC) in the form of IP cores. It is not a stand-alone application, and its future development potential is far less than that of HBM. (High-bandwidth memory).
In terms of unit capacity, performance and power consumption, the HBM technology used in NVIDIA GPUs is superior to SRAM.
From a technical and performance perspective, GBI Escortsroq is currently unable to shake Nvidia’s position.
The reason is that Nvidia’s GPU products are versatile, while Groq’s products are ASICsBurundi Sugar (Purpose Integrated Circuit) is not a general-purpose product, but a customized product.
In other words, any artificial intelligence algorithm can use NVIDIA’s H200. , but only Mixtral and Llama2 can use Groq’s LPU
To use Groq products, large mold companies need to first clarify the requirements, specify the specifications, and then perform performance verification before the final products can be put into use. .
NVIDIA’s financial report once again confirmed its position as the biggest winner in the artificial intelligence wave.
NVIDIA released its performance report for the four quarters as of January 28, 2024, on February 22, Beijing time. .
The report showed that Burundi Sugar‘s quarterly revenue reached a record of US$22.1 billion, far exceeding Nvidia’s own and Wall Street expectations. , a year-on-year increase of 265%.
Full-year revenue also reached a new high, reaching 60.9 billion US dollars, a year-on-year increase of 126%.
Nvidia expects this quarter’s revenue to further climb to 24 billion US dollars. Later, its stock price rose by more than 10% after hours.
Starting with:
Groq architecture Burundi Sugar Daddy features small memory and large computing power, which is suitable for frequent data transfer scenarios. It is fast but has limited throughput capacity on a single card and requires more cards. To ensure uniform throughput, speed is both an advantage and an advantage.
In addition, because the GPU ecosystem is extremely developed, Nvidia’s GPUs are not only powerful, but also have excellent performance and have gathered a large number of users and a rich ecosystem. The surrounding situation.
In contrast, Groq can currently only provide services for a few large models. If it wants to establish a sustained advantage in the low-latency field, it needs to expand its service scope and further reduce overall costs.
p>
Review and editor: Liu Qing
Original title: Popular丨”Internet celebrity” chip Groq makes Nvidia evaporate 560 billion
Article source : [Microelectronics signal: World_2078, WeChat public account: AI Chip Worldwide] Welcome to add tracking and attention! Please indicate the source when transcribing and publishing the article.
The speed of the Groq chip that refreshes the screen is far higher than that of Nvidia GPU! The cost has been questioned. Electronic Enthusiast Network reports (Text/Li Wanwan) Has NVIDIA encountered a strong enemy? Recently, Groq chip computing speed exceeded NVIDIA Published on 02-22 09:06 •3356 views
Nvidia’s market value evaporated by nearly 200 billion U.S. dollars. Nvidia (Nvidia) suffered serious setbacks in U.S. stock trading on Thursday. Its stock price plummeted by more than 6%, and its market value instantly evaporated by nearly 200 billion U.S. dollars. The dramatic decline comes after the company’s latest earnings report failed to meet Wall Street’s sky-high Burundins Escort expectations, even though it completed spending in the previous quarter Published on 08-30 15:38 •319 views
AI chip giant NVIDIA rose by more than 4%. NVIDIA’s market value surged by 750 billion. Who is the most handsome kid in the US stock market? AI chip giant NVIDIA definitely has a place in the wave of artificial intelligence, especially when the global capital market is in turmoil. Industry analysisBurundiSugarMany teachers believe that Nvidia is the best “rebound stock” Published on 08-13 15:33 •950 views
Technology highlights: JPMorgan Chase explains in detail the “NVIDIA chip problem” Burundins Sugardaddy Musk 5BI Escorts6 billion salary plan sparks controversy, distributes to gurus, friends, the latest from some tech giantsBurundi Sugar Daddy News: JPMorgan Chase explains in detail the “NVIDIA chip problem” A research report by JPMorgan Chase revealed that “NVIDIA chip Published on 08-05 16:18 • 534 views
Nvidia may face serious technical selling. Nvidia’s market value of Burundi Sugar evaporated 1.4 trillion overnight. We all know Nvidia. The chip sales have caused Nvidia’s stock price to continue to soar and hit new highs, but there are still short positions. On July 30, local time, the U.S. semiconductor index fell sharply. Published on 07-31 16:11 • 732 views
NVIDIA’s market value plummeted in three days, and the chip market was shocked. In the recent fluctuations in the technology stock market, NVIDIA (NVDA) has become the center of much attention. The technology giant, which is well-known for graphics processing BI Escorts (GPU) technology, experienced a huge increase in market value in just three days. evaporated, with cumulative losses as high as 430 billion US dollars, creating the history of Published on 06-25 17:48 •717 views
Groq raised approximately US$300 million to Cerebras and other rivals are on par. This company, founded nearly eight years ago by Jonathan Ross, one of the inventors of Google’s exclusive chip tensor processing unit, is committed to developing products that can replace Nvidia chips. It is understood that including Groq and Cere Published on 05-23 15:49 •394 views
Further steps to interpret NVIDIA Blackwell architecture, NVlink and GB200 super chip On March 19, 2024, [NVIDIA] CEO [Jensen Huang] announced the new generation AI chip architecture BLACKWELL at the GTC conference, and released the super chip GB200 based on this architecture. Promoting data processing, engineering simulation, and electronic design automation Published on 05-13 17:16
NVIDIA’s market value evaporated by 611.6 billion yuan overnight NVIDIA employees walked away with $62 million Burundins Escort In this stock market storm, Nvidia’s stock price plummeted 3.87%, and its market value evaporated approximately US$84.5 billion overnight, equivalent to 611.6 billion yuan. Published on 04-18 14:52 •1975 views
NVIDIA’s market value evaporated by 611.6 billion yuan overnight Burundi Sugar Daddy 611.6 billion yuan disappeared overnight. On Wednesday, all three major U.S. stock indexes fell. Technology giant Yingwei Burundins Sugardaddy led the decline. Issued on 04-18 1Burundins Sugardaddy 4:41 •382 views
Nvidia should be vigilant! Can the explosive Groq chip make a comeback? AI inference speed “beats” Nvidia? With the rapid development of technology, artificial intelligence company Groq has challenged Nvidia’s king position. Its AI chips not only show outstanding strength, but also have huge potential. Groqdesign created a unique tweet Published on 03-08 09:44 •711 views
Nvidia was accused of delaying shipments and hindering competition. According to reports, if the invention As customers seek new business development opportunities, Nvidia may delay shipments of data center GPUs. Jonathan Ross, CEO of Groq, an artificial intelligence chip start-up, said that due to troubles Published on 02-29 0Burundins Escort9:53 •403 views
NVIDIA’s market value evaporated by US$31 billion. NVIDIA closed down about 2.7%. NVIDIA’s stock price fell 2.68% on December 4 to US$455.1, with a market value of US$11,000. billion dollars. This caused NVIDIA’s market value to evaporate by 310% overnight Published on 12-05 15:38 •1339 views
NVIDIA’s stock price plummeted and NVIDIA’s market value plummeted overnight 221.4 billion Nvidia stock price plummeted, Nvidia’s market value dropped sharply overnight 221.4 billion technology giant Nvidia Published on 12-05 09:16 •864 views
發佈留言