News / BUS Articles
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
April 17, 2024
In the rapidly evolving world of artificial intelligence, one name stands out as a pioneer and visionary: Jonathan Ross, founder and CEO of Groq. Ross, who previously invented the Tensor Processing Unit (TPU) at Google, has set his sights on revolutionizing computing power for the generative AI era with Groq’s novel chip architecture.
During a recent interview, Ross shared his insights on why he left the comfort of Google to start Groq, the unique advantages of Groq’s hardware, and his predictions for the future of computing in the age of AI.
The Founding of Groq
After spearheading groundbreaking projects like the TPU at Google, Ross realized the limitations of working within a large corporation. He found the decision-making process constraining and sought an environment where he could be “more ambitious” and “more bold.” This realization prompted him to take the entrepreneurial leap and found Groq.
The Groq Difference
At the core of Groq’s offering is a chip architecture designed for unparalleled inference speed, capable of processing an astonishing 5 to 7 hundred tokens per second. This blistering performance is made possible by a design that avoids the memory bottlenecks plaguing traditional GPUs, which Ross likens to “sipping through a martini straw.”
Groq’s approach is akin to an efficient assembly line, where the chip’s resources are utilized for short bursts, enabling remarkable throughput. While Groq’s chips have lower memory per chip, Ross argues that this design choice enables higher efficiency and better utilization of resources, much like a well-designed factory.
The Future of Computing: “Compute is the New Oil”
Ross wholeheartedly agrees with Sam Altman’s assertion that “compute is the currency of the future.” He believes that in the generative AI era, the real value lies not in merely retrieving and copying data but in creating something new in real-time – a process that requires immense computing power.
Echoing industry concerns about the energy demands of AI, Ross acknowledges that Groq’s chips use about one-tenth of the power compared to traditional solutions, making them a more sustainable choice for the ecosystem.
The Generative AI Revolution
Ross is optimistic about the societal impact of generative AI, believing it will foster curiosity, nuance, and subtlety in human discourse. He draws a parallel between the invention of the telescope, which initially threatened humanity’s perception of its place in the universe, and the emergence of large language models, which have revealed the vastness of intelligence.
Preserving Human Agency
While enthusiastic about the transformative potential of AI, Ross remains cognizant of the risks associated with ceding too much control to these systems. Groq’s mission, he states, is to “preserve human agency in the age of AI” by ensuring that humans retain decision-making power. To achieve this, Groq will curate the models it runs, favoring those that assist rather than replace human decision-making.
As the world stands on the precipice of a generative AI revolution, Groq, with Jonathan Ross at the helm, is poised to play a pivotal role in shaping the computing landscape. By pushing the boundaries of what’s possible with silicon and championing human agency, Groq offers a glimpse into a future where humans and AI coexist symbiotically, unlocking new realms of innovation and understanding.
Share this article:
More in BUS Articles:
Job Growth Slows but Remains Solid in April
The U.S. labor market remained resilient in April, though job growth decelerated slightly amid cooling wage pressures, according to the...
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
May 1, 2024
The Rise of Technical Analysis in Modern Stock Trading
In today’s fast-paced and technology-driven stock market, technical analysis has emerged as the predominant approach used by traders to make...
Trent Grinkmeyer
April 20, 2024
Is MicroStrategy's Massive Bitcoin Bet Genius or Gambling?
In the high-stakes world of investing, there’s always been a fine line between boldness and recklessness. MicroStrategy’s CEO Michael Saylor...
Trent Grinkmeyer
April 16, 2024
Best of US Investors brings Wall Street Technology to Main Street
For decades, massive Wall Street firms like Goldman Sachs have enjoyed a decisive advantage over individual investors. With thousands of...
Trent Grinkmeyer
April 16, 2024
Will the Fed Raise or Lower Rates?
CPI Report Expected to Show Little Progress on Inflation
April 10, 2024 Inflation is real and hitting American households hard. From the grocery store to the gas pump to...
Trent Grinkmeyer
April 10, 2024
Bitcoin Whale Emerges!
A Bitcoin whale moved 2,000 BTC that had been dormant since 2010, but this action had no noticeable effect on Bitcoin's price. Typically, such large movements can cause market apprehension, yet this time it was completely ignored, suggesting Bitcoin's price is currently independent of such news.
A Bitcoin whale moved 2,000 BTC that had been dormant since 2010, but this action had no noticeable effect on...
Trent Grinkmeyer
March 28, 2024