News / BUS Articles
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
April 17, 2024
In the rapidly evolving world of artificial intelligence, one name stands out as a pioneer and visionary: Jonathan Ross, founder and CEO of Groq. Ross, who previously invented the Tensor Processing Unit (TPU) at Google, has set his sights on revolutionizing computing power for the generative AI era with Groq’s novel chip architecture.
During a recent interview, Ross shared his insights on why he left the comfort of Google to start Groq, the unique advantages of Groq’s hardware, and his predictions for the future of computing in the age of AI.
The Founding of Groq
After spearheading groundbreaking projects like the TPU at Google, Ross realized the limitations of working within a large corporation. He found the decision-making process constraining and sought an environment where he could be “more ambitious” and “more bold.” This realization prompted him to take the entrepreneurial leap and found Groq.
The Groq Difference
At the core of Groq’s offering is a chip architecture designed for unparalleled inference speed, capable of processing an astonishing 5 to 7 hundred tokens per second. This blistering performance is made possible by a design that avoids the memory bottlenecks plaguing traditional GPUs, which Ross likens to “sipping through a martini straw.”
Groq’s approach is akin to an efficient assembly line, where the chip’s resources are utilized for short bursts, enabling remarkable throughput. While Groq’s chips have lower memory per chip, Ross argues that this design choice enables higher efficiency and better utilization of resources, much like a well-designed factory.
The Future of Computing: “Compute is the New Oil”
Ross wholeheartedly agrees with Sam Altman’s assertion that “compute is the currency of the future.” He believes that in the generative AI era, the real value lies not in merely retrieving and copying data but in creating something new in real-time – a process that requires immense computing power.
Echoing industry concerns about the energy demands of AI, Ross acknowledges that Groq’s chips use about one-tenth of the power compared to traditional solutions, making them a more sustainable choice for the ecosystem.
The Generative AI Revolution
Ross is optimistic about the societal impact of generative AI, believing it will foster curiosity, nuance, and subtlety in human discourse. He draws a parallel between the invention of the telescope, which initially threatened humanity’s perception of its place in the universe, and the emergence of large language models, which have revealed the vastness of intelligence.
Preserving Human Agency
While enthusiastic about the transformative potential of AI, Ross remains cognizant of the risks associated with ceding too much control to these systems. Groq’s mission, he states, is to “preserve human agency in the age of AI” by ensuring that humans retain decision-making power. To achieve this, Groq will curate the models it runs, favoring those that assist rather than replace human decision-making.
As the world stands on the precipice of a generative AI revolution, Groq, with Jonathan Ross at the helm, is poised to play a pivotal role in shaping the computing landscape. By pushing the boundaries of what’s possible with silicon and championing human agency, Groq offers a glimpse into a future where humans and AI coexist symbiotically, unlocking new realms of innovation and understanding.
Share this article:
More in BUS Articles:
Ultra Clean Holdings (UCTT) July 25, 2024, Earnings Call Summary
Future Price Projections Participants: Rhonda Bennetto – Senior Vice President, Investor Relations Jim Scholhamer – Chief Executive Officer Sheri Savage...
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
July 26, 2024
APPLE, MICROSOFT, NVIDIA PRICE TARGET 🎯
Short term, price targets for the top three S&P 500 holdings
Short term, price targets for the top three S&P 500 holdings The following are my price targets for the very...
![Trent Grinkmeyer in front of stock market with bull background](https://bestofusinvestors.com/uploads/2023/06/trent-e1687263019450-300x300.webp)
Trent Grinkmeyer
July 25, 2024
Nvidia's Stake in Serve Robotics: A Game-Changer for AI-Powered Delivery?
The tech world was buzzing last week when news broke that AI chip giant Nvidia owns a 10% stake in Serve Robotics, a company specializing in autonomous sidewalk delivery robots. This revelation sent Serve's stock soaring an impressive 233% over two days. But what does this mean for the future of AI-powered delivery, and should investors jump on board?
The tech world was buzzing last week when news broke that AI chip giant Nvidia owns a 10% stake in...
![Trent Grinkmeyer in front of stock market with bull background](https://bestofusinvestors.com/uploads/2023/06/trent-e1687263019450-300x300.webp)
Trent Grinkmeyer
July 24, 2024
The Commercial Real Estate Crash
Its Ripple Effect on the Banking System and The Stock Market
The commercial real estate market is on the verge of a significant downturn, potentially mirroring the infamous 2008 financial crisis....
The Future of Computing Power: Groq Founder Jonathan Ross on “Compute Being the New Oil”
July 23, 2024
The Democratization of Compute
A Paradigm Shift in Business and Investment Artificial Intelligence (AI) is undeniably transformative, poised to revolutionize the world as we...
![Kerry Grinkmeyer in a suit standing in front of a stock chart with a bull on it](https://bestofusinvestors.com/uploads/2023/07/kerry-300x300.webp)
Kerry Grinkmeyer
July 23, 2024
Are Google and Meta Heading for a Stock Price Slump?
As an investor, it's crucial to keep a keen eye on market trends and potential shifts that could impact major players. Today, I want to discuss two tech giants that have long been darlings of Wall Street: Google and Meta. While they've enjoyed impressive growth and dominance in their respective fields, there are signs that their stock prices might face some headwinds in the near future.
As an investor, it's crucial to keep a keen eye on market trends and potential shifts that could impact major...
![Trent Grinkmeyer in front of stock market with bull background](https://bestofusinvestors.com/uploads/2023/06/trent-e1687263019450-300x300.webp)
Trent Grinkmeyer
July 23, 2024