‘107,000 GPUs on the waitlist’ — Io.net beta launch attracts data centers, GPU clusters
Over 100,000 graphics processing units (GPUs) from data centers and private clusters are set to plug into a new decentralized physical infrastructure network (DePIN) beta launched by io.net.
As Cointelegraph previously reported, the startup has developed a decentralized network that sources GPU computing power from geographically diverse data centers, cryptocurrency miners and decentralized storage providers to power machine learning and artificial intelligence (AI) computing.
The company announced the launch of its beta platform during the Solana Breakpoint conference in Amsterdam, which coincided with a newly formed partnership with Render Network.
Tory Green, chief operating officer of io.net, and Angela Yi, head of business development, spoke exclusively to Cointelegraph after Green’s keynote speech at the conference. The pair outlined the critical differentiators between io.net’s DePIN and the broader cloud and GPU computing market.
Related: Google Cloud broadens Web3 startup program with 11 blockchain firms
Green identifies cloud providers like Amazon Web Services (AWS) and Microsoft Azure as entities that own their supplies of GPUs and rent them out. Meanwhile, peer-to-peer GPU aggregators were created to solve GPU shortages but “quickly ran into the same problems,” the exec explained.
Proud to present @ionet_official at @Solana #Breakpoint2023 yesterday!
— io.net (@ionet_official) November 4, 2023
Whether you're a GPU provider or an ML engineer - tune in for the live demonstration of the platform and join https://t.co/WLXlHkv6f1 now.
Watch the full video pic.twitter.com/E1XsgJLJNu
The wider Web2 industry continues to look to tap into GPU computing from underutilized sources. Still, Green contends that none of these existing infrastructure providers cluster GPUs in the same way that io.net founder Ahmad Shadid has pioneered.
“The problem is that they don’t really cluster. They’re primarily single instance, and while they do have a cluster option on their websites, it’s likely that a salesperson is going to call up all of their different data centers to see what’s available,” Green adds.
Meanwhile, Web3 firms like Render, Filecoin and Storj have decentralized services not focused on machine learning. This is part of io.net’s potential benefit to the Web3 space as a primer for these services to tap into.
Green points to AI-focused solutions like Akash Network, which clusters an average of eight to 32 GPUs, as well as Gensyn, as the closest service providers in terms of functionality. Gensyn is building its own machine learning compute protocol to provide a peer-to-peer “supercluster” of computing resources.
With an overview of the industry established, Green believes io.net’s solution is novel in its ability to cluster over different geographic locations in minutes. This statement was tested by Yi, who created a cluster of GPUs from other networks and locations during a live demo on stage at the Solana Breakpoint conference.
As for its use of the Solana blockchain to facilitate payments to GPU computing providers, Green and Yi claim that the sheer scale of transactions and inferences that io.net will facilitate would not be processable by any other network.
“If you’re a generative art platform and you have a user base that’s giving you prompts, every single time those inferences are made, micro-transactions behind it,” Yi explains.
“So now you can imagine just the sheer size and the scale of transactions that are being made there. And so that’s why we felt like Solana would be the best partner for us.”
The partnership with Render, an established DePIN network of distributed GPU suppliers, provides computing resources already deployed on its platform to io.net. Render’s network is primarily aimed at sourcing GPU rendering computing at lower costs and faster speeds than centralized cloud solutions.
Yi described the partnership as a win-win situation, with the company looking to tap into io.net’s clustering capabilities to use the GPU compute it has access to but cannot put to use for rendering applications.
Io.net will carry out a $700,000 incentive program for GPU resource providers, while Render nodes can expand their existing GPU capacity from graphical rendering to AI and machine learning applications. The program is aimed at users with consumer-grade GPUs, categorized as hardware from Nvidia RTX 4090s and under.
As for the broader market, Yi highlights that many data centers worldwide are sitting on significant percentages of underused GPU capacity. A number of these locations have “tens of thousands of top-end GPUs” that are idle:
“They’re only utilizing 12% to 18% of their GPU capacity, and they didn’t really have a way to leverage their idle capacity. It’s a very inefficient market.”
Io.net’s infrastructure will primarily cater to machine learning engineers and businesses that can tap into a highly modular user interface that allows users to select how many GPUs they need, the location, security parameters and other metrics.
Magazine: Beyond crypto: Zero-knowledge proofs show potential from voting to finance
