When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
(Image credit: NitroGen research page) Share Share by: Copy link Facebook X Whatsapp Reddit Flipboard Share this article Join the conversation Follow us Add us as a preferred source on Google A diverse group of researchers from Nvidia , Stanford, Caltech, and other institutions has introduced NitroGen. In a LinkedIn post on Friday, Jim Fan, Nvidia Director of AI & Distinguished Scientist, heralded NitroGen as “an open-source foundation model trained to play 1000+ games.” However, the implications are much wider, spilling from game worlds into the real world, with sizable benefits for simulations and robotics.
You could say, this research presents an attempt to distill a ‘GPT for actions.’ Thus, it is a kind of LLM breakthrough, applying this proven large-scale training tech beyond the fields of language and computer vision. Moreover, the pioneering building of “generally capable embodied agents that can operate in unknown environments has long been considered a holy grail of AI research,” asserts an introduction to the research paper.
Interestingly, NitroGen’s foundation is the GROOT N1.5 architecture, originally designed for robotics . And its application inside the world of gaming shows potential to circle back and bring great benefits to robots working in diverse or unpredictable environments, too.
Nvidia’s TiDAR experiment could speed up AI token generation using hybrid diffusion decoder
Two GTX 580s in SLI are responsible for the AI we have today — Nvidia's Huang revealed that the invention of deep learning began with two flagship Fermi GPUs in 2012
Nvidia and OpenAI forge $100 billion alliance to deliver 10 gigawatts of Nvidia hardware for AI datacenters
NitroGen was adapted to play games packed with wildly different mechanics and physics – that’s the nature, and fun, of video games. The researchers used 40,000+ hours of public gameplay videos shared by streamers. Videos in which gamers overlaid their real-time gamepad interactions on the stream were particularly helpful.
In tests, NitroGen was successful in games as diverse as “RPG, platformer, battle royale, racing, 2D, 3D, you name it!” enthuses Fan. While results are promising, the Nvidia scientist says that this is just the start, with a big hill left to climb.
This first version of NitroGen is intentionally focused on fast motor control, or ‘gamer instinct,’ as Fan calls it. According to the shared research, the new LLM also has a “strong competence across diverse domains,” and the model works in procedurally generated worlds as well as unseen games with a “52% relative improvement in task success rates over models trained from scratch.”
All the research into NitroGen so far has been open sourced, and those interested in gaming , robotics, and LLMs are encouraged to tinker. Tweaks to the pretrained model weights, the entire action dataset, and code are all open to your flights of fancy and fiddly digits.
Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/artificial-intelligence/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/artificial-intelligence/nvidia-led-nitrogen-is-a-generalist-video-gaming-ai-that-can-play-any-title-research-also-has-big-implications-for-robotics#main
- https://www.tomshardware.com
- Hands-on with the Thermal Grizzly Der8enchtable: Updating our longstanding motherboard test bench
- Savvy PC builder finds GeForce GTX 1660 Super for just $8.40 at thrift store — Goodwill purchase comes with 6GB of VRAM for 1080p gaming, still sells for up to
- Nintendo Switch 2 to reportedly get smaller capacity game cartridges soon, offering an alternative to costly 64GB cards — Storage crisis might delay production,
- HP Omen 34c G2 34-inch WQHD 180 Hz gaming monitor review: Delivering style, speed and value
- AMD's legacy Ryzen 7 5800X3D chips now sell for up to $800, more than a new 9800X3D — AM4 chip costs twice as much as MSRP, as enthusiasts flock to old DDR4 mem
Informational only. No financial advice. Do your own research.