#realscale

[jcmarchi]

You Need to Know About Groq

New Post has been published on https://thedigitalinsider.com/you-need-to-know-about-groq/

You Need to Know About Groq

A $640 million funding round to accelerate its fast inference chips.

Created Using DALL-E

Next Week in The Sequence:

Edge 421: We start a new ( and short) series about state space models which are considered the main viable alternative to transformers. This issue includes a reviews of the famous “Transformers are SSMs” paper and the DeepChecks framework for testing, evaluating monitoring SSMs.

Edge 422: We dive into the fascinating NuminaMath model that just won first prize in the AI Math Olympiad.

You can subscribe to The Sequence below:

TheSequence is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.

📝 Editorial: Groq’s Massive Milestone

Making inference fast is one of the north stars for the next generation of AI infrastructure providers. The default assumption is that the AI inference market will be dominated by NVIDIA, and while that might turn out to be correct, there is innovation happening across all levels of the AI infrastructure stack. One of the most intriguing newcomers in this space is Groq, a startup that has emerged to become synonymous with fast AI inference.

Groq is the maker of the Language Processing Unit (LPU), a chip optimized for fast AI inference. The Groq LPU is a single-core processor designed for LLMs, interconnected with a fast switchless routing fabric using 288 QSFP28 optical cables. A rack is built from 9 GroqNode 1 servers (with 1 server acting as a redundant resource), featuring a fully connected internal RealScale network delivering accelerated compute performance of up to 48 PetaOPs (INT8) or 12 PFLOPs (FP16). Groq Cloud is an LPU-based cloud offering that already includes many of the top generative AI models and counts over 350,000 developers. Groq is fast. In Groq Cloud, models can perform at over 500 tokens per second, with a 10x comparable improvement over GPT-4.

The rise of Groq might seem sudden given the frantic pace of the AI market. However, the startup has been working on LPUs since 2016. Their perseverance has been rewarded. Last week, Groq announced a $640 million funding round led by Blackrock, along with Neuberger Berman, Type One Ventures, Cisco, KDDI, and Samsung Catalyst Fund.

AI hardware is a tough market, but Groq now has the resources to innovate and compete. AI inference is still NVIDIA’s world, but Groq is a fascinating new player in it.

🔎 ML Research

Robots for Table Tennis

Google DeepMind published a paper introducing the techniques building the first robot agent to achieved human competitive level in table tennis. The paper details different techniques such as hierarchical policy learning, sim-to-real and many others that are combined in a very clever way —> Read more.

CodexGraph

Aliaba Research published a paper introducing CodexGraph, a system that integrates LLMs with a graph database based on code repositories. The graph model allows LLMs to navigate more sophisticated code structures adn tackle more complex tasks —> Read more.

GENEVA

Microsoft Research published a paper introducing GENEVA, a tool that can generate rich narrative graphs based on a high level description and a set of constraints. GENEVA, explores different narractive paths through a visual, graph interface —> Read more.

RAG Foundry

Researchers from Intel published a paper detailing RAG Foundry, a framework for streamlining RAG use cases. RAG Foundry enables capabilities such as data creation, inference, evaluation in a single workflow —> Read more.

LLM Scaling Without Increasing Parameters

Google DeepMind published a paper discussing the importance of scaling test time computation in order to scale LLMs. The paper explores increasing test-time computation by searching against dense, process-based verifier reward models and updating the model distribution based on prompts at test time —> Read more.

Self-Taught Evaluators

Meta AI published a paper proposing an LLM-as-a-judge technique to improve evaluators withouht using human synthetic data. The method trains an LLM to produce reasoning traces and final judgments and repeats that process to obtain improved prediction —> Read more.

🤖 AI Tech Releases

OpenAI API Structured Outputs

OpenAI unveiled a new feature that enables structured JSON outputs as part of its API —> Read more.

🛠 Real World AI

Prompt Poet

Character.ai open sourced Prompt Poet, their framework for prompt design —> Read more.

Smart Notifications at Pinterest

Pinterest discusses the machine learning techniques used in their notification systems —> Read more.

📡AI Radar

Groq raised $640 million for its fast AI inference platform.

Important departures at OpenAI.

OpenAI added a CMU professor to their board of directors.

TMSC announced an astonishig sales growth of 45% based on AI chip demand.

HuggingFace acquired XetHub to boost its ML infrastructure.

Google DeepMind developed a robot table tennis player.

Autonomous agent platform Bardeen.ai raised $15.3 million in a new round.

Perceptive Space raised $2.8 million to improve space weather predictions.

Microsoft and Palantir announced a new strategic alliance to deliver AI capabilities to the intelligence community.

Box acquired AlphaMoon to improve its document intelligence capabilities.

Autonomous vehicle startup WeRide is getting ready for an IPO.

SoundHound acquired Amelia AI to boost its conversational capabilities.

Placer.ai raised at a $1.5 billion valuation for its AI-based, location-specific market research platform.

TheSequence is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.

[wehire4u]

Hypergen: Cold-Email Marketing Manager

Headquarters: Sofia, Bulgaria URL: http://hypergen.io We are looking to add a Campaign Manager to our team! Starting monthly salary of $2000+ revenue share opportunities after 3 months. ✨Who are we: A B2B SaaS Marketing agency working with top US, UK, and EU startup clients. Some of our clients include Lytics, Prezzee, Daring and RealScale. We are an ROI-driven agency with one of the best Cold…

[dskstudio]

20hr work - 8hr just watching : [ Fully animatable Model 85% Done . . . #3d #3dmodeling #construction #real #realscale #blender #blender3d #3dmodel #plan #bulding #buldingdesign #design #designer #3ddesign #3ddesigner #work #working #2022 https://www.instagram.com/p/CgsJThTJkW1/?igshid=NGJjMDIxMWI=

[rc-hub]

No one makes it easier to get your scale on than RC4WD! Totally digging the new Gelande II D110 now fully ready to rock in Dark Blue! #rc4wd #gelande2 #d110 #gelande #crawling #rccrawler #offroad #terrain #gorgeous #realscale #scalerc #rcscale #blue #darkblue #4door #rc #rctruck #rc4x4 #rchub @rchub @rc4wd

[alvinoni]

Finalmente el plano de la puerta desplegado en escala real. Finally the gstes plan desployed in real scale #arte #art #desing #diseño #vector #vectorial #vectordesing #wacom #lightning #relampago #plan #plano #realscale #escalareal #forja #ironwork #portalon #gates #alvinoni #alvinoni77 #alvinoninstagram https://www.instagram.com/p/Bu4dk5zFNYJ/?utm_source=ig_tumblr_share&igshid=wdrbu6b3kc5q

[homewithanome]

Updated with granny and tv peep -

Also as for the number scale - assume thats an estimate. I’ve just checked the models in realscale and Six is actually meant to be 2 feet tall. So I have no idea where this canon height of 12 inches has come from :/ So either the LN team’s height is a bit off, or everyone is a LOT shorter than expected XDDD

[personalshopperwebuyjapan]

Gundam statue from Odaiba Tokyo #gundam #gundamstatue #gundamstatueodaiba #gundamtokyo #odaiba #tokyo #diversitytokyo #gundammodel #realscale #statue #anime #japan

[devotiontocreation-blog]

View this post on Instagram

A post shared by Tommy Brando (@devotiontocreation)

#musicscales #musicscale #realscale #musically #music #musica #musiclover #musician #musiclove #everydayivegottheblues #musicforlife #musicismylife #musicforthesoul

[cecarvalho-blog]

First time Using GravitySketch VR. It combines tape drawing, sketching and CAD in the same tool. The capability to see the design in realscale is incredible. Congrats team from gravitysketch. (can´t wait to see the next version)

[instapicsil1]

#Repost @zoeryanprojects—chair and curator of Architecture and Design: ・・・ Testing Herbert Bayer's 1930s field of vision diagram at full scale. Part of the ingenious new installation @artinstitutechi by @projectprojects that celebrates our publication - As Seen: Exhibitions that Made Architecture and Design History. More on the book soon. #herbertbayer #fieldofvision #realscale #installations #comeseetheshow @adamjmichaels @_publicaddress #comingsoon2017 http://ift.tt/2fgAWU2

[instatrack]

#Repost @zoeryanprojects—chair and curator of Architecture and Design: ・・・ Testing Herbert Bayer's 1930s field of vision diagram at full scale. Part of the ingenious new installation @artinstitutechi by @projectprojects that celebrates our publication - As Seen: Exhibitions that Made Architecture and Design History. More on the book soon. #herbertbayer #fieldofvision #realscale #installations #comeseetheshow @adamjmichaels @_publicaddress #comingsoon2017 http://ift.tt/2fgAWU2

[rc-hub]

Where is my hard hat??? 🚧... Those are two TF2s sitting in the bed with room to spare! It weighs over 200lbs and the bed can lift over 400lbs!!! RCHUB.com for all the details...#rc4wd #miningtruck #earthmover #huge #dump #dumptruck #bigboystoys #hugetinytruck #hydrolics #realscale #scale #awesome #notatoy #tinytrucks #rc #rctruck #scalerc #rcscale #rcporn #rcdumptruck @rchub @rc4wd