#OpenAI’s API Now Available with No Waitlist | Explore Tumblr posts and blogs

tastydregs · 2 years ago

Text

Anthropic’s Claude AI can now digest an entire book like The Great Gatsby in seconds

Enlarge / An AI-generated image of a robot reading a book.

Benj Edwards / Stable Diffusion

On Thursday, AI company Anthropic announced it has given its ChatGPT-like Claude AI language model the ability to analyze an entire book's worth of material in under a minute. This new ability comes from expanding Claude's context window to 100,000 tokens, or about 75,000 words.

Like OpenAI's GPT-4, Claude is a large language model (LLM) that works by predicting the next token in a sequence when given a certain input. Tokens are fragments of words used to simplify AI data processing, and a "context window" is similar to short-term memory—how much human-provided input data an LLM can process at once.

A larger context window means an LLM can consider larger works like books or participate in very long interactive conversations that span "hours or even days," according to Anthropic:

The average person can read 100,000 tokens of text in ~5+ hours, and then they might need substantially longer to digest, remember, and analyze that information. Claude can now do this in less than a minute. For example, we loaded the entire text of The Great Gatsby into Claude-Instant (72K tokens) and modified one line to say Mr. Carraway was “a software engineer that works on machine learning tooling at Anthropic.” When we asked the model to spot what was different, it responded with the correct answer in 22 seconds.

While it may not sound impressive to pick out changes in a text (Microsoft Word can do that), consider that after feeding Claude the text of The Great Gatsby, the AI model can then interactively answer questions about it or analyze its meaning. 100,000 tokens is a big upgrade for LLMs. In comparison, OpenAI's GPT-4 LLM boasts context window lengths of 4,096 tokens (about 3,000 words) when used as part of ChatGPT and 8,192 or 32,768 tokens via the GPT-4 API (which is currently only available via waitlist).

To understand how a larger context window leads to a longer conversation with a chatbot like ChatGPT or Claude, we made a diagram for an earlier article that shows how the size of the prompt (which is held in the context window) enlarges to contain the entire text of the conversation. That means a longer context window can last longer before the chatbot loses its "memory" of the conversation.

Enlarge / A diagram showing how conversational language model prompting works.

Benj Edwards / Ars Technica

According to Anthropic, Claude's enhanced capabilities extend past processing books. The enlarged context window could potentially help businesses extract important information from multiple documents through a conversational interaction. The company suggests that this approach may outperform vector search-based methods when dealing with complicated queries.

A demo of using Claude as a business analyst, provided by Anthropic.

While not as big of a name in AI as Microsoft and Google, Anthropic has emerged as a notable rival to OpenAI in terms of competitive offerings in LLMs and API access. Former OpenAI VP of Research Dario Amodei and his sister Daniela founded Anthropic in 2021 after a disagreement over OpenAI's commercial direction. Notably, Anthropic received a $300 million investment from Google in late 2022, with Google acquiring a 10 percent stake in the firm.

Anthropic says that 100K context windows are available now for users of the Claude API, which is currently restricted by a waitlist.

0 notes

anewswire · 2 years ago

Text

What is ChatGPT-4: Everything you need to know

It's been a mere four months since artificial intelligence company OpenAI released ChatGPT and — not to overstate its relevance — transformed the world forever. It has altered schooling systems, provoked doomsday predictions in global employment markets, and attracted millions of users, including huge banks and app developers, in only 15 short weeks. But, ChatGPT is already being replaced by ChatGPT-4, an even more potent weapon that will undoubtedly have much greater reverberations around the globe. How potent is GPT-4, what does it do, and how can you utilize it? Here is all the information you require: Describe ChatGPT-4. Begin with the name. GPT-4 stands for "generative pre trained transformer 4," and the Chat part is self-explanatory since it is an interactive computer interface. This indicates that the OpenAI program is currently in its fourth iteration and has gone through extensive data analysis to learn how to produce writing that sounds human and provides users with in-depth answers to questions. How is ChatGPT-4 different from its forerunner? Everybody who has looked into ChatGPT is aware of its shortcomings. It has drawn criticism for providing incorrect information, displaying bias, and acting improperly by getting beyond its own built-in limitations and providing responses that are not permitted. The claim has been made that the quality of the bot depends entirely on the data it was trained on. OpenAI claims that during the last six months, it has worked to make the new program safer. It asserts that ChatGPT-4 is "40% more likely" to deliver factual responses than ChatGPT-3.5 and is more accurate, creative, and collaborative. What else can it perform? One of ChatGPT-4's most impressive new features is its capacity to handle both words and images, or "multimodal" technology. Users will be able to upload both text and a picture, which ChatGPT-4 will be able to process and discuss. Eventually, video input will also be possible. Which restrictions apply to it? Due to the fact that ChatGPT-4 was trained on data from before 2021, it performs similarly to its predecessor when it comes to reasoning about current events. The most recent prototype "still has numerous recognized limitations that we are aiming to solve, such as social biases, hallucinations, and adversarial prompts," according to a blog post by OpenAI. How does ChatGPT-4 work? Most people can give basic ChatGPT a spin by signing up with OpenAI here, however, restrictions apply in various regions and territories throughout the world. Nevertheless, the most recent version is only now being made available as an API tool for developers to include in their applications and to ChatGPT Plus members for $20 per month (sign up here). Joining the waitlist is possible here. You'll probably find it on Bing, Microsoft's search engine, in the future. Right now, if you visit the Bing website and click the "chat" icon at the top, you'll probably be taken to a page that asks you to join a waitlist; access is being given out to users gradually. Who is currently utilizing ChatGPT-4? It is being tested to see if it can assist prevent fraud by payment processor Stripe Inc., used by Morgan Stanley to organize wealth management data, and integrated into language-learning tool Duolingo to help users understand their mistakes and practice speaking in public. What follows? In a nutshell, rivals. Several technology companies are vying for a piece of the action even though Microsoft Corp. has promised to invest $10 billion in OpenAI. A number of firms are vying for the AI train, but Alphabet Inc.'s Google has already made its own AI service, called Bard, available to testers. In China, Meituan, Alibaba, and a number of other lesser-known companies are also entering the race. Baidu Inc. is also getting ready to introduce its own bot, Ernie. Read the full article

0 notes