Customizing GPT-3 for your application

OpenAI News
Customizing GPT-3 for your application

Developers can now fine-tune GPT‑3 on their own data, creating a custom version tailored to their application. Customizing makes GPT‑3 reliable for a wider variety of use cases and makes running the model cheaper and faster.

You can use an existing dataset of virtually any shape and size, or incrementally add data based on user feedback. With fine-tuning, one API customer was able to increase correct outputs from 83% to 95%. By adding new data from their product each week, another reduced error rates by 50%.

To get started, just run a single command in the OpenAI command line tool with a file you provide. Your custom version will start training and then be available immediately in our API.

* Read documentation

Last year wetrained GPT‑3⁠(opens in a new window)and made it available inour API⁠. With only a few examples, GPT‑3 can perform a wide variety ofnatural language tasks⁠(opens in a new window), a concept called few-shot learning or prompt design. Customizing GPT‑3 can yield even better results because you can provide many more examples than what’s possible with prompt design.

It takes less than 100 examples to start seeing the benefits of fine-tuning GPT‑3 and performance continues to improve as you add more data. Inresearch published last June⁠, we showed how fine-tuning with less than 100 examples can improve GPT‑3’s performance on certain tasks. We’ve also found that each doubling of the number of examples tends to improve quality linearly.

With one of our most challenging research datasets,grade school math problems⁠, fine-tuning GPT‑3 improves accuracy by 2 to 4x over what’s possible with prompt design.

Customizing GPT‑3 improves the reliability of output, offering more consistent results that you can count on for production use-cases. One customer found that customizing GPT‑3 reduced the frequency of unreliable outputs from 17% to 5%. Since custom versions of GPT‑3 are tailored to your application, the prompt can be much shorter, reducing costs and improving latency.

Whether text generation, summarization, classification, or any other natural language task GPT‑3 is capable of performing, customizing GPT‑3 will improve performance.

## Apps powered by customized versions of GPT-3

Keeper Taxhelps independent contractors and freelancers with their taxes. After a customer links their financial accounts, Keeper Tax uses various models to extract text and classify transactions. Using the classified data, Keeper Tax identifies easy-to-miss tax write-offs and helps customers file their taxes directly from the app. By customizing GPT‑3, Keeper Tax is able to continuously improve results. Once a week, Keeper Tax adds around 500 new training examples to fine-tune their model, which is leading to about a 1% accuracy improvement each week, increasing accuracy from 85% to 93%.

Viablehelps companies get insights from their customer feedback. By customizing GPT‑3, Viable is able to transform massive amounts of unstructured data into readable natural language reports, highlighting top customer complaints, compliments, requests, and questions. Customizing GPT‑3 has increased the reliability of Viable’s reports. By using a customized version of GPT‑3, accuracy in summarizing customer feedback has improved from 66% to 90%. The result is tangible, intuitive information that customers need to inform their product decisions.

Sana Labsis a global leader in the development and application of AI to learning. The Sana learning platform powers personalized learning experiences for businesses by leveraging the latest ML breakthroughs to tailor the content for each individual. By customizing GPT‑3 with their data, Sana’s question and content generation went from grammatically correct but general responses to highly accurate outputs. This yielded a 60% improvement, enabling fundamentally more personalized and effective experiences for their learners.

Elicitis an AI research assistant that helps people directly answer research questions using findings from academic papers. The tool finds the most relevant abstracts from a large corpus of research papers, then applies a customized version of GPT‑3 to generate the claim (if any) that the paper makes about the question. A custom version of GPT‑3 outperformed prompt design across three important measures: results were easier to understand (a 24% improvement), more accurate (a 17% improvement), and better overall (a 33%improvement).

All API customers can customize GPT‑3 today. Sign-up and get started with thefine-tuning documentation⁠(opens in a new window).

Rachel Lim, Michael Wu, Luke Miller

View all product articles

Navigating the challenges and opportunities of synthetic voices Product Mar 29, 2024

New embedding models and API updates Product Jan 25, 2024

Introducing the GPT Store Product Jan 10, 2024

Our Research * Research Index * Research Overview * Research Residency * OpenAI for Science * Economic Research

Latest Advancements * GPT-5.3 Instant * GPT-5.3-Codex * GPT-5 * Codex

Safety * Safety Approach * Security & Privacy * Trust & Transparency

ChatGPT * Explore ChatGPT(opens in a new window) * Business * Enterprise * Education * Pricing(opens in a new window) * Download(opens in a new window)

Sora * Sora Overview * Features * Pricing * Sora log in(opens in a new window)

API Platform * Platform Overview * Pricing * API log in(opens in a new window) * Documentation(opens in a new window) * Developer Forum(opens in a new window)

For Business * Business Overview * Solutions * Contact Sales

Company * About Us * Our Charter * Foundation * Careers * Brand

Support * Help Center(opens in a new window)

More * News * Stories * Livestreams * Podcast * RSS

Terms & Policies * Terms of Use * Privacy Policy * Other Policies

(opens in a new window)(opens in a new window)(opens in a new window)(opens in a new window)(opens in a new window)(opens in a new window)(opens in a new window)

OpenAI © 2015–2026 Manage Cookies

English United States

Originally published on OpenAI News.