<meta charset="utf-8" /><meta http-equiv="content-security-policy" content=""><meta name="hf:doc:metadata" content="{&quot;local&quot;:&quot;accelerated-inference-api&quot;,&quot;title&quot;:&quot;🤗 Accelerated Inference API&quot;}" data-svelte="svelte-1phssyn">
	<link rel="stylesheet" href="/docs/api-inference/pr_799/en/_app/assets/pages/__layout.svelte-ab71f83a.css">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/start-b0a07886.js">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/chunks/vendor-7c454903.js">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/chunks/paths-4b3c6e7e.js">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/pages/__layout.svelte-6835d907.js">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/pages/index.mdx-11ad83bf.js">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/chunks/Tip-735285fc.js">
	<link rel="modulepreload" href="/docs/api-inference/pr_799/en/_app/chunks/IconCopyLink-5457534b.js"> 






<h1 class="relative group"><a id="accelerated-inference-api" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#accelerated-inference-api"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>🤗 Accelerated Inference API
	</span></h1>

<p>Integrate into your apps over 20,000 pre-trained state of the art
models, or your own private models, via simple HTTP requests, with 2x to
10x faster inference than out of the box deployment, and scalability
built-in.</p>
<h2 class="relative group"><a id="hugging-face-is-trusted-in-production-by-over-5,000-companies" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#hugging-face-is-trusted-in-production-by-over-5,000-companies"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>Hugging Face is trusted in production by over 5,000 companies
	</span></h2>

<img class="block dark:hidden !shadow-none !border-0 !rounded-none" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-api/companies-light.png" width="600">
<img class="hidden dark:block invert !shadow-none !border-0 !rounded-none" src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/inference-api/companies-light.png" width="600">
<h2 class="relative group"><a id="main-features:" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#main-features:"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>Main features:
	</span></h2>

<ul><li>Leverage <strong>20,000+ Transformer models</strong> (T5, Blenderbot, Bart, GPT-2, Pegasus...)</li>
<li>Upload, manage and serve your <strong>own models privately</strong></li>
<li>Run Classification, NER, Conversational, Summarization, Translation, Question-Answering, Embeddings Extraction tasks</li>
<li>Get up to <strong>10x inference speedup</strong> to reduce user latency</li>
<li>Accelerated inference on <strong>CPU</strong> and <strong>GPU</strong> (GPU requires a <a href="https://huggingface.co/pricing" rel="nofollow">Startup or Enterprise plan</a>)</li>
<li>Run <strong>large models</strong> that are challenging to deploy in production</li>
<li>Scale to 1,000 requests per second with <strong>automatic scaling</strong> built-in</li>
<li><strong>Ship new NLP features faster</strong> as new models become available</li>
<li>Build your business on a platform powered by the reference open source project in NLP</li></ul>
<h2 class="relative group"><a id="if-you-are-looking-for-custom-support-from-the-hugging-face-team" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#if-you-are-looking-for-custom-support-from-the-hugging-face-team"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>If you are looking for custom support from the Hugging Face team
	</span></h2>

<a target="_blank" href="https://huggingface.co/support"><img alt="HuggingFace Expert Acceleration Program" src="https://huggingface.co/front/thumbnails/support.png" style="max-width: 400px; border: 1px solid #eee; border-radius: 4px; box-shadow: 0 1px 2px 0 rgba(0, 0, 0, 0.05);"></a>
<h2 class="relative group"><a id="third-party-library-models:" class="header-link block pr-1.5 text-lg no-hover:hidden with-hover:absolute with-hover:p-1.5 with-hover:opacity-0 with-hover:group-hover:opacity-100 with-hover:right-full" href="#third-party-library-models:"><span><svg class="" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" aria-hidden="true" role="img" width="1em" height="1em" preserveAspectRatio="xMidYMid meet" viewBox="0 0 256 256"><path d="M167.594 88.393a8.001 8.001 0 0 1 0 11.314l-67.882 67.882a8 8 0 1 1-11.314-11.315l67.882-67.881a8.003 8.003 0 0 1 11.314 0zm-28.287 84.86l-28.284 28.284a40 40 0 0 1-56.567-56.567l28.284-28.284a8 8 0 0 0-11.315-11.315l-28.284 28.284a56 56 0 0 0 79.196 79.197l28.285-28.285a8 8 0 1 0-11.315-11.314zM212.852 43.14a56.002 56.002 0 0 0-79.196 0l-28.284 28.284a8 8 0 1 0 11.314 11.314l28.284-28.284a40 40 0 0 1 56.568 56.567l-28.285 28.285a8 8 0 0 0 11.315 11.314l28.284-28.284a56.065 56.065 0 0 0 0-79.196z" fill="currentColor"></path></svg></span></a>
	<span>Third-party library models:
	</span></h2>

<ul><li><p>The <a href="https://huggingface.co" rel="nofollow">Hub</a> now supports many new libraries:</p>
<ul><li><a href="https://spacy.io/" rel="nofollow">SpaCy</a>, <a href="https://allennlp.org/" rel="nofollow">AllenNLP</a>,</li>
<li><a href="https://speechbrain.github.io/" rel="nofollow">Speechbrain</a>,</li>
<li><a href="https://pypi.org/project/timm/" rel="nofollow">Timm</a> and <a href="https://huggingface.co/docs/hub/libraries" rel="nofollow">many others</a>…</li></ul></li>
<li><p>Those models are enabled on the API thanks to some docker integration <a href="https://github.com/huggingface/huggingface_hub/tree/main/api-inference-community" rel="nofollow">api-inference-community</a>.</p></li></ul>


<div class="course-tip course-tip-orange bg-gradient-to-br dark:bg-gradient-to-r before:border-orange-500 dark:before:border-orange-800 from-orange-50 dark:from-gray-900 to-white dark:to-gray-950 border border-orange-50 text-orange-700 dark:text-gray-400"><p>Please note however, that these models will not allow you (<a href="https://github.com/huggingface/huggingface_hub/issues/85" rel="nofollow">tracking issue</a>):</p>
<ul><li>To get full optimization</li>
<li>To run private models</li>
<li>To get access to GPU inference</li></ul></div>


		<script type="module" data-hydrate="h0ax80">
		import { start } from "/docs/api-inference/pr_799/en/_app/start-b0a07886.js";
		start({
			target: document.querySelector('[data-hydrate="h0ax80"]').parentNode,
			paths: {"base":"/docs/api-inference/pr_799/en","assets":"/docs/api-inference/pr_799/en"},
			session: {},
			route: false,
			spa: false,
			trailing_slash: "never",
			hydrate: {
				status: 200,
				error: null,
				nodes: [
					import("/docs/api-inference/pr_799/en/_app/pages/__layout.svelte-6835d907.js"),
						import("/docs/api-inference/pr_799/en/_app/pages/index.mdx-11ad83bf.js")
				],
				params: {}
			}
		});
	</script>
