HuggingFaceInference

Here's an example of calling a HugggingFaceInference model as an LLM:

npm

npm install @huggingface/inference@2

Yarn

yarn add @huggingface/inference@2

pnpm

pnpm add @huggingface/inference@2

import { HuggingFaceInference } from "langchain/llms/hf";

const model = new HuggingFaceInference({
  model: "gpt2",
  apiKey: "YOUR-API-KEY", // In Node.js defaults to process.env.HUGGINGFACEHUB_API_KEY
});
const res = await model.call("1 + 1 =");
console.log({ res });