Skip to main content

Fireworks

You can use models provided by Fireworks AI as follows:

import { Fireworks } from "langchain/llms/fireworks";

const model = new Fireworks({
  temperature: 0.9,
  // In Node.js defaults to process.env.FIREWORKS_API_KEY
  fireworksApiKey: "YOUR-API-KEY",
});

API Reference:

Behind the scenes, Fireworks AI uses the OpenAI SDK and OpenAI compatible API, with some caveats:

  • Certain properties are not supported by the Fireworks API, see here.
  • Generation using multiple prompts is not supported.