calcEmbeddings

calcEmbeddings(embeddingFuncs): TransformComponent<Promise<BaseNode<Metadata>[]>>

Defined in: packages/core/src/embeddings/transformation.ts:33

Creates a transformation that adds embeddings to nodes based on their modality type.

Parameters

embeddingFuncs

EmbeddingsByType

Map of modality type to embedding function

Returns

TransformComponent<Promise<BaseNode<Metadata>[]>>

A transformation component that adds embeddings to nodes

Example

const pipeline = new IngestionPipeline({
  transformations: [
    new SentenceSplitter({ chunkSize: 1024 }),
    embeddings({
      text: getOpenAIEmbedding("text-embedding-3-small"),
    }),
  ],
});