How to use Xenova/deplot using the transformers.js library.

[aadya940]

Question

Currently I'm doing:

      this.pipeline = await pipeline("image-text-to-text", "Xenova/deplot", {
        progress_callback: (progress) => {
          this.updateProgress({ 
            status: `Loading model: ${progress.status}`, 
            progress: 0.1 + (progress.progress * 0.9) 
          });
        },
        device: "cpu",
        dtype: dtype,
      });

I get the following error:

Error: Unsupported pipeline: image-text-to-text. Must be one of [text-classification,token-classification,question-answering,fill-mask,summarization,translation,text2text-generation,text-generation,zero-shot-classification,audio-classification,zero-shot-audio-classification,automatic-speech-recognition,text-to-audio,image-to-text,image-classification,image-segmentation,zero-shot-image-classification,object-detection,zero-shot-object-detection,document-question-answering,image-to-image,depth-estimation,feature-extraction,image-feature-extraction]