CPU time hard limit reached. isolate: 55619bfe-af00-4461-9821-860f9c76c61a failed to send request to user worker: request has been cancelled by supervisor

[umerbaig]

I am Self hosting the supabase edge function with below code on fly.io and following the same steps mentioned in this repo self host supabase edge functions however my code runs perfect on local but it is giving me this error when i deploy that function to fly.io

CPU time hard limit reached. isolate: 55619bfe-af00-4461-9821-860f9c76c61a failed to send request to user worker: request has been cancelled by supervisor

import { PDFLoader } from "langchain/document_loaders/fs/pdf";
import { DocxLoader } from "langchain/document_loaders/fs/docx";
import { RecursiveCharacterTextSplitter } from "langchain/text_splitter";
import * as pdf from "pdf-parse";
import * as mammoth from "mammoth";
import { corsHeaders } from "../_shared/cors.ts";
import { response } from "../_common/request.ts";
// Follow this setup guide to integrate the Deno language server with your editor:
// https://deno.land/manual/getting_started/setup_your_environment
// This enables autocomplete, go to definition, etc.

// Setup type definitions for built-in Supabase Runtime APIs
/// <reference types="https://esm.sh/@supabase/functions-js/src/edge-runtime.d.ts" />

Deno.serve(async (req) => {
  if (req.method === "OPTIONS") {
    return new Response("ok", { headers: corsHeaders });
  }
  const form = await req.formData();
  const file: File = form.get("file") || null;
  const authorizationHeader = req.headers.get("Authorization") || null;

  if (!file) {
    return response({ error: "File required" }, 400);
  }

  if (!authorizationHeader) {
    return response({ error: "Authorization header required" }, 403);
  }
  try {
    let chunks = null;
    if (file.name.endsWith(".pdf")) {
      chunks = await new PDFLoader(file).loadAndSplit(
        new RecursiveCharacterTextSplitter({
          chunkSize: 1300,
          chunkOverlap: 150,
        }),
      );
    }

    if (file.name.endsWith(".doc") || file.name.endsWith(".docx")) {
      chunks = await new DocxLoader(file).loadAndSplit(
        new RecursiveCharacterTextSplitter({
          chunkSize: 1300,
          chunkOverlap: 150,
        }),
      );
    }

    if (!chunks) {
      return response({ data: [] }, 200);
    }

    const docChunks = chunks?.map((doc) => {
      return doc.pageContent.replace(/\n/g, " ");
    }) || [];
    return response({ data: docChunks }, 200);
  } catch (err) {
    console.log(err, 'omer error');
    let errorText = "Could not parse the provided file";
    if (err instanceof Error) {
      if (err.message.includes("We only support a maximum of 200 pages")) {
        errorText = "We only support a maximum of 200 pages";
      }
    }
    return response({ error: errorText }, 400);
  }
}, { port: 9005 });

[kallebysantos]

Same for me, while trying to parse with PDFLoader.
So I'd increased my CPU limit by adding it to main functions/main/index.ts

const cpuScalling = 5;

// ...
   
const worker = await EdgeRuntime.userWorkers.create({
  cpuTimeSoftLimitMs: 50 * cpuScalling,
  cpuTimeHardLimitMs: 100 * cpuScalling,
  // ... etc
});

// ...

[Nishanth-Gobi]

Can you please share a complete snippet? I am a little stuck on where to add this 😅