RobR
Convex Community•2y ago•
4 replies
Rob

Crawlee in Convex Action

Hi, I'm trying to run Crawlee (an open source web scraping library) in a Convex action. I was able to get my action to deploy by using the node runtime and specifying crawlee and playwright as external packages

{
    "node": {
        "externalPackages": ["crawlee", "playwright"]
    }
}


However, when I run my action, I'm seeing this error:
log
'\x1B[32mINFO\x1B[39m \x1B[33m PlaywrightCrawler:\x1B[39m Starting the crawler.'
error
'\x1B[31mERROR\x1B[39m Memory snapshot failed.\n' +
  '  spawn ps ENOENT\n' +
  '  \x1B[90m    at ChildProcess._handle.onexit (node:internal/child_process:284:19)\x1B[39m\n' +
  '  \x1B[90m    at onErrorNT (node:internal/child_process:477:16)\x1B[39m\n' +
  '  \x1B[90m    at processTicksAndRejections (node:internal/process/task_queues:82:21)\x1B[39m'
failure
[Request ID: aa36c2a408c7a2f7] Server Error
Uncaught Error: spawn ps ENOENT


Any thoughts or advice on how to troubleshoot?
image.png
Was this page helpful?