Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Await onApiCallEnd/onApiCallBegin hooks #30795

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

Andarist
Copy link
Contributor

onApiCallBegin doesn't completely serve its purpose today.

  1. it gets called here before the "API call"
  2. that call gets executed by this async wrapper that executes all hooks in sequeuence
  3. Playwright adds one onApiCallBegin hook here so whatever gets installed after it gets executed in the next microtask (since this hook is synchronous). That means that the next hooks get called after the API call has already been dispatched since the engine exits from the non-awaited instrumentation wrapper call and proceeds to this._connection.sendMessageToServer

@@ -188,7 +189,7 @@ export abstract class ChannelOwner<T extends channels.Channel = channels.Channel
logApiCall(logger, `=> ${apiName} started`, isInternal);
const apiZone: ApiZone = { apiName, frames, isInternal, reported: false, csi, callCookie, wallTime };
const result = await zones.run('apiZone', apiZone, async () => await func(apiZone));
csi?.onApiCallEnd(callCookie);
await csi?.onApiCallEnd(callCookie);
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

similar issue happens here when this is not awaited - the test runs to completion, closes the browser and code in onApiCallEnd can get rejected with "Test ended." error because the browser was already closes by the time it gets executed

This comment has been minimized.

@pavelfeldman
Copy link
Member

How did you discover this? We only have one instrumentation instance, so things should run in order. Starting with an issue would always be great as well!

@Andarist
Copy link
Contributor Author

How did you discover this?

We are hooking into this not-so-stable API in our @replayio/playwright package. This is the only way to achieve what we want because we have to evaluate functions at precise~ moments (before steps actually happen in the browser). We add annotations to our runtime to aid our time-travel experience in Replay.

Copy link
Contributor

Test results for "tests 1"

6 fatal errors, not part of any test
341 failed
❌ [chromium-library] › library/beforeunload.spec.ts:55:3 › should run beforeunload if asked for @smoke
❌ [chromium-library] › library/beforeunload.spec.ts:79:3 › should access page after beforeunload
❌ [chromium-library] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
❌ [chromium-library] › library/browsercontext-add-init-script.spec.ts:45:3 › should work without navigation in popup
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:83:3 › should be able to match a URL relative to its given URL with urlMatcher
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:105:3 › should not construct a new URL with baseURL when a glob was used
❌ [chromium-library] › library/browsercontext-basic.spec.ts:70:3 › window.open should use parent tab context
❌ [chromium-library] › library/browsercontext-basic.spec.ts:305:3 › should emulate media in popup
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:19:3 › should fetch lodpi assets @smoke
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:31:3 › should fetch hidpi assets
❌ [chromium-library] › library/browsercontext-events.spec.ts:29:5 › console event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:60:5 › console event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:77:5 › dialog event should work @smoke
❌ [chromium-library] › library/browsercontext-events.spec.ts:91:5 › dialog event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:123:5 › dialog event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-fetch.spec.ts:850:3 › should override request parameters
❌ [chromium-library] › library/browsercontext-har.spec.ts:166:3 › should change document URL after redirected navigation
❌ [chromium-library] › library/browsercontext-har.spec.ts:180:3 › should change document URL after redirected navigation on click
❌ [chromium-library] › library/browsercontext-locale.spec.ts:74:3 › should format number in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:89:3 › should affect navigator.language in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:103:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-locale.spec.ts:166:3 › should format number in workers
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:43:3 › should have about:blank url with domcontentloaded
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:55:3 › should have about:blank for empty url with domcontentloaded
❌ [chromium-library] › library/browsercontext-pages.spec.ts:46:3 › should click with disabled javascript
❌ [chromium-library] › library/browsercontext-reuse.spec.ts:255:1 › should continue issuing events after closing the reused page
❌ [chromium-library] › library/browsercontext-service-worker-policy.spec.ts:26:5 › block › blocks service worker registration
❌ [chromium-library] › library/browsercontext-timezone-id.spec.ts:58:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-viewport-mobile.spec.ts:99:5 › mobile viewport › should fire orientationchange event
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:89:5 › should connectOverCDP and manage downloads in default context
❌ [chromium-library] › library/chromium/launcher.spec.ts:102:3 › should support request/response events when using backgroundPage()
❌ [chromium-library] › library/defaultbrowsercontext-1.spec.ts:173:3 › should support acceptDownloads option
❌ [chromium-library] › library/defaultbrowsercontext-2.spec.ts:143:3 › should have passed URL when launching with ignoreDefaultArgs: true
❌ [chromium-library] › library/download.spec.ts:54:5 › download event › should report download when navigation turns into download @smoke
❌ [chromium-library] › library/download.spec.ts:80:5 › download event › should work with Cross-Origin-Opener-Policy
❌ [chromium-library] › library/download.spec.ts:106:5 › download event › should report downloads with acceptDownloads: false
❌ [chromium-library] › library/download.spec.ts:123:5 › download event › should report downloads with acceptDownloads: true
❌ [chromium-library] › library/download.spec.ts:136:5 › download event › should report proper download url when download is from download attribute
❌ [chromium-library] › library/download.spec.ts:148:5 › download event › should report downloads for download attribute
❌ [chromium-library] › library/download.spec.ts:162:5 › download event › should save to user-specified path without updating original path
❌ [chromium-library] › library/download.spec.ts:180:5 › download event › should save to two different paths with multiple saveAs calls
❌ [chromium-library] › library/download.spec.ts:199:5 › download event › should save to overwritten filepath
❌ [chromium-library] › library/download.spec.ts:217:5 › download event › should create subdirectories when saving to non-existent user-specified path
❌ [chromium-library] › library/download.spec.ts:231:5 › download event › should error when saving with downloads disabled
❌ [chromium-library] › library/download.spec.ts:244:5 › download event › should error when saving after deletion
❌ [chromium-library] › library/download.spec.ts:258:5 › download event › should report non-navigation downloads
❌ [chromium-library] › library/download.spec.ts:307:5 › download event › should report alt-click downloads
❌ [chromium-library] › library/download.spec.ts:330:5 › download event › should report new window downloads
❌ [chromium-library] › library/download.spec.ts:342:5 › download event › should delete file
❌ [chromium-library] › library/download.spec.ts:356:5 › download event › should expose stream
❌ [chromium-library] › library/beforeunload.spec.ts:55:3 › should run beforeunload if asked for @smoke
❌ [chromium-library] › library/beforeunload.spec.ts:79:3 › should access page after beforeunload
❌ [chromium-library] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
❌ [chromium-library] › library/browsercontext-add-init-script.spec.ts:45:3 › should work without navigation in popup
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:83:3 › should be able to match a URL relative to its given URL with urlMatcher
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:105:3 › should not construct a new URL with baseURL when a glob was used
❌ [chromium-library] › library/browsercontext-basic.spec.ts:70:3 › window.open should use parent tab context
❌ [chromium-library] › library/browsercontext-basic.spec.ts:305:3 › should emulate media in popup
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:19:3 › should fetch lodpi assets @smoke
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:31:3 › should fetch hidpi assets
❌ [chromium-library] › library/browsercontext-events.spec.ts:29:5 › console event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:60:5 › console event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:77:5 › dialog event should work @smoke
❌ [chromium-library] › library/browsercontext-events.spec.ts:91:5 › dialog event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:123:5 › dialog event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-fetch.spec.ts:850:3 › should override request parameters
❌ [chromium-library] › library/browsercontext-har.spec.ts:166:3 › should change document URL after redirected navigation
❌ [chromium-library] › library/browsercontext-har.spec.ts:180:3 › should change document URL after redirected navigation on click
❌ [chromium-library] › library/browsercontext-locale.spec.ts:74:3 › should format number in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:89:3 › should affect navigator.language in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:103:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-locale.spec.ts:166:3 › should format number in workers
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:43:3 › should have about:blank url with domcontentloaded
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:55:3 › should have about:blank for empty url with domcontentloaded
❌ [chromium-library] › library/browsercontext-pages.spec.ts:46:3 › should click with disabled javascript
❌ [chromium-library] › library/browsercontext-reuse.spec.ts:255:1 › should continue issuing events after closing the reused page
❌ [chromium-library] › library/browsercontext-service-worker-policy.spec.ts:26:5 › block › blocks service worker registration
❌ [chromium-library] › library/browsercontext-timezone-id.spec.ts:58:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-viewport-mobile.spec.ts:99:5 › mobile viewport › should fire orientationchange event
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:89:5 › should connectOverCDP and manage downloads in default context
❌ [chromium-library] › library/chromium/launcher.spec.ts:102:3 › should support request/response events when using backgroundPage()
❌ [chromium-library] › library/defaultbrowsercontext-1.spec.ts:173:3 › should support acceptDownloads option
❌ [chromium-library] › library/defaultbrowsercontext-2.spec.ts:143:3 › should have passed URL when launching with ignoreDefaultArgs: true
❌ [chromium-library] › library/download.spec.ts:54:5 › download event › should report download when navigation turns into download @smoke
❌ [chromium-library] › library/download.spec.ts:80:5 › download event › should work with Cross-Origin-Opener-Policy
❌ [chromium-library] › library/download.spec.ts:106:5 › download event › should report downloads with acceptDownloads: false
❌ [chromium-library] › library/download.spec.ts:123:5 › download event › should report downloads with acceptDownloads: true
❌ [chromium-library] › library/download.spec.ts:136:5 › download event › should report proper download url when download is from download attribute
❌ [chromium-library] › library/download.spec.ts:148:5 › download event › should report downloads for download attribute
❌ [chromium-library] › library/download.spec.ts:162:5 › download event › should save to user-specified path without updating original path
❌ [chromium-library] › library/download.spec.ts:180:5 › download event › should save to two different paths with multiple saveAs calls
❌ [chromium-library] › library/download.spec.ts:199:5 › download event › should save to overwritten filepath
❌ [chromium-library] › library/download.spec.ts:217:5 › download event › should create subdirectories when saving to non-existent user-specified path
❌ [chromium-library] › library/download.spec.ts:231:5 › download event › should error when saving with downloads disabled
❌ [chromium-library] › library/download.spec.ts:244:5 › download event › should error when saving after deletion
❌ [chromium-library] › library/download.spec.ts:258:5 › download event › should report non-navigation downloads
❌ [chromium-library] › library/download.spec.ts:307:5 › download event › should report alt-click downloads
❌ [chromium-library] › library/download.spec.ts:330:5 › download event › should report new window downloads
❌ [chromium-library] › library/download.spec.ts:342:5 › download event › should delete file
❌ [chromium-library] › library/download.spec.ts:356:5 › download event › should expose stream
❌ [chromium-library] › library/beforeunload.spec.ts:55:3 › should run beforeunload if asked for @smoke
❌ [chromium-library] › library/beforeunload.spec.ts:79:3 › should access page after beforeunload
❌ [chromium-library] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
❌ [chromium-library] › library/browsercontext-add-init-script.spec.ts:45:3 › should work without navigation in popup
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:83:3 › should be able to match a URL relative to its given URL with urlMatcher
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:105:3 › should not construct a new URL with baseURL when a glob was used
❌ [chromium-library] › library/browsercontext-basic.spec.ts:70:3 › window.open should use parent tab context
❌ [chromium-library] › library/browsercontext-basic.spec.ts:305:3 › should emulate media in popup
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:19:3 › should fetch lodpi assets @smoke
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:31:3 › should fetch hidpi assets
❌ [chromium-library] › library/browsercontext-events.spec.ts:29:5 › console event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:60:5 › console event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:77:5 › dialog event should work @smoke
❌ [chromium-library] › library/browsercontext-events.spec.ts:91:5 › dialog event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:123:5 › dialog event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-fetch.spec.ts:850:3 › should override request parameters
❌ [chromium-library] › library/browsercontext-har.spec.ts:166:3 › should change document URL after redirected navigation
❌ [chromium-library] › library/browsercontext-har.spec.ts:180:3 › should change document URL after redirected navigation on click
❌ [chromium-library] › library/browsercontext-locale.spec.ts:74:3 › should format number in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:89:3 › should affect navigator.language in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:103:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-locale.spec.ts:166:3 › should format number in workers
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:43:3 › should have about:blank url with domcontentloaded
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:55:3 › should have about:blank for empty url with domcontentloaded
❌ [chromium-library] › library/browsercontext-pages.spec.ts:46:3 › should click with disabled javascript
❌ [chromium-library] › library/browsercontext-reuse.spec.ts:255:1 › should continue issuing events after closing the reused page
❌ [chromium-library] › library/browsercontext-service-worker-policy.spec.ts:26:5 › block › blocks service worker registration
❌ [chromium-library] › library/browsercontext-timezone-id.spec.ts:58:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-viewport-mobile.spec.ts:99:5 › mobile viewport › should fire orientationchange event
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:89:5 › should connectOverCDP and manage downloads in default context
❌ [chromium-library] › library/chromium/launcher.spec.ts:102:3 › should support request/response events when using backgroundPage()
❌ [chromium-library] › library/defaultbrowsercontext-1.spec.ts:173:3 › should support acceptDownloads option
❌ [chromium-library] › library/download.spec.ts:54:5 › download event › should report download when navigation turns into download @smoke
❌ [chromium-library] › library/download.spec.ts:80:5 › download event › should work with Cross-Origin-Opener-Policy
❌ [chromium-library] › library/download.spec.ts:106:5 › download event › should report downloads with acceptDownloads: false
❌ [chromium-library] › library/download.spec.ts:123:5 › download event › should report downloads with acceptDownloads: true
❌ [chromium-library] › library/download.spec.ts:136:5 › download event › should report proper download url when download is from download attribute
❌ [chromium-library] › library/download.spec.ts:148:5 › download event › should report downloads for download attribute
❌ [chromium-library] › library/download.spec.ts:162:5 › download event › should save to user-specified path without updating original path
❌ [chromium-library] › library/download.spec.ts:180:5 › download event › should save to two different paths with multiple saveAs calls
❌ [chromium-library] › library/download.spec.ts:199:5 › download event › should save to overwritten filepath
❌ [chromium-library] › library/download.spec.ts:217:5 › download event › should create subdirectories when saving to non-existent user-specified path
❌ [chromium-library] › library/download.spec.ts:231:5 › download event › should error when saving with downloads disabled
❌ [chromium-library] › library/download.spec.ts:244:5 › download event › should error when saving after deletion
❌ [chromium-library] › library/download.spec.ts:258:5 › download event › should report non-navigation downloads
❌ [chromium-library] › library/download.spec.ts:307:5 › download event › should report alt-click downloads
❌ [chromium-library] › library/download.spec.ts:330:5 › download event › should report new window downloads
❌ [chromium-library] › library/download.spec.ts:342:5 › download event › should delete file
❌ [chromium-library] › library/download.spec.ts:356:5 › download event › should expose stream
❌ [chromium-library] › library/download.spec.ts:371:5 › download event › should delete downloads on context destruction
❌ [firefox-library] › library/beforeunload.spec.ts:55:3 › should run beforeunload if asked for @smoke
❌ [firefox-library] › library/beforeunload.spec.ts:79:3 › should access page after beforeunload
❌ [firefox-library] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
❌ [firefox-library] › library/browsercontext-add-init-script.spec.ts:45:3 › should work without navigation in popup
❌ [firefox-library] › library/browsercontext-base-url.spec.ts:83:3 › should be able to match a URL relative to its given URL with urlMatcher
❌ [firefox-library] › library/browsercontext-base-url.spec.ts:105:3 › should not construct a new URL with baseURL when a glob was used
❌ [firefox-library] › library/browsercontext-basic.spec.ts:70:3 › window.open should use parent tab context
❌ [firefox-library] › library/browsercontext-basic.spec.ts:272:3 › should work with offline option
❌ [firefox-library] › library/browsercontext-basic.spec.ts:305:3 › should emulate media in popup
❌ [firefox-library] › library/browsercontext-dsf.spec.ts:19:3 › should fetch lodpi assets @smoke
❌ [firefox-library] › library/browsercontext-dsf.spec.ts:31:3 › should fetch hidpi assets
❌ [firefox-library] › library/browsercontext-events.spec.ts:29:5 › console event should work in popup
❌ [firefox-library] › library/browsercontext-events.spec.ts:77:5 › dialog event should work @smoke
❌ [firefox-library] › library/browsercontext-events.spec.ts:91:5 › dialog event should work in popup
❌ [firefox-library] › library/browsercontext-events.spec.ts:123:5 › dialog event should work in immediately closed popup
❌ [firefox-library] › library/browsercontext-fetch.spec.ts:850:3 › should override request parameters
❌ [firefox-library] › library/browsercontext-har.spec.ts:166:3 › should change document URL after redirected navigation
❌ [firefox-library] › library/browsercontext-har.spec.ts:180:3 › should change document URL after redirected navigation on click
❌ [firefox-library] › library/browsercontext-locale.spec.ts:74:3 › should format number in popups
❌ [firefox-library] › library/browsercontext-locale.spec.ts:89:3 › should affect navigator.language in popups
❌ [firefox-library] › library/browsercontext-locale.spec.ts:103:3 › should work for multiple pages sharing same process
❌ [firefox-library] › library/browsercontext-locale.spec.ts:166:3 › should format number in workers
❌ [firefox-library] › library/browsercontext-page-event.spec.ts:109:3 › should not crash while redirecting of original request was missed
❌ [firefox-library] › library/browsercontext-pages.spec.ts:46:3 › should click with disabled javascript
❌ [firefox-library] › library/browsercontext-reuse.spec.ts:255:1 › should continue issuing events after closing the reused page
❌ [firefox-library] › library/browsercontext-service-worker-policy.spec.ts:26:5 › block › blocks service worker registration
❌ [firefox-library] › library/browsercontext-timezone-id.spec.ts:58:3 › should work for multiple pages sharing same process
❌ [firefox-library] › library/defaultbrowsercontext-1.spec.ts:173:3 › should support acceptDownloads option
❌ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:143:3 › should have passed URL when launching with ignoreDefaultArgs: true
❌ [firefox-library] › library/download.spec.ts:54:5 › download event › should report download when navigation turns into download @smoke
❌ [firefox-library] › library/download.spec.ts:80:5 › download event › should work with Cross-Origin-Opener-Policy
❌ [firefox-library] › library/download.spec.ts:106:5 › download event › should report downloads with acceptDownloads: false
❌ [firefox-library] › library/download.spec.ts:123:5 › download event › should report downloads with acceptDownloads: true
❌ [firefox-library] › library/download.spec.ts:136:5 › download event › should report proper download url when download is from download attribute
❌ [firefox-library] › library/download.spec.ts:148:5 › download event › should report downloads for download attribute
❌ [firefox-library] › library/download.spec.ts:162:5 › download event › should save to user-specified path without updating original path
❌ [firefox-library] › library/download.spec.ts:180:5 › download event › should save to two different paths with multiple saveAs calls
❌ [firefox-library] › library/download.spec.ts:199:5 › download event › should save to overwritten filepath
❌ [firefox-library] › library/download.spec.ts:217:5 › download event › should create subdirectories when saving to non-existent user-specified path
❌ [firefox-library] › library/download.spec.ts:231:5 › download event › should error when saving with downloads disabled
❌ [firefox-library] › library/download.spec.ts:244:5 › download event › should error when saving after deletion
❌ [firefox-library] › library/download.spec.ts:258:5 › download event › should report non-navigation downloads
❌ [firefox-library] › library/download.spec.ts:330:5 › download event › should report new window downloads
❌ [firefox-library] › library/download.spec.ts:342:5 › download event › should delete file
❌ [firefox-library] › library/download.spec.ts:356:5 › download event › should expose stream
❌ [firefox-library] › library/download.spec.ts:371:5 › download event › should delete downloads on context destruction
❌ [firefox-library] › library/download.spec.ts:391:5 › download event › should delete downloads on browser gone
❌ [firefox-library] › library/download.spec.ts:437:5 › download event › should close the context without awaiting the download
❌ [firefox-library] › library/download.spec.ts:472:5 › download event › should throw if browser dies
❌ [firefox-library] › library/download.spec.ts:499:5 › download event › should download large binary.zip
❌ [firefox-library] › library/downloads-path.spec.ts:32:5 › downloads path › should keep downloadsPath folder
❌ [playwright-test] › playwright.ct-react.spec.ts:354:5 › should bundle public folder
❌ [playwright-test] › playwright.trace.spec.ts:737:5 › should not throw when screenshot on failure fails
❌ [playwright-test] › test-step.spec.ts:1096:5 › should report api steps
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:21:5 › should contain text attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:48:5 › should contain binary attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:69:5 › should contain string attachment
❌ [playwright-test] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test] › web-server.spec.ts:321:5 › should be able to use an existing server when reuseExistingServer:true
❌ [chromium-library] › library/beforeunload.spec.ts:55:3 › should run beforeunload if asked for @smoke
❌ [chromium-library] › library/beforeunload.spec.ts:79:3 › should access page after beforeunload
❌ [chromium-library] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
❌ [chromium-library] › library/browsercontext-add-init-script.spec.ts:45:3 › should work without navigation in popup
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:83:3 › should be able to match a URL relative to its given URL with urlMatcher
❌ [chromium-library] › library/browsercontext-base-url.spec.ts:105:3 › should not construct a new URL with baseURL when a glob was used
❌ [chromium-library] › library/browsercontext-basic.spec.ts:70:3 › window.open should use parent tab context
❌ [chromium-library] › library/browsercontext-basic.spec.ts:305:3 › should emulate media in popup
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:19:3 › should fetch lodpi assets @smoke
❌ [chromium-library] › library/browsercontext-dsf.spec.ts:31:3 › should fetch hidpi assets
❌ [chromium-library] › library/browsercontext-events.spec.ts:29:5 › console event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:60:5 › console event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:77:5 › dialog event should work @smoke
❌ [chromium-library] › library/browsercontext-events.spec.ts:91:5 › dialog event should work in popup
❌ [chromium-library] › library/browsercontext-events.spec.ts:123:5 › dialog event should work in immediately closed popup
❌ [chromium-library] › library/browsercontext-fetch.spec.ts:850:3 › should override request parameters
❌ [chromium-library] › library/browsercontext-har.spec.ts:166:3 › should change document URL after redirected navigation
❌ [chromium-library] › library/browsercontext-har.spec.ts:180:3 › should change document URL after redirected navigation on click
❌ [chromium-library] › library/browsercontext-locale.spec.ts:74:3 › should format number in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:89:3 › should affect navigator.language in popups
❌ [chromium-library] › library/browsercontext-locale.spec.ts:103:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-locale.spec.ts:166:3 › should format number in workers
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:43:3 › should have about:blank url with domcontentloaded
❌ [chromium-library] › library/browsercontext-page-event.spec.ts:55:3 › should have about:blank for empty url with domcontentloaded
❌ [chromium-library] › library/browsercontext-pages.spec.ts:46:3 › should click with disabled javascript
❌ [chromium-library] › library/browsercontext-reuse.spec.ts:255:1 › should continue issuing events after closing the reused page
❌ [chromium-library] › library/browsercontext-service-worker-policy.spec.ts:26:5 › block › blocks service worker registration
❌ [chromium-library] › library/browsercontext-timezone-id.spec.ts:58:3 › should work for multiple pages sharing same process
❌ [chromium-library] › library/browsercontext-viewport-mobile.spec.ts:99:5 › mobile viewport › should fire orientationchange event
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:89:5 › should connectOverCDP and manage downloads in default context
❌ [chromium-library] › library/chromium/launcher.spec.ts:102:3 › should support request/response events when using backgroundPage()
❌ [chromium-library] › library/defaultbrowsercontext-1.spec.ts:173:3 › should support acceptDownloads option
❌ [chromium-library] › library/defaultbrowsercontext-2.spec.ts:143:3 › should have passed URL when launching with ignoreDefaultArgs: true
❌ [chromium-library] › library/download.spec.ts:54:5 › download event › should report download when navigation turns into download @smoke
❌ [chromium-library] › library/download.spec.ts:80:5 › download event › should work with Cross-Origin-Opener-Policy
❌ [chromium-library] › library/download.spec.ts:106:5 › download event › should report downloads with acceptDownloads: false
❌ [chromium-library] › library/download.spec.ts:123:5 › download event › should report downloads with acceptDownloads: true
❌ [chromium-library] › library/download.spec.ts:136:5 › download event › should report proper download url when download is from download attribute
❌ [chromium-library] › library/download.spec.ts:148:5 › download event › should report downloads for download attribute
❌ [chromium-library] › library/download.spec.ts:162:5 › download event › should save to user-specified path without updating original path
❌ [chromium-library] › library/download.spec.ts:180:5 › download event › should save to two different paths with multiple saveAs calls
❌ [chromium-library] › library/download.spec.ts:199:5 › download event › should save to overwritten filepath
❌ [chromium-library] › library/download.spec.ts:217:5 › download event › should create subdirectories when saving to non-existent user-specified path
❌ [chromium-library] › library/download.spec.ts:231:5 › download event › should error when saving with downloads disabled
❌ [chromium-library] › library/download.spec.ts:244:5 › download event › should error when saving after deletion
❌ [chromium-library] › library/download.spec.ts:258:5 › download event › should report non-navigation downloads
❌ [chromium-library] › library/download.spec.ts:307:5 › download event › should report alt-click downloads
❌ [chromium-library] › library/download.spec.ts:330:5 › download event › should report new window downloads
❌ [chromium-library] › library/download.spec.ts:342:5 › download event › should delete file
❌ [chromium-library] › library/download.spec.ts:356:5 › download event › should expose stream
❌ [playwright-test] › playwright.ct-react.spec.ts:354:5 › should bundle public folder
❌ [playwright-test] › playwright.trace.spec.ts:737:5 › should not throw when screenshot on failure fails
❌ [playwright-test] › test-step.spec.ts:1096:5 › should report api steps
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:21:5 › should contain text attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:48:5 › should contain binary attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:69:5 › should contain string attachment
❌ [playwright-test] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test] › web-server.spec.ts:321:5 › should be able to use an existing server when reuseExistingServer:true
❌ [playwright-test] › playwright.ct-react.spec.ts:354:5 › should bundle public folder
❌ [playwright-test] › playwright.trace.spec.ts:737:5 › should not throw when screenshot on failure fails
❌ [playwright-test] › test-step.spec.ts:1096:5 › should report api steps
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:21:5 › should contain text attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:48:5 › should contain binary attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:69:5 › should contain string attachment
❌ [playwright-test] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test] › web-server.spec.ts:321:5 › should be able to use an existing server when reuseExistingServer:true
❌ [playwright-test] › playwright.ct-react.spec.ts:354:5 › should bundle public folder
❌ [playwright-test] › playwright.trace.spec.ts:737:5 › should not throw when screenshot on failure fails
❌ [playwright-test] › test-step.spec.ts:1096:5 › should report api steps
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:21:5 › should contain text attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:48:5 › should contain binary attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:69:5 › should contain string attachment
❌ [playwright-test] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test] › web-server.spec.ts:321:5 › should be able to use an existing server when reuseExistingServer:true
❌ [webkit-library] › library/beforeunload.spec.ts:55:3 › should run beforeunload if asked for @smoke
❌ [webkit-library] › library/beforeunload.spec.ts:79:3 › should access page after beforeunload
❌ [webkit-library] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
❌ [webkit-library] › library/browsercontext-add-init-script.spec.ts:45:3 › should work without navigation in popup
❌ [webkit-library] › library/browsercontext-base-url.spec.ts:83:3 › should be able to match a URL relative to its given URL with urlMatcher
❌ [webkit-library] › library/browsercontext-base-url.spec.ts:105:3 › should not construct a new URL with baseURL when a glob was used
❌ [webkit-library] › library/browsercontext-basic.spec.ts:70:3 › window.open should use parent tab context
❌ [webkit-library] › library/browsercontext-basic.spec.ts:305:3 › should emulate media in popup
❌ [webkit-library] › library/browsercontext-dsf.spec.ts:19:3 › should fetch lodpi assets @smoke
❌ [webkit-library] › library/browsercontext-dsf.spec.ts:31:3 › should fetch hidpi assets
❌ [webkit-library] › library/browsercontext-events.spec.ts:29:5 › console event should work in popup
❌ [webkit-library] › library/browsercontext-events.spec.ts:60:5 › console event should work in immediately closed popup
❌ [webkit-library] › library/browsercontext-events.spec.ts:77:5 › dialog event should work @smoke
❌ [webkit-library] › library/browsercontext-events.spec.ts:91:5 › dialog event should work in popup
❌ [webkit-library] › library/browsercontext-events.spec.ts:123:5 › dialog event should work in immediately closed popup
❌ [webkit-library] › library/browsercontext-fetch.spec.ts:850:3 › should override request parameters
❌ [webkit-library] › library/browsercontext-har.spec.ts:166:3 › should change document URL after redirected navigation
❌ [webkit-library] › library/browsercontext-har.spec.ts:180:3 › should change document URL after redirected navigation on click
❌ [webkit-library] › library/browsercontext-locale.spec.ts:74:3 › should format number in popups
❌ [webkit-library] › library/browsercontext-locale.spec.ts:89:3 › should affect navigator.language in popups
❌ [webkit-library] › library/browsercontext-locale.spec.ts:103:3 › should work for multiple pages sharing same process
❌ [webkit-library] › library/browsercontext-locale.spec.ts:166:3 › should format number in workers
❌ [webkit-library] › library/browsercontext-page-event.spec.ts:43:3 › should have about:blank url with domcontentloaded
❌ [webkit-library] › library/browsercontext-page-event.spec.ts:55:3 › should have about:blank for empty url with domcontentloaded
❌ [webkit-library] › library/browsercontext-pages.spec.ts:46:3 › should click with disabled javascript
❌ [webkit-library] › library/browsercontext-reuse.spec.ts:255:1 › should continue issuing events after closing the reused page
❌ [webkit-library] › library/browsercontext-service-worker-policy.spec.ts:26:5 › block › blocks service worker registration
❌ [webkit-library] › library/browsercontext-timezone-id.spec.ts:58:3 › should work for multiple pages sharing same process
❌ [webkit-library] › library/browsercontext-viewport-mobile.spec.ts:99:5 › mobile viewport › should fire orientationchange event
❌ [webkit-library] › library/defaultbrowsercontext-1.spec.ts:173:3 › should support acceptDownloads option
❌ [webkit-library] › library/download.spec.ts:54:5 › download event › should report download when navigation turns into download @smoke
❌ [webkit-library] › library/download.spec.ts:80:5 › download event › should work with Cross-Origin-Opener-Policy
❌ [webkit-library] › library/download.spec.ts:106:5 › download event › should report downloads with acceptDownloads: false
❌ [webkit-library] › library/download.spec.ts:123:5 › download event › should report downloads with acceptDownloads: true
❌ [webkit-library] › library/download.spec.ts:136:5 › download event › should report proper download url when download is from download attribute
❌ [webkit-library] › library/download.spec.ts:148:5 › download event › should report downloads for download attribute
❌ [webkit-library] › library/download.spec.ts:162:5 › download event › should save to user-specified path without updating original path
❌ [webkit-library] › library/download.spec.ts:180:5 › download event › should save to two different paths with multiple saveAs calls
❌ [webkit-library] › library/download.spec.ts:199:5 › download event › should save to overwritten filepath
❌ [webkit-library] › library/download.spec.ts:217:5 › download event › should create subdirectories when saving to non-existent user-specified path
❌ [webkit-library] › library/download.spec.ts:231:5 › download event › should error when saving with downloads disabled
❌ [webkit-library] › library/download.spec.ts:244:5 › download event › should error when saving after deletion
❌ [webkit-library] › library/download.spec.ts:258:5 › download event › should report non-navigation downloads
❌ [webkit-library] › library/download.spec.ts:307:5 › download event › should report alt-click downloads
❌ [webkit-library] › library/download.spec.ts:330:5 › download event › should report new window downloads
❌ [webkit-library] › library/download.spec.ts:342:5 › download event › should delete file
❌ [webkit-library] › library/download.spec.ts:356:5 › download event › should expose stream
❌ [webkit-library] › library/download.spec.ts:371:5 › download event › should delete downloads on context destruction
❌ [webkit-library] › library/download.spec.ts:391:5 › download event › should delete downloads on browser gone
❌ [webkit-library] › library/download.spec.ts:499:5 › download event › should download large binary.zip
❌ [playwright-test] › playwright.ct-react.spec.ts:354:5 › should bundle public folder
❌ [playwright-test] › playwright.trace.spec.ts:737:5 › should not throw when screenshot on failure fails
❌ [playwright-test] › test-step.spec.ts:1096:5 › should report api steps
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:21:5 › should contain text attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:48:5 › should contain binary attachment
❌ [playwright-test] › ui-mode-test-attachments.spec.ts:69:5 › should contain string attachment
❌ [playwright-test] › web-server.spec.ts:24:5 › should create a server
❌ [playwright-test] › web-server.spec.ts:321:5 › should be able to use an existing server when reuseExistingServer:true

1 flaky ⚠️ [chromium-library] › library/defaultbrowsercontext-2.spec.ts:143:3 › should have passed URL when launching with ignoreDefaultArgs: true
5 interrupted ⚠️ [chromium-library] › library/browsertype-connect.spec.ts:262:5 › run-server › should support slowmo option
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:185:5 › run-server › should be able to visit ipv6 through localhost
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:173:5 › run-server › should ignore page.pause when headed
⚠️ [chromium-library] › library/browsertype-connect.spec.ts:185:5 › run-server › should be able to visit ipv6 through localhost
⚠️ [webkit-library] › library/browsertype-connect.spec.ts:272:5 › run-server › disconnected event should be emitted when browser is closed or server is closed

10147 passed, 244 skipped, 16897 did not run
✔️✔️✔️

Merge workflow run.

@pavelfeldman
Copy link
Member

Looks like the bots are unhappy with your approach.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants