Introduction to the Microsoft Playwright Testing service: Scale Your Playwright tests

No video

Introduction to the Microsoft Playwright Testing service: Scale Your Playwright tests

Рет қаралды 8,611

Playwright

Күн бұрын

Пікірлер: 46

@charlyyshell 9 ай бұрын

I'm loving all these updates and improvements you're doing, I'm excited to see this service working! I hope it could have an online trace viewer, so we can check the results without needing to upload the .zip, which could be an interesting upgrade and differentiator versus the other cloud solutions.

@kailashpathak9184 3 ай бұрын

This is amazing !

@AnonYmous-kf7uu 6 ай бұрын

Is there going to be a better integration with Azure DevOps? I've connected our Azure DevOps to the Playwright Testing resource. I'm able to run my tests there but the reporting is terrible. To not be able to see the video or traces within the pipeline run itself is a serious limitation. Do you know if Microsoft is working on that?

@AnonYmous-kf7uu 5 ай бұрын

Hello?

@TheCzenczi 9 ай бұрын

So basically you can run tests in browsers that are not on your machine, so tests can run much faster if I understand properly. Is it all free? I can imagine that letting all users use these browsers can be very demanding, so I assume that it is not all that free, right?

@Playwrightdev 9 ай бұрын

The first 100 test minutes are free in the 30-day trial. Pricing details are here: aka.ms/mpt/pricing.

@vivi182t 3 ай бұрын

i love it! :)

@EricChua-gm9in 8 ай бұрын

3 questions 1. I checked, it seems Southeast Asia not supported. Any idea when this will be released to Southeast Asia? 2. If my project has 100 tests than run for 10 mins, are those considered as 1 test for 10 mins duration? wonder how the pricing works. 3. Can I use playwright to run test on self hosted server (instead of your service)?

@wasuraja6 6 ай бұрын

It is working fine for typescript tests. But not for .net c# tests. Can you please tell how to run playwright tests created in c# in Azure cloud?

@pluto9963 9 ай бұрын

I was exploring playwright java and loved it. But I wanted to make use of Python's flexibility so switched to Python playwright. But there I am struggling a bit to understand how I use asyncio properly. There is a sync_api and async_api and both of them run async. Wish if someone could guide me to a better documentation. I am not planning to use JavaScript. I will stick with Java or Python.

@Playwrightdev 9 ай бұрын

check this page in docs which might help: playwright.dev/python/docs/library#usage for any other questions please use our discord server

@Dzidziolino 9 ай бұрын

I assume we need to have stable test environment to run 40 tests at once? With this solution we are removing part of the load from the CI but still environment might be a bottleneck, correct?

@johnstallo3782 9 ай бұрын

Excellent question! It's important to make sure your target application's environment can manage the number of concurrent requests you plan to test. This requirement varies depending on your application's characteristics, the aspects your tests are focusing on, and potential network delays. To determine the most effective number of workers for your specific scenario, we suggest experimenting with different quantities to find the ideal balance for your use case. Often, you may find that running fewer parallel workers can still yield significant performance improvements.

@renuchudamani 9 ай бұрын

How’s this any different than what browserstack or similar offers? Also - what’s the max number of workers you support?

@muralidharanrajendran4098 9 ай бұрын

Cool feature ❤

@xavier9556 8 ай бұрын

I wonder you have the browser instances somewhere in the cloud. How will they reach internal applications that are not accessible via outside connections. Because now we run playwright on our own internal azure devops runners or our local machine but i dont see how cloud browser will have access to our internal app.

@Playwrightdev 8 ай бұрын

We provide a feature to expose your localhost. See here: learn.microsoft.com/en-us/azure/playwright-testing/how-to-test-local-applications

@vpgaming21 9 ай бұрын

Love it!

@brveg1 9 ай бұрын

Does the playwright service support a specific browser versions. Also can we run against Edge browser as well instead of Chromium?

@Playwrightdev 9 ай бұрын

It supports the same browser versions like the Playwright project is using. See the release notes for more details. Microsoft Edge is also supported. File an issue here for more questions: github.com/microsoft/playwright-testing-service

@managed-code 9 ай бұрын

This is cool but, is it support Safari too?

@Playwrightdev 9 ай бұрын

Yes it supports all Playwright browsers. File an issue here for more questions: github.com/microsoft/playwright-testing-service

@paulandrewc 9 ай бұрын

Will the Public Preview be coming to the UK regions?

@automation_remarks 9 ай бұрын

It's interesting to know how to integrate for languages like java or python

@Playwrightdev 9 ай бұрын

So far it’s only available for Node.js, stay tuned!

@johnnyp5877 8 ай бұрын

@@Playwrightdev can we expect this feature to be available for dotnet in the future?

@alexanderkomanov4151 9 ай бұрын

Wow! Looks great! What about free tier plan? How much it covers?

@Playwrightdev 9 ай бұрын

The first 100 test minutes are free in the 30-day trial. Pricing details are here: aka.ms/mpt/pricing.

@sand4rt 9 ай бұрын

Nice!

@CTimmerman 9 ай бұрын

Can it bypass CORS for Firefox and Safari?

@Playwrightdev 9 ай бұрын

Yes, bypassCSP will just work! can you post your question on the discord server for the service: discord.com/channels/807756831384403968/1161681421774094366

@vitaliypotapov8994 9 ай бұрын

What about debugging such tests?

@dand4485 9 ай бұрын

I could be wrong this is more about running your tests, would still develop them locally, and when a PR and a test pass are needed... Would be the same as devs working on product code, hard to see debugging in a remote web environment whey they can debug local?

@Playwrightdev 9 ай бұрын

As per above yes. Debugging strategy is the same. We recommend traces on CI and UI Mode / VSCode extension locally. File an issue here for more questions github.com/microsoft/playwright-testing-service

@Kranael93 9 ай бұрын

doesn't work for API Tests. It says "No tests" found if you dont use a browser

@Playwrightdev 9 ай бұрын

It should work! Can you report this on the discord service so the azure team can follow up: discord.com/channels/807756831384403968/1161681421774094366