blocks|key|2548789|text|在理解了您的问题陈述之后，很明显，您正在寻找CI/CD工具以及测试用例的并行实现，以减少执行时间。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2548790|对于希望实现频繁交付方法(如持续集成和交付)的软件开发团队来说，减少测试执行时间是关键。|2548791|首先，我们应该理解CI/CD工具是Jenkins、或Team+City。另一方面，我们实现并行或分布式测试用例执行的不同方式是使用Selenium+Grid+&+Docker|offset|length|style|BOLD|2548792|使用Selenium+Grid，+one可以在多台机器上并行运行多个测试，从而将执行时间从几天减少到几个小时。|2548793|+Docker+在使用网格以非常简单的步骤设置测试实验室方面提供了很大帮助，同时帮助消除了所有复杂性，Docker专业包括|2548794|与尝试从头开始设置Selenium相比，使用预制容器启动和运行要快得多。你不需要安装Java+#winning。|2548795|你不需要安装所有必要的浏览器。也许你不想安装Firefox，或者想用特定的老版本的Chrome或具有特定插件或功能的浏览器进行测试？|2548796|竹子CI/CD工具:+Jenkins+vs.+TeamCity+vs.+|2548797|什么是Jenkins?|2548798|Jenkins是当今市场上最流行的开源CI/CD工具。Jenkins允许开发人员在将代码提交到源代码库后立即自动构建、集成和测试代码。这使开发人员能够快速捕获错误，并最终更快地进行部署。|2548799|什么是竹子？|2548800|竹子服务器是一台来自亚特兰大的CI/CD服务器。就像其他CI/CD服务器一样，竹子允许开发人员自动构建、集成和测试源代码，然后为部署准备应用程序。竹子还可以与Atlassian的其他工具(如Jira)无缝协作。|2548801|什么是TeamCity?|2548802|TeamCity是另一种商业CI/CD服务器，这次来自JetBrains公司。它以其令人难以置信的简单设置和漂亮的用户界面而闻名。|2548803|因此，请根据您的应用程序和测试依赖项&需求，以及您在一天结束时想要实现的目标，给出一个思考过程。首先在设计和方法上工作，然后请转向实施。|2548804|entityMap^0|0|0|P|1Q|0|2|E|0|0|8|0|0|0|0|0|B|0|0|0|6|0|0|0|C|0|0|0^^$0|@$1|2|3|4|5|6|7|19|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|1A|8|@]|9|@]|A|$]]|$1|D|3|E|5|6|7|1B|8|@$F|1C|G|1D|H|I]]|9|@]|A|$]]|$1|J|3|K|5|6|7|1E|8|@$F|1F|G|1G|H|I]]|9|@]|A|$]]|$1|L|3|M|5|6|7|1H|8|@$F|1I|G|1J|H|I]]|9|@]|A|$]]|$1|N|3|O|5|6|7|1K|8|@]|9|@]|A|$]]|$1|P|3|Q|5|6|7|1L|8|@]|9|@]|A|$]]|$1|R|3|S|5|6|7|1M|8|@]|9|@]|A|$]]|$1|T|3|U|5|6|7|1N|8|@$F|1O|G|1P|H|I]]|9|@]|A|$]]|$1|V|3|W|5|6|7|1Q|8|@]|9|@]|A|$]]|$1|X|3|Y|5|6|7|1R|8|@$F|1S|G|1T|H|I]]|9|@]|A|$]]|$1|Z|3|10|5|6|7|1U|8|@]|9|@]|A|$]]|$1|11|3|12|5|6|7|1V|8|@$F|1W|G|1X|H|I]]|9|@]|A|$]]|$1|13|3|14|5|6|7|1Y|8|@]|9|@]|A|$]]|$1|15|3|16|5|6|7|1Z|8|@]|9|@]|A|$]]|$1|17|3|-4|5|6|7|20|8|@]|9|@]|A|$]]]|18|$]]

After understanding your problem statement, it's clear you are looking for CI/CD tools along with parallel implementation of test cases to reduce the execution time.

Reducing test execution time is key for software development teams that wish to implement frequent delivery approaches (like continuous integration and delivery) 

First we shall understand CI/CD tools are Jenkins, Bamboo or Team City. On the other side, different ways in which we can implement parallel or distributed test case execution are of using Selenium Grid &amp; Docker

Using Selenium Grid, one can run multiple tests on multiple machines in parallel, which reduces execution times from days to hours.

Docker helps a lot in setting up test labs using Grid in very easy and simple steps while helping to remove all complexities and Docker Specialities are

It’s much quicker to get up and running using the pre-made containers than to try and set Selenium up from scratch. You don’t need to install Java #winning.

You don’t need to install all the necessary browsers. Perhaps you don’t want to install Firefox or want to test with a specific older build of Chrome or one with specific plugin or capabilities?

CI/CD Tools : Jenkins vs. TeamCity vs. Bamboo

What is Jenkins?

Jenkins is the most popular open source CI/CD tool on the market today. Jenkins allows developers to automatically build, integrate, and test code as soon as they commit it to the source repository. This allows developers to catch bugs quickly and ultimately deploy much faster.

What is Bamboo?

Bamboo is a CI/CD server from Atlassian. Like other CI/CD servers, Bamboo allows developers to automatically build, integrate, and test source code, then prepare the app for deployment. Bamboo also works seamlessly with Atlassian’s other tools like Jira 

What is TeamCity?

TeamCity is another commercial CI/CD server, this time from the firm JetBrains. It is known for its incredibly simple setup and beautiful user interface. 

So please give a thought process based on your application and testing dependencies &amp; requirements and what you want to achieve at end of the day - Your Goal.
First work on the design &amp; approach then please move towards implementation.

blocks|key|2338550|text|我使用了两种方法：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|2338551|2338552|使用测试套件设置Docker，并在本地进行调试。然后使用AWS+CodeBuild的"docker“镜像部署Dockerfile。|ordered-list-item|2338553|CodeBuild可以使用"selenium“镜像https://github.com/awslabs/serverless-automated-ui-testing/blob/master/automated-ui-testing.yaml#L480，而不是您在Dockerfile中提供的说明|offset|length|2338554|2338555|在这两种情况下，CodePipeline都包含4个步骤：|2338556|2338557|grab源代码(代码和测试)|unordered-list-item|2338558|构建项目(使用代码)|2338559|部署selenium+(使用测试)|2338560|2338561|每一步都会产生输出，用于下一步。部署步骤生成selenium可以使用的URL。在我的例子中，"deploy“是部署一个CloudFormation堆栈，但它也可以将必要的文件复制到S3存储桶中或使用其他方法。|2338562|我的设置与https://aws.amazon.com/blogs/devops/using-aws-codepipeline-aws-codebuild-and-aws-lambda-for-serverless-automated-ui-testing/类似，但要简单得多。|2338563|挑战|2338564|最大的问题是获得selenium、浏览器和webdriver的正确组合。关于如何做到这一点有不同的指南。尝试适合你的方法，所有的实现都很混乱，但我认为Docker更可靠。|2338565|示例docker-compose：|2338566|version:+'2'
services:
++hub:
++++image:+selenium/hub:3.3.1
++++ports:+
++++++-+"4444:4444"
++chrome:
++++image:+selenium/node-chrome:3.3.1
++++links:+
++++++-+hub
++++environment:
++++++HUB_PORT_4444_TCP_ADDR:+hub
++++++HUB_PORT_4444_TCP_PORT:+4444
++++++DBUS_SESSION_BUS_ADDRESS:+/dev/null

++firefox:
++++image:+selenium/node-firefox:3.3.1
++++links:
++++++-+hub
++++environment:
++++++HUB_PORT_4444_TCP_ADDR:+hub
++++++HUB_PORT_4444_TCP_PORT:+4444

++phantomjs:
++++image:+selenium/node-phantomjs:3.3.1
++++links:
++++++-+hub
++++environment:
++++++HUB_PORT_4444_TCP_ADDR:+hub
++++++HUB_PORT_4444_TCP_PORT:+4444
++++++PHANTOMJS_OPTS:+"--ignore-ssl-errors=true"

++b3-test:
++++build:+.
++++volumes:+
++++++-+./logs:/app/survey-tests/logs
++++++-+./screenshots:/app/survey-tests/screenshots
++++environment:
++++++-+BTEST_DRIVER=REMOTE
++++++-+BTEST_REMOTE=http://hub:4444/wd/hub|code-block|syntax|javascript|2338567|entityMap|0|LINK|mutability|MUTABLE|url|https://github.com/awslabs/serverless-automated-ui-testing/blob/master/automated-ui-testing.yaml#L480|1|https://aws.amazon.com/blogs/devops/using-aws-codepipeline-aws-codebuild-and-aws-lambda-for-serverless-automated-ui-testing/^0|0|0|0|P|2T|0|0|0|0|0|0|0|0|0|0|5|3G|1|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|1K|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|1L|8|@]|9|@]|A|$]]|$1|C|3|D|5|E|7|1M|8|@]|9|@]|A|$]]|$1|F|3|G|5|E|7|1N|8|@]|9|@$H|1O|I|1P|1|1Q]]|A|$]]|$1|J|3|-4|5|6|7|1R|8|@]|9|@]|A|$]]|$1|K|3|L|5|6|7|1S|8|@]|9|@]|A|$]]|$1|M|3|-4|5|6|7|1T|8|@]|9|@]|A|$]]|$1|N|3|O|5|P|7|1U|8|@]|9|@]|A|$]]|$1|Q|3|R|5|P|7|1V|8|@]|9|@]|A|$]]|$1|S|3|T|5|P|7|1W|8|@]|9|@]|A|$]]|$1|U|3|-4|5|6|7|1X|8|@]|9|@]|A|$]]|$1|V|3|W|5|6|7|1Y|8|@]|9|@]|A|$]]|$1|X|3|Y|5|6|7|1Z|8|@]|9|@$H|20|I|21|1|22]]|A|$]]|$1|Z|3|10|5|6|7|23|8|@]|9|@]|A|$]]|$1|11|3|12|5|6|7|24|8|@]|9|@]|A|$]]|$1|13|3|14|5|6|7|25|8|@]|9|@]|A|$]]|$1|15|3|16|5|17|7|26|8|@]|9|@]|A|$18|19]]|$1|1A|3|-4|5|6|7|27|8|@]|9|@]|A|$]]]|1B|$1C|$5|1D|1E|1F|A|$1G|1H]]|1I|$5|1D|1E|1F|A|$1G|1J]]]]

I've used two approaches:

<ol>
<li>set up Docker with the test-suite and debug locally. Then deploy Dockerfile using "docker" image of AWS CodeBuild. </li>
<li>CodeBuild can use "selenium" image <a href="https://github.com/awslabs/serverless-automated-ui-testing/blob/master/automated-ui-testing.yaml#L480" rel="nofollow noreferrer">https://github.com/awslabs/serverless-automated-ui-testing/blob/master/automated-ui-testing.yaml#L480</a>, instead of Dockerfile you provide instructions in codebuild.yml.</li>
</ol>

In both cases, the CodePipeline consists of 4 steps:

<ul>
<li>grab source (code and tests)</li>
<li>build project (using code)</li>
<li>deploy test-project</li>
<li>run selenium (using tests)</li>
</ul>

Each step produces output, that is used in next step. Deploy step generates URL which selenium can use. In my case "deploy" was deploying a CloudFormation stack, but it could also copy necessary files to S3 bucket or use some other approach.

My setup was similar but much more simpler than: <a href="https://aws.amazon.com/blogs/devops/using-aws-codepipeline-aws-codebuild-and-aws-lambda-for-serverless-automated-ui-testing/" rel="nofollow noreferrer">https://aws.amazon.com/blogs/devops/using-aws-codepipeline-aws-codebuild-and-aws-lambda-for-serverless-automated-ui-testing/</a>.

<h2>Challenges</h2>

The biggest problem is to get the correct combination of selenium, browser and webdriver. There are different guides on how to do it. Try what works for you, all implementations are messy, but I thought that Docker was more reliable.

<h2>Sample docker-compose:</h2>

<pre><code>version: '2'
services:
 hub:
 image: selenium/hub:3.3.1
 ports: 
 - "4444:4444"
 chrome:
 image: selenium/node-chrome:3.3.1
 links: 
 - hub
 environment:
 HUB_PORT_4444_TCP_ADDR: hub
 HUB_PORT_4444_TCP_PORT: 4444
 DBUS_SESSION_BUS_ADDRESS: /dev/null

 firefox:
 image: selenium/node-firefox:3.3.1
 links:
 - hub
 environment:
 HUB_PORT_4444_TCP_ADDR: hub
 HUB_PORT_4444_TCP_PORT: 4444

 phantomjs:
 image: selenium/node-phantomjs:3.3.1
 links:
 - hub
 environment:
 HUB_PORT_4444_TCP_ADDR: hub
 HUB_PORT_4444_TCP_PORT: 4444
 PHANTOMJS_OPTS: "--ignore-ssl-errors=true"

 b3-test:
 build: .
 volumes: 
 - ./logs:/app/survey-tests/logs
 - ./screenshots:/app/survey-tests/screenshots
 environment:
 - BTEST_DRIVER=REMOTE
 - BTEST_REMOTE=http://hub:4444/wd/hub
</code></pre>

I have been assigned a task to integrate the the automation test that I developed to the a AWS CI/CD pipeline, I was researching on how to achieve this task for a while now. After doing some research I found out that a lot of people have used tools like Jenkins/ Docker to achieve this task, even after doing all the research Im still confused on what is the best way to achieve this, here are some of the documents that I found,

<a href="http://www.testautomationguru.com/selenium-webdriver-how-to-run-automated-tests-inside-a-docker-container/" rel="noreferrer">http://www.testautomationguru.com/selenium-webdriver-how-to-run-automated-tests-inside-a-docker-container/</a>

<a href="https://www.pawangaria.com/post/docker/how-to-use-docker-with-webdriver/" rel="noreferrer">https://www.pawangaria.com/post/docker/how-to-use-docker-with-webdriver/</a>

<a href="https://aws.amazon.com/blogs/devops/using-aws-codepipeline-aws-codebuild-and-aws-lambda-for-serverless-automated-ui-testing/" rel="noreferrer">https://aws.amazon.com/blogs/devops/using-aws-codepipeline-aws-codebuild-and-aws-lambda-for-serverless-automated-ui-testing/</a>

<a href="https://dzone.com/articles/qa-automation-pipeline-learn-how-to-build-your-own-1" rel="noreferrer">https://dzone.com/articles/qa-automation-pipeline-learn-how-to-build-your-own-1</a>

What Im supposed to do is, once the web application the developers are working on is deployed through the pipeline, I will have to run the selenium test through the pipeline to check if the web application is deployed properly. (This is where I need some clarification on what is the best way to achieve this)

I built a maven project with the selenium scripts to check content on the web application for now I have used a dummy url in the scripts, here is the maven project 

<a href="https://github.com/nimeshdilshan96/pipeline-script-test.git" rel="noreferrer">https://github.com/nimeshdilshan96/pipeline-script-test.git</a> 

This is what I have done up-to now, 

<ul>
<li>I have a docker container running in my local PC (this is the docker image that i used <a href="https://hub.docker.com/r/selenium/standalone-chrome" rel="noreferrer">https://hub.docker.com/r/selenium/standalone-chrome</a>)</li>
<li>I have the maven project which runs the tests on the docker container </li>
</ul>

At this point Im really confused and stuck on what should be done, here are some questions Im looking answers for,

<ul>
<li>What is the best way to run selenium tests on a CI/CD pipeline?</li>
<li>Should the maven project run separately or within the docker container?</li>
<li>Should the docker container only act as the environment in which tests are executed? </li>
</ul>

Any help would be appreciated, thanks in advance :)

What is the best way to run selenium tests in AWS CI/CD pipeline

软件开发

服务器

容器

Docker

Java

我被分配了一项任务，将我开发的自动化测试集成到AWS CI/CD管道中，我现在正在研究如何实现这一任务。在做了一些研究之后，我发现很多人已经使用像Jenkins/ Docker这样的工具来完成这项任务，即使做了所有的研究，我仍然对实现这一任务的最佳方法感到困惑，以下是我找到的一些文档，我应该做的是，一旦开发人员正在开发...

问在AWS CI/CD管道中运行selenium测试的最佳方式是什么
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问在AWS CI/CD管道中运行selenium测试的最佳方式是什么EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问在AWS CI/CD管道中运行selenium测试的最佳方式是什么
EN