February 2021 - Compass-ci - mailweb.openeuler.org

[PATCH v6 compass-ci 3/3] container/submit: add source file for debian packages
by Luan Shengde 04 Feb '21

04 Feb '21

it may take a long time, even break up if use the default source address to install bebian backages. use the source address inland will resolv the problem. Signed-off-by: Luan Shengde <shdluan(a)163.com> --- container/submit/conf/sources.list | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 container/submit/conf/sources.list diff --git a/container/submit/conf/sources.list b/container/submit/conf/sources.list new file mode 100644 index 0000000..8179e01 --- /dev/null +++ b/container/submit/conf/sources.list @@ -0,0 +1,9 @@ +deb [trusted=yes] http://mirrors.163.com/debian/ buster main non-free contrib +deb [trusted=yes] http://mirrors.163.com/debian/ buster-updates main non-free contrib +deb [trusted=yes] http://mirrors.163.com/debian/ buster-backports main non-free contrib +deb [trusted=yes] http://mirrors.163.com/debian-security/ buster/updates main non-free contrib + +deb-src [trusted=yes] http://mirrors.163.com/debian/ buster main non-free contrib +deb-src [trusted=yes] http://mirrors.163.com/debian/ buster-updates main non-free contrib +deb-src [trusted=yes] http://mirrors.163.com/debian/ buster-backports main non-free contrib +deb-src [trusted=yes] http://mirrors.163.com/debian-security/ buster/updates main non-free contrib -- 2.23.0

1 0

[PATCH v6 compass-ci 2/3] container/submit: executable file submit
by Luan Shengde 04 Feb '21

04 Feb '21

executable file for container: submit file 'submit' is used as the command installed in the container. it can be run as the real command submit itself in the container. when you run it, it will calls the command 'submit' in the container. add ln for it to PATH, you can run it at anywhere. Signed-off-by: Luan Shengde <shdluan(a)163.com> --- container/submit/submit | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+) create mode 100755 container/submit/submit diff --git a/container/submit/submit b/container/submit/submit new file mode 100755 index 0000000..6236892 --- /dev/null +++ b/container/submit/submit @@ -0,0 +1,23 @@ +#!/bin/bash +# SPDX-License-Identifier: MulanPSL-2.0+ +# Copyright (c) 2020 Huawei Technologies Co., Ltd. All rights reserved. + +# This is a single-use container. +# The container will run if you run the 'submit' to submit jobs. +# After the command execute over, the container will been removed itself. +# Do not need to delete manually for it has been added option '--rm'. +date_suffix=$(date +%m%d-%H%M%S) +cmd=( + docker run + --rm + --name=submit-$USER-$data_suffix + -it + -v /etc/compass-ci:/etc/compass-ci:ro + -v $HOME/.config:/root/.config:ro + -v $HOME/.ssh:/root/.ssh:rw + submit + /srv/lkp-tests/sbin/submit "$@" +) + +"${cmd[@]}" + -- 2.23.0

1 0

[PATCH v6 compass-ci 1/3] container/submit: Dockerfile
by Luan Shengde 04 Feb '21

04 Feb '21

Instal lkp-tests and its deps in the container instead of install them at localhost. Signed-off-by: Luan Shengde <shdluan(a)163.com> --- container/submit/Dockerfile | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) create mode 100644 container/submit/Dockerfile diff --git a/container/submit/Dockerfile b/container/submit/Dockerfile new file mode 100644 index 0000000..3ca13f4 --- /dev/null +++ b/container/submit/Dockerfile @@ -0,0 +1,27 @@ +# SPDX-License-Identifier: MulanPSL-2.0+ +# Copyright (c) 2020 Huawei Technologies Co., Ltd. All rights reserved. + +FROM debian + +MAINTAINER Luan Shengde <shdluan(a)163.com> + +ENV DEBIAN_FRONTEND noninteractive + +# it may take a long time, even break up if you use default source address to install pkgs. +# you can delete the following step if you do not want to use it. +COPY conf/sources.list /etc/apt/ + +RUN apt-get update && \ + apt-get install -y git ruby ruby-dev make libssl-dev gcc g++ sudo uuid-runtime + +# it may take a long time, even break up if you use default source address for the gem. +# delete the following step if you do not want to use the default one. +RUN gem sources --add https://gems.ruby-china.com/ && \ + gem sources --remove https://rubygems.org/ + +RUN gem install git faye-websocket activesupport rest-client + +WORKDIR /srv + +RUN git clone https://gitee.com/wu_fengguang/lkp-tests.git +RUN cd lkp-tests && make install -- 2.23.0

1 0

[PATCH compass-ci] container/redis: use echo "xxx" for safety reason
by Liu Yinsi 04 Feb '21

04 Feb '21

before: echo you can use cmd: redis-cli to start a redis client echo and then use cmd: keys * after: echo "you can use cmd: redis-cli to start a redis client" echo "and then use cmd: keys *" [why] when use echo $string, if $string include '*', will be parsed, just like: root@test-lys /c/compass-ci/container/redis# ./start ... and then use cmd: keys build Dockerfile start Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- container/redis/start | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/container/redis/start b/container/redis/start index 34266a0..4611fe4 100755 --- a/container/redis/start +++ b/container/redis/start @@ -24,6 +24,6 @@ cmd=( "${cmd[@]}" # test -echo you can use cmd: redis-cli to start a redis client -echo and then use cmd: keys * +echo "you can use cmd: redis-cli to start a redis client" +echo "and then use cmd: keys *" -- 2.23.0

2 2

[PATCH compass-ci] sparrow/5-build: download os rootfs
by Liu Yinsi 04 Feb '21

04 Feb '21

default download os rootfs openeuler aarch64 20.03 for boot testbox. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- sparrow/5-build/os-ready | 5 +++++ sparrow/install-tiny | 1 + 2 files changed, 6 insertions(+) create mode 100755 sparrow/5-build/os-ready diff --git a/sparrow/5-build/os-ready b/sparrow/5-build/os-ready new file mode 100755 index 0000000..48a740b --- /dev/null +++ b/sparrow/5-build/os-ready @@ -0,0 +1,5 @@ +#!/bin/bash +# SPDX-License-Identifier: MulanPSL-2.0+ +# Copyright (c) 2020 Huawei Technologies Co., Ltd. All rights reserved. + +$CCI_SRC/sbin/download-rootfs diff --git a/sparrow/install-tiny b/sparrow/install-tiny index a291549..5f026e5 100755 --- a/sparrow/install-tiny +++ b/sparrow/install-tiny @@ -19,4 +19,5 @@ cd $CCI_SRC/sparrow || exit . /etc/profile.d/compass.sh 4-docker/buildall 5-build/ipxe +5-build/os-ready 7-systemd/systemd-setup -- 2.23.0

1 0

[PATCH compass-ci] sparrow/5-build: register my info
by Liu Yinsi 04 Feb '21

04 Feb '21

register user own account info to ES. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- sparrow/5-build/register-account | 5 +++++ 1 file changed, 5 insertions(+) create mode 100755 sparrow/5-build/register-account diff --git a/sparrow/5-build/register-account b/sparrow/5-build/register-account new file mode 100755 index 0000000..1a23e07 --- /dev/null +++ b/sparrow/5-build/register-account @@ -0,0 +1,5 @@ +#!/bin/bash +# SPDX-License-Identifier: MulanPSL-2.0+ +# Copyright (c) 2020 Huawei Technologies Co., Ltd. All rights reserved. + +$CCI_SRC/sbin/build-my-info.rb -- 2.23.0

1 0

[PATCH lkp-tests] stats: add stats script for dockerfile migrating
by Bai Jing 04 Feb '21

04 Feb '21

[input] Error: Unable to find a match: supervisor /bin/sh: tar: command not found [output] sh.command-not-found.tar: 1 yum.error.Unable-to-find-a-match.supervisor: 1 Signed-off-by: Bai Jing <799286817(a)qq.com> --- stats/openeuler_docker | 13 +++++++++++++ 1 file changed, 13 insertions(+) create mode 100755 stats/openeuler_docker diff --git a/stats/openeuler_docker b/stats/openeuler_docker new file mode 100755 index 000000000..95e2a272b --- /dev/null +++ b/stats/openeuler_docker @@ -0,0 +1,13 @@ +#!/usr/bin/env ruby + +while (line = STDIN.gets) + line.chomp! + case line + when /Error: Unable to find a match: (.+)/ + $1.split.each do |repo| + puts "yum.error.Unable-to-find-a-match.#{repo}: 1" + end + when /\/bin\/sh: (.+): command not found/ + puts "sh.command-not-found.#{$1}: 1" + end +end -- 2.23.0

1 0

[PATCH v3 lkp-tests] stats: add stats script for dockerfile os migrating
by Bai Jing 04 Feb '21

04 Feb '21

[input] ^[[91mError: Unable to find a match: supervisor ^[[91m/bin/sh: tar: command not found [output] sh.command-not-found.tar: 1 yum.error.Unable-to-find-a-match.supervisor: 1 Signed-off-by: Bai Jing <799286817(a)qq.com> --- stats/openeuler_docker | 11 ++++++++--- 1 file changed, 8 insertions(+), 3 deletions(-) diff --git a/stats/openeuler_docker b/stats/openeuler_docker index e31934573..95e2a272b 100755 --- a/stats/openeuler_docker +++ b/stats/openeuler_docker @@ -2,7 +2,12 @@ while (line = STDIN.gets) line.chomp! - next unless line =~ /build.fail/ - - puts line + case line + when /Error: Unable to find a match: (.+)/ + $1.split.each do |repo| + puts "yum.error.Unable-to-find-a-match.#{repo}: 1" + end + when /\/bin\/sh: (.+): command not found/ + puts "sh.command-not-found.#{$1}: 1" + end end -- 2.23.0

1 0

[PATCH compass-ci] delimiter/utils.rb: delete the nil elements in array
by Cao Xueliang 04 Feb '21

04 Feb '21

Signed-off-by: Cao Xueliang <caoxl78320(a)163.com> --- src/delimiter/utils.rb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/delimiter/utils.rb b/src/delimiter/utils.rb index 3120ca6..0930dd7 100644 --- a/src/delimiter/utils.rb +++ b/src/delimiter/utils.rb @@ -29,7 +29,7 @@ module Utils commits << temp_commit if temp_commit end commits << get_last_commit(work_dir, commit) if commits.empty? - return commits.to_a + return commits.to_a.compact end def get_day_ago_commit(work_dir, commit, day_ago) -- 2.23.0

1 0

[PATCH compass-ci] doc/manual: add document
by Luan Shengde 04 Feb '21

04 Feb '21

add chinese document for apply account Signed-off-by: Luan Shengde <shdluan(a)163.com> --- doc/manual/apply-account.zh.md | 56 ++++++++++++++++++++++++++++++++++ 1 file changed, 56 insertions(+) create mode 100644 doc/manual/apply-account.zh.md diff --git a/doc/manual/apply-account.zh.md b/doc/manual/apply-account.zh.md new file mode 100644 index 0000000..52d43ba --- /dev/null +++ b/doc/manual/apply-account.zh.md @@ -0,0 +1,56 @@ +# 账号申请 + +首先您需要一个账号来提交job，同时用于跟踪您的资源消费情况。 +因为目前我们的测试机资源池有限，因此需要做一些使用限制。 + +我们为平台测试所覆盖的开源软件（OSS）的贡献者提供了免费的账号。 +你可以通过在下面邮件中提供‘my oss commit’来验明正身您是一个开源软件（OSS）的贡献者。 + +我们同时也为我们的合作者提供了免费的账号。 +这种情况需要提供用的邮件，名字，ssh公钥，以及申请测试机的目的。 + +## 1. 发送邮件进行账号申请 + +邮件模板： + +--- + From: {{ David Rientjes <rientjes(a)google.com> }} + To: compass-ci-robot(a)qq.com + Subject: apply account + + my oss commit: {{ https://github.com/torvalds/linux/commit/7be74942f184fdfba34ddd19a0d995deb3… }} + + {{ attach your ssh pubkey file(s), e.g. ~/.ssh/id_rsa.pub }} + +--- + +- 使用您的信息替换{{ }}中的内容 + +- 邮件名应该使用英文或中文拼音，例如模板中的“David Rientjes” + +- my oss commit: 使用您的邮件和名字提交的代码的地址。 + 您的仓库需要在平台测试覆盖的范围内，并且注册到： + [upstream-repos](https://gitee.com/wu_fengguang/upstream-repos). + 如果贡献的OSS工程仓库不在upstream-repos中，请参考： + [test-oss-project](https://gitee.com/wu_fengguang/lkp-tests/blob/master/doc/… + 将仓库注册到compass-ci测试池中。 + +## 2. 接收邮件 + +申请邮件成功后，您将收到反馈邮件，包括： + + my_name + my_email + my_token + lab + +## 3. 一次性配置 + +**根据步骤2收到邮件的提示，配置您的本地环境： + + git clone https://gitee.com/wu_fengguang/lkp-tests.git + setup ~/.config/compass-ci/defaults/account.yaml + +## 4. 现在开始 + +[submit a job to compass-ci](https://gitee.com/wu_fengguang/compass-ci/blob/master/doc/manua… -- 2.23.0

2 2