November 2020 - Compass-ci - mailweb.openeuler.org

[PATCH v9 lkp-tests] job2sh.rb: define on_state
by Hu Xuejiao 18 Nov '20

18 Nov '20

[why] If job.yaml is defined: on_fail: sleep(tests): 300(runtime) [how] By on_fail(sh_on_state), it will appear in job.sh: on_fail() { . $LKP_SRC/lib/job.sh . $LKP_SRC/lib/env.sh run_test $LKP_SRC/tests/wrapper sleep 300 } Signed-off-by: Hu XueJiao <1034502035(a)qq.com> --- lib/job2sh.rb | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/lib/job2sh.rb b/lib/job2sh.rb index 9c8b578d..14bf7159 100755 --- a/lib/job2sh.rb +++ b/lib/job2sh.rb @@ -363,14 +363,14 @@ class Job2sh < Job out_line "}\n\n" end - def sh_on_state(job = nil) + def sh_on_state(state = nil, job = nil) @script_lines = [] @programs = available_programs(:workload_elements) job ||= (@jobx || @job).clone - if job.include?('on_fail') + if state == 'on_fail' && job.include?('on_fail') @cur_func = :run_job -- 2.23.0

1 0

[PATCH v6 lkp-tests] add: sysbench-threads-git result parsing file
by Hu Xuejiao 18 Nov '20

18 Nov '20

[input] General statistics: total time: 0.3987s total number of events: 10000 total time taken by event execution: 0.3971 response time: min: 0.04ms [output] total time: 0.3987s Signed-off-by: Hu XueJiao <1034502035(a)qq.com> --- stats/sysbench-threads-git | 14 ++++++++++++++ 1 file changed, 14 insertions(+) create mode 100755 stats/sysbench-threads-git diff --git a/stats/sysbench-threads-git b/stats/sysbench-threads-git new file mode 100755 index 00000000..785aca73 --- /dev/null +++ b/stats/sysbench-threads-git @@ -0,0 +1,14 @@ +#!/usr/bin/env ruby + +# General statistics: +# total time: 0.2671s +# total number of events: 10000 +# total time taken by event execution: 0.3971s +# response time: +# min: 0.04ms + +$stdin.each_line do |line| + next unless line =~ /^s\+total time:\s+([0-9.]+)/ + + puts "total time: #{$1.to_f}s" +end -- 2.23.0

2 1

[PATCH v3 lkp-tests 1/2] stats/iozone: fix iozone cannot match the data line of part test
by Lu Kaiyi 18 Nov '20

18 Nov '20

[why] iozone can match the line like: 64 4 1599680 3057153 4274062 4897948 3588436 2892445 2772930 3057153 3958892 3057153 3022727 3363612 4564786 but cannot match the line as below(there are extra spaces after '2892445'): 64 4 1599680 3057153 4274062 4897948 3588436 2892445 [how] Add line.strip! before match Signed-off-by: Lu Kaiyi <2392863668(a)qq.com> --- stats/iozone | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/stats/iozone b/stats/iozone index 9f7ee72f..32dce7ba 100755 --- a/stats/iozone +++ b/stats/iozone @@ -8,7 +8,8 @@ per_record = {} all_sum = 0 nr_records = 0 while (line = STDIN.gets) - next unless line =~ /^\s*\d+.*\d+$/ + line.strip! + next unless line =~ /^\d+.*\d+$/ data = line.split data.each_index do |i| -- 2.23.0

1 0

[PATCH v2 compass-ci] sbin/docker-pull: fix failed to pull image from local repository
by Liu Yinsi 18 Nov '20

18 Nov '20

[why] lys@crystal ~/compass-ci/providers% ./my-docker Donehttp://$DOCKER_REGISTRY_HOST:$DOCKER_REGISTRY_PORT/boot.container/hostname/dc-1g.lys-501708 pull image from local repository Error response from daemon: manifest for 127.0.0.1:5001/centos:7 not found pull image from docker hub 7: Pulling from library/centos [how] if pull image failed from local repository, it will pull from docker hub, so hide error info for first failed pull. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- providers/docker/docker.rb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/providers/docker/docker.rb b/providers/docker/docker.rb index 8e489c6..849ea22 100755 --- a/providers/docker/docker.rb +++ b/providers/docker/docker.rb @@ -80,7 +80,7 @@ end def start_container(hostname, load_path, hash) docker_image = hash['docker_image'] - system "#{ENV['CCI_SRC']}/sbin/docker-pull #{docker_image}" + system "#{ENV['CCI_SRC']}/sbin/docker-pull #{docker_image} 2> /dev/null" system( { 'hostname' => hostname, 'docker_image' => docker_image, 'load_path' => load_path }, ENV['CCI_SRC'] + '/providers/docker/run.sh' -- 2.23.0

2 2

[PATCH v3 lkp-tests] stats/libmicro: fix rubocop offenses
by Lu Kaiyi 18 Nov '20

18 Nov '20

[errors] Inspecting 1 file C Offenses: libmicro:7:1: C: Layout/IndentationWidth: Use 2 (not 4) spaces for indentation. next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ ^^^^ libmicro:7:5: C: Layout/EmptyLineAfterGuardClause: Add empty line after guard clause. next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 1 file inspected, 2 offenses detected Signed-off-by: Lu Kaiyi <2392863668(a)qq.com> --- stats/libmicro | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/stats/libmicro b/stats/libmicro index 530d8e2e..b7e895bf 100755 --- a/stats/libmicro +++ b/stats/libmicro @@ -4,6 +4,7 @@ # close_tmp 1 1 0.61880 201 0 640 $stdin.each_line do |line| - next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ - puts "#{$1}: #{$2}" + next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ + + puts "#{$1}: #{$2}" end -- 2.23.0

1 0

[PATCH v2 lkp-tests] stats/libmicro: fix rubocop warning
by Lu Kaiyi 18 Nov '20

18 Nov '20

Signed-off-by: Lu Kaiyi <2392863668(a)qq.com> --- stats/libmicro | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/stats/libmicro b/stats/libmicro index 530d8e2e..b7e895bf 100755 --- a/stats/libmicro +++ b/stats/libmicro @@ -4,6 +4,7 @@ # close_tmp 1 1 0.61880 201 0 640 $stdin.each_line do |line| - next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ - puts "#{$1}: #{$2}" + next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ + + puts "#{$1}: #{$2}" end -- 2.23.0

2 1

[PATCH v3 lkp-tests] update command parameters
by Hu Xuejiao 18 Nov '20

18 Nov '20

[why] The current result: nr_threads: 2 "total_time" is 0.3927 nr_threads: 4 "total_time" is 0.3927 ... nr_threads: 8192 "total_time" is 0.3927 [how] After updating testcase: nr_threads: 2 "total_time" is 0.3927 nr_threads: 4 "total_time" is 0.5643 ... nr_threads: 8192 "total_time" is 1.678 Signed-off-by: Hu XueJiao <1034502035(a)qq.com> --- tests/sysbench-threads-git | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tests/sysbench-threads-git b/tests/sysbench-threads-git index df1bb5cf..be83b441 100755 --- a/tests/sysbench-threads-git +++ b/tests/sysbench-threads-git @@ -10,7 +10,7 @@ : "${thread_locks:=2}" args=( - --threads=$nr_threads + --num-threads=$nr_threads --thread-yields=$thread_yields --thread-locks=$thread_locks ) -- 2.23.0

2 1

[PATCH v5 compass-ci 4/4] assign-account: build send account email
by Luan Shengde 18 Nov '20

18 Nov '20

build email message for successfuly assign account Signed-off-by: Luan Shengde <shdluan(a)163.com> --- .../build-send-account-email.rb | 32 +++++++++++++++++++ 1 file changed, 32 insertions(+) create mode 100755 container/assign-account/build-send-account-email.rb diff --git a/container/assign-account/build-send-account-email.rb b/container/assign-account/build-send-account-email.rb new file mode 100755 index 0000000..3c41404 --- /dev/null +++ b/container/assign-account/build-send-account-email.rb @@ -0,0 +1,32 @@ +#!/usr/bin/env ruby +# SPDX-License-Identifier: MulanPSL-2.0+ +# Copyright (c) 2020 Huawei Technologies Co., Ltd. All rights reserved. +# frozen_string_literal: true + +def build_message(email, account_info) + message = <<~EMAIL_MESSAGE + To: #{email} + Subject: [compass-ci] jumper account is ready + + Dear user: + + Thank you for joining us. + You can use the following command to login the jumper server: + + Login command: + ssh -p #{account_info['jumper_port']} #{account_info['my_login_name']}@#{account_info['jumper_host']} + + Account password: + #{account_info['my_password']} + + You can use your pub_key to login if you have offered one. + + Suggest: + If you use the password to login, change it in time. + + regards + compass-ci + EMAIL_MESSAGE + + return message +end -- 2.23.0

2 4

[PATCH v8 compass-ci 04/11] mail-robot: check commit url for gitee
by Luan Shengde 18 Nov '20

18 Nov '20

GiteeCommitUrlCheck used to check commit for hub gitee.com when execute commit_url_availability in ParseApplyAccountEmail input: my_commit_url gitee_commit_check clone the repo and check commit exists and availalbe Signed-off-by: Luan Shengde <shdluan(a)163.com> --- .../mail-robot/lib/gitee-commit-url-check.rb | 47 +++++++++++++++++++ 1 file changed, 47 insertions(+) create mode 100755 container/mail-robot/lib/gitee-commit-url-check.rb diff --git a/container/mail-robot/lib/gitee-commit-url-check.rb b/container/mail-robot/lib/gitee-commit-url-check.rb new file mode 100755 index 0000000..23b91f1 --- /dev/null +++ b/container/mail-robot/lib/gitee-commit-url-check.rb @@ -0,0 +1,47 @@ +#!/usr/bin/env ruby +# SPDX-License-Identifier: MulanPSL-2.0+ +# Copyright (c) 2020 Huawei Technologies Co., Ltd. All rights reserved. +# frozen_string_literal: true + +require 'json' +require 'mail' + +# used to check commit available for hub gitee.com +# it is called when: +# - ParseApplyAccountEmail execute commit_url_availability +# - hub is gitee.com +# gitee_commit_check +# clone the repo +# check commit available +class GiteeCommitUrlCheck + def initialize(my_info, url, base_url) + @my_info = my_info + @url = url + @base_url = base_url + end + + def gitee_commit_check + repo_dir = @url.split('/')[-3] + repo_url = [@base_url, 'git'].join('.') + commit_id = @url.split('/')[-1] + + Dir.chdir '/tmp' + %x(/usr/bin/git clone #{repo_url} #{repo_dir}) + + email_index = %x(/usr/bin/git -C #{repo_dir} show #{commit_id}).index @my_info['my_email'] + + FileUtils.rm_rf repo_dir + + gitee_commit_exist(email_index) + end + + def gitee_commit_exist(email_index) + return unless email_index.nil? + + error_message = "We can not conform whether the commit url matches your email.\n" + error_message += 'Make sure that the commit url is right,' + error_message += ' or it is truely submitted with your email.' + + raise error_message + end +end -- 2.23.0

2 2

[PATCH lkp-tests] lib/job.rb: change the way to analyze the testbox field
by Li Ping 18 Nov '20

18 Nov '20

If user wants to reproduce the result directly in the result directory. [problem] /srv/result/iperf/vm-2p8g/2020-11-09/z9.147520% submit job.yaml output: /home/liping/lkp-tests/lib/job.rb:344:in `get_hosts_file': hosts file not exist: vm-2p8g.taishan200-2280-2s64p-256g, maybe need check testbox field (ArgumentError) --- lib/job.rb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/lib/job.rb b/lib/job.rb index 01719c2e..6dd93f01 100755 --- a/lib/job.rb +++ b/lib/job.rb @@ -337,7 +337,7 @@ class Job lab_hosts_file = get_lab_hosts_file return lab_hosts_file if lab_hosts_file - hosts_file_name = @job['tbox_group'].split('--')[0] + hosts_file_name = @job['tbox_group'].split(/(\.|--)/)[0] hosts_file = "#{LKP_SRC}/hosts/#{hosts_file_name}" return hosts_file if File.file?(hosts_file) -- 2.23.0

2 2