- Compass-ci - mailweb.openeuler.org

[PATCH v6 lkp-tests] add: sysbench-threads-git result parsing file
by Hu Xuejiao 18 Nov '20

18 Nov '20

[input] General statistics: total time: 0.3987s total number of events: 10000 total time taken by event execution: 0.3971 response time: min: 0.04ms [output] total time: 0.3987s Signed-off-by: Hu XueJiao <1034502035(a)qq.com> --- stats/sysbench-threads-git | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100755 stats/sysbench-threads-git diff --git a/stats/sysbench-threads-git b/stats/sysbench-threads-git new file mode 100755 index 00000000..b7a88534 --- /dev/null +++ b/stats/sysbench-threads-git @@ -0,0 +1,17 @@ +#!/usr/bin/env ruby + +# General statistics: +# total time: 0.2671s +# total number of events: 10000 +# total time taken by event execution: 0.3971s +# response time: +# min: 0.04ms + + +$stdin.each_line do |line| + next unless line =~ /^\s+total time:\s+([0-9.]+)/ + + puts "total time: #{$1.to_f}s" +end + + -- 2.23.0

2 1

[PATCH compass-ci] sparrow/3-code: add ENV INITRD_HTTP_HOST and OS_HTTP_HOST default values
by Liu Yinsi 18 Nov '20

18 Nov '20

Using the default value server_ip is convenient for customers to set up compass CI locally. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- sparrow/3-code/dev-env | 2 ++ 1 file changed, 2 insertions(+) diff --git a/sparrow/3-code/dev-env b/sparrow/3-code/dev-env index 77027d9..8928816 100755 --- a/sparrow/3-code/dev-env +++ b/sparrow/3-code/dev-env @@ -6,6 +6,8 @@ server_name=$(hostname | cut -f1 -d.) server_ip=$(ip route get 1.2.3.4 | awk '{print $7; exit}') : ${sched_host:=$server_ip} : ${sched_port:=3000} +: ${os_http_host:=$server_ip} +: ${initrd_http_host:=$server_ip} : ${initrd_http_port:=8800} : ${MASTER_FLUENTD_HOST:=$server_ip} : ${MASTER_FLUENTD_PORT:=24224} -- 2.23.0

1 0

[PATCH v4 compass-ci] sbin/docker-pull: fix failed to pull image from local repository
by Liu Yinsi 18 Nov '20

18 Nov '20

[why] lys@crystal ~/compass-ci/sbin% ./docker-pull centos:7 pull image from local repository Error response from daemon: manifest for 127.0.0.1:5001/centos:7 not found pull image from docker hub 7: Pulling from library/centos Digest: sha256:0f4ec88e21daf75124b8a9e5ca03c37a5e937e0e108a255d890492430789b60e Status: Image is up to date for centos:7 [how] if pull image failed from local repository, it will pull from docker hub, so hide error info for first failed pull. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- sbin/docker-pull | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/sbin/docker-pull b/sbin/docker-pull index 5972913..d69af64 100755 --- a/sbin/docker-pull +++ b/sbin/docker-pull @@ -14,7 +14,7 @@ image_name=$1 local_repository() { echo "pull image from local repository" - docker pull $DOCKER_REGISTRY_HOST:$DOCKER_REGISTRY_PORT/$image_name && { + docker pull $DOCKER_REGISTRY_HOST:$DOCKER_REGISTRY_PORT/$image_name 2> /dev/null && { docker tag $DOCKER_REGISTRY_HOST:$DOCKER_REGISTRY_PORT/$image_name $image_name } } -- 2.23.0

1 0

[PATCH v3 compass-ci] providers/docker: fix failed to pull image from local repository
by Liu Yinsi 18 Nov '20

18 Nov '20

[why] lys@crystal ~/compass-ci/providers% ./my-docker Donehttp://$DOCKER_REGISTRY_HOST:$DOCKER_REGISTRY_PORT/boot.container/hostname/dc-1g.lys-501708 pull image from local repository Error response from daemon: manifest for 127.0.0.1:5001/centos:7 not found pull image from docker hub 7: Pulling from library/centos [how] if pull image failed from local repository, it will pull from docker hub, so hide error info for first failed pull. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- providers/docker/docker.rb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/providers/docker/docker.rb b/providers/docker/docker.rb index 8e489c6..849ea22 100755 --- a/providers/docker/docker.rb +++ b/providers/docker/docker.rb @@ -80,7 +80,7 @@ end def start_container(hostname, load_path, hash) docker_image = hash['docker_image'] - system "#{ENV['CCI_SRC']}/sbin/docker-pull #{docker_image}" + system "#{ENV['CCI_SRC']}/sbin/docker-pull #{docker_image} 2> /dev/null" system( { 'hostname' => hostname, 'docker_image' => docker_image, 'load_path' => load_path }, ENV['CCI_SRC'] + '/providers/docker/run.sh' -- 2.23.0

3 4

[PATCH v9 lkp-tests] job2sh.rb: define on_state
by Hu Xuejiao 18 Nov '20

18 Nov '20

[why] If job.yaml is defined: on_fail: sleep(tests): 300(runtime) [how] By on_fail(sh_on_state), it will appear in job.sh: on_fail() { . $LKP_SRC/lib/job.sh . $LKP_SRC/lib/env.sh run_test $LKP_SRC/tests/wrapper sleep 300 } Signed-off-by: Hu XueJiao <1034502035(a)qq.com> --- lib/job2sh.rb | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/lib/job2sh.rb b/lib/job2sh.rb index 9c8b578d..14bf7159 100755 --- a/lib/job2sh.rb +++ b/lib/job2sh.rb @@ -363,14 +363,14 @@ class Job2sh < Job out_line "}\n\n" end - def sh_on_state(job = nil) + def sh_on_state(state = nil, job = nil) @script_lines = [] @programs = available_programs(:workload_elements) job ||= (@jobx || @job).clone - if job.include?('on_fail') + if state == 'on_fail' && job.include?('on_fail') @cur_func = :run_job -- 2.23.0

1 0

[PATCH v6 lkp-tests] add: sysbench-threads-git result parsing file
by Hu Xuejiao 18 Nov '20

18 Nov '20

[input] General statistics: total time: 0.3987s total number of events: 10000 total time taken by event execution: 0.3971 response time: min: 0.04ms [output] total time: 0.3987s Signed-off-by: Hu XueJiao <1034502035(a)qq.com> --- stats/sysbench-threads-git | 14 ++++++++++++++ 1 file changed, 14 insertions(+) create mode 100755 stats/sysbench-threads-git diff --git a/stats/sysbench-threads-git b/stats/sysbench-threads-git new file mode 100755 index 00000000..785aca73 --- /dev/null +++ b/stats/sysbench-threads-git @@ -0,0 +1,14 @@ +#!/usr/bin/env ruby + +# General statistics: +# total time: 0.2671s +# total number of events: 10000 +# total time taken by event execution: 0.3971s +# response time: +# min: 0.04ms + +$stdin.each_line do |line| + next unless line =~ /^s\+total time:\s+([0-9.]+)/ + + puts "total time: #{$1.to_f}s" +end -- 2.23.0

2 1

[PATCH v3 lkp-tests 1/2] stats/iozone: fix iozone cannot match the data line of part test
by Lu Kaiyi 18 Nov '20

18 Nov '20

[why] iozone can match the line like: 64 4 1599680 3057153 4274062 4897948 3588436 2892445 2772930 3057153 3958892 3057153 3022727 3363612 4564786 but cannot match the line as below(there are extra spaces after '2892445'): 64 4 1599680 3057153 4274062 4897948 3588436 2892445 [how] Add line.strip! before match Signed-off-by: Lu Kaiyi <2392863668(a)qq.com> --- stats/iozone | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/stats/iozone b/stats/iozone index 9f7ee72f..32dce7ba 100755 --- a/stats/iozone +++ b/stats/iozone @@ -8,7 +8,8 @@ per_record = {} all_sum = 0 nr_records = 0 while (line = STDIN.gets) - next unless line =~ /^\s*\d+.*\d+$/ + line.strip! + next unless line =~ /^\d+.*\d+$/ data = line.split data.each_index do |i| -- 2.23.0

1 0

[PATCH v2 compass-ci] sbin/docker-pull: fix failed to pull image from local repository
by Liu Yinsi 18 Nov '20

18 Nov '20

[why] lys@crystal ~/compass-ci/providers% ./my-docker Donehttp://$DOCKER_REGISTRY_HOST:$DOCKER_REGISTRY_PORT/boot.container/hostname/dc-1g.lys-501708 pull image from local repository Error response from daemon: manifest for 127.0.0.1:5001/centos:7 not found pull image from docker hub 7: Pulling from library/centos [how] if pull image failed from local repository, it will pull from docker hub, so hide error info for first failed pull. Signed-off-by: Liu Yinsi <liuyinsi(a)163.com> --- providers/docker/docker.rb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/providers/docker/docker.rb b/providers/docker/docker.rb index 8e489c6..849ea22 100755 --- a/providers/docker/docker.rb +++ b/providers/docker/docker.rb @@ -80,7 +80,7 @@ end def start_container(hostname, load_path, hash) docker_image = hash['docker_image'] - system "#{ENV['CCI_SRC']}/sbin/docker-pull #{docker_image}" + system "#{ENV['CCI_SRC']}/sbin/docker-pull #{docker_image} 2> /dev/null" system( { 'hostname' => hostname, 'docker_image' => docker_image, 'load_path' => load_path }, ENV['CCI_SRC'] + '/providers/docker/run.sh' -- 2.23.0

2 2

[PATCH v3 lkp-tests] stats/libmicro: fix rubocop offenses
by Lu Kaiyi 18 Nov '20

18 Nov '20

[errors] Inspecting 1 file C Offenses: libmicro:7:1: C: Layout/IndentationWidth: Use 2 (not 4) spaces for indentation. next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ ^^^^ libmicro:7:5: C: Layout/EmptyLineAfterGuardClause: Add empty line after guard clause. next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 1 file inspected, 2 offenses detected Signed-off-by: Lu Kaiyi <2392863668(a)qq.com> --- stats/libmicro | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/stats/libmicro b/stats/libmicro index 530d8e2e..b7e895bf 100755 --- a/stats/libmicro +++ b/stats/libmicro @@ -4,6 +4,7 @@ # close_tmp 1 1 0.61880 201 0 640 $stdin.each_line do |line| - next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ - puts "#{$1}: #{$2}" + next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ + + puts "#{$1}: #{$2}" end -- 2.23.0

1 0

[PATCH v2 lkp-tests] stats/libmicro: fix rubocop warning
by Lu Kaiyi 18 Nov '20

18 Nov '20

Signed-off-by: Lu Kaiyi <2392863668(a)qq.com> --- stats/libmicro | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/stats/libmicro b/stats/libmicro index 530d8e2e..b7e895bf 100755 --- a/stats/libmicro +++ b/stats/libmicro @@ -4,6 +4,7 @@ # close_tmp 1 1 0.61880 201 0 640 $stdin.each_line do |line| - next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ - puts "#{$1}: #{$2}" + next unless line =~ /^(\w+)\s+\S+\s+\S+\s+(\S+)/ + + puts "#{$1}: #{$2}" end -- 2.23.0

2 1