- Crystal-ci - mailweb.openeuler.org

[PATCH crystal-ci] feat: sched: import block_helper
by Tong Qunfeng 21 Aug '20

21 Aug '20

import BlockHelper to Sched. ===demo test code=== 1) add checkfile function at scheduler.cr def self.checkfile File.exists?("/home/chief/0.txt") end 2) add call to block_until_finished # echo alive get "/" do | _ | sched.block_helper.block_until_finished("1") { checkfile } "LKP Alive! The time is #{Time.local}, version = #{VERSION}" end 3) when scheduler is start up at (172.17.0.134:3000), call 3 times curl http://172.17.0.134:3000 - call at different shell - 2 time before create file "/home/chief/0.txt" - 1 time after create file "/home/chief/0.txt" 4) result the first 2 call was blocked. after the 3rd call: 3 curl respond with same message. - LKP Alive! The time is 2020-08-21 03:22:15 UTC, version = 0.2.0 and the scheduler logs shows: - 2020-08-21 03:22:15 UTC 200 GET / 375.36µs - 2020-08-21 03:22:15 UTC 200 GET / 49781.88ms - 2020-08-21 03:22:15 UTC 200 GET / 70282.96ms 1 response in 0.3ms, 1 in 4.9s and 1 in 7s Signed-off-by: Tong Qunfeng <tongqunfeng(a)huawei.com> --- src/lib/sched.cr | 3 +++ 1 file changed, 3 insertions(+) diff --git a/src/lib/sched.cr b/src/lib/sched.cr index faa3553..60e97ba 100644 --- a/src/lib/sched.cr +++ b/src/lib/sched.cr @@ -3,6 +3,7 @@ require "kemal" require "./job" +require "./block_helper" require "./taskqueue_api" require "../scheduler/jobfile_operate" require "../scheduler/redis_client" @@ -12,11 +13,13 @@ class Sched property es property redis + property block_helper def initialize() @es = Elasticsearch::Client.new @redis = Redis::Client.new @task_queue = TaskQueueAPI.new + @block_helper = BlockHelper.new end def normalize_mac(mac : String) -- 2.23.0

1 0

Re: [PATCH crystal-ci] crystal-ci/container: add container for rsync service
by Liu Yinsi 21 Aug '20

21 Aug '20

On Thu, Aug 20, 2020 at 08:29:55PM +0800, Zhang Yu wrote: >Signed-off-by: Zhang Yu <zhangyu424(a)huawei.com> >+RUN apk add --no-cache rsync openssh \ >+ && rm -rf /var/cache/apk/* \ >+ && adduser lkp -u 1090 -g 1090 -D in sparrow/1-storage/permission, already add permission chown lkp:lkp /srv/result no need to adduser in Dockerfile. >+docker_rm rsync_server >+cmd=( >+ docker run >+ -id -i no need. --restart=always ^ if container needs to start always, add --restart=always. >+ --name=rsync_server >+ -v /srv/result:/result ^ is /srv/result? Thanks, Yinsi

2 1

[PATCH todo] remind-credit: ignore hidden files
by Wu Fengguang 21 Aug '20

21 Aug '20

Signed-off-by: Wu Fengguang <wufengguang(a)huawei.com> --- bin/remind-credit | 1 + 1 file changed, 1 insertion(+) diff --git a/bin/remind-credit b/bin/remind-credit index 65d25d3..887bd42 100755 --- a/bin/remind-credit +++ b/bin/remind-credit @@ -7,6 +7,7 @@ cd /c/todo.git for p in $(git ls-tree --name-only HEAD people/) do + [ "${p#people/.}" != "$p" ] && continue [ -n "$(git ls-tree --name-only HEAD $p/credit/$credit_file)" ] && continue name=`basename $p` -- 2.23.0

1 0

[PATCH v2 todo 2/2] weekly credits
by Li Ping 21 Aug '20

21 Aug '20

--- people/LiPing/credit/2020-08-21.md | 8 ++++++++ 1 file changed, 8 insertions(+) create mode 100644 people/LiPing/credit/2020-08-21.md diff --git a/people/LiPing/credit/2020-08-21.md b/people/LiPing/credit/2020-08-21.md new file mode 100644 index 0000000..3914948 --- /dev/null +++ b/people/LiPing/credit/2020-08-21.md @@ -0,0 +1,8 @@ +Wu Zhende +Wu Fengguang +Wei Jihui +Luan Shengde +Cao Xueliang +Liu Shaofei +Xu Xijian +Li Yuanchao -- 2.23.0

1 0

[PATCH v2 todo 1/2] add todo
by Li Ping 21 Aug '20

21 Aug '20

--- .../LiPing/todo/20200831-12d:fill-email-head-and-body.md | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 people/LiPing/todo/20200831-12d:fill-email-head-and-body.md diff --git a/people/LiPing/todo/20200831-12d:fill-email-head-and-body.md b/people/LiPing/todo/20200831-12d:fill-email-head-and-body.md new file mode 100644 index 0000000..105ec52 --- /dev/null +++ b/people/LiPing/todo/20200831-12d:fill-email-head-and-body.md @@ -0,0 +1,9 @@ +# write email for test task done and bisect done + +get the information to fill the head and body + - find the lkp-test repo and bisect repo + - get the head and body + +call email service + + -- 2.23.0

1 0

Re: git bisect result
by Du Kaitian 21 Aug '20

21 Aug '20

标题需要修改，参考之前蚂蚁雄兵的标题格式 On Fri, Aug 21, 2020 at 10:13:12AM +0800, team(a)crystal.ci wrote: >573e4a8d2c9cc600ffeb109683d5a5904aa8fa50 is the first bad commit >commit 573e4a8d2c9cc600ffeb109683d5a5904aa8fa50 >Author: Dave Vasilevsky <dave(a)vasilevsky.ca> >Date: Sun Jul 26 16:34:00 2020 -0400 > > release 1.0.7 需要提供仓库地址 > NEWS | 10 ++++++++++ > configure.ac | 2 +- > 2 files changed, 11 insertions(+), 1 deletion(-) > 这个信息不完整，建议干脆删除，我们这里强调的是通过仓库地址及commit id 可以找到触发点,围绕这个点来提供邮件的信息 Thanks jimmy

1 0

[PATCH v2 lkp-tests] lib/job.rb: raise when no input testbox
by Wei Jihui 21 Aug '20

21 Aug '20

before fix: lib/job.rb:286:in `get_hosts_file': undefined method `split' for nil:NilClass (NoMethodError) after fix: lib/job.rb:269:in `load_hosts_config': hosts_file doesn't exist: /home/weijihui/lkp-tests/hosts/, please check your testbox (RuntimeError) Signed-off-by: Wei Jihui <weijihui2(a)huawei.com> --- lib/job.rb | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-) diff --git a/lib/job.rb b/lib/job.rb index c8b5d82d..72397d8b 100755 --- a/lib/job.rb +++ b/lib/job.rb @@ -265,10 +265,7 @@ class Job return if @job.include?(:no_defaults) hosts_file = get_hosts_file - if !(File.exist? hosts_file) - raise "hosts_file doesn't exist: #{hosts_file}, please check your testbox" - end - return unless File.exist? hosts_file + File.file?(hosts_file) || raise("hosts_file doesn't exist: #{hosts_file}, please check your testbox") hwconfig = load_yaml(hosts_file, nil) @job[source_file_symkey(hosts_file)] = nil @@ -283,7 +280,7 @@ class Job tbox_group = tbox_group(@job['testbox']) end - hosts_file_name = tbox_group.split('--')[0] + hosts_file_name = tbox_group.to_s.split('--')[0] hosts_file = "#{LKP_SRC}/hosts/#{hosts_file_name}" end -- 2.23.0

1 0

[PATCH v2 todo] todo: fix git-count error
by Bai Jing 21 Aug '20

21 Aug '20

problem : sh: line 0: cd: /home/baijing/.am/todo: No such file or directory Signed-off-by: Bai Jing <baijing14(a)huawei.com> --- bin/git-count | 7 +++++-- people/BaiJing/credit/2020-08-21.md | 5 +++++ 2 files changed, 10 insertions(+), 2 deletions(-) create mode 100644 people/BaiJing/credit/2020-08-21.md diff --git a/bin/git-count b/bin/git-count index 2b1359b..5799054 100755 --- a/bin/git-count +++ b/bin/git-count @@ -56,9 +56,12 @@ end count_by_name.sort_by { |k, _v| k } +%x(mkdir -p #{ENV['HOME']}/.am) unless File.exist?("#{ENV['HOME']}/.am") repos.each do |repo, files| - %x(git -C ~/.am/#{repo} pull --rebase) - %x(cd ~/.am/#{repo} && git shortlog -ens --no-merges --since "#{days} days ago" -- #{files}).each_line do |line| + %x(cd #{ENV['HOME']}/.am/ && git clone file:///c/#{repo}.git) unless File.exist?("#{ENV['HOME']}/.am/#{repo}") + %x(git -C #{ENV['HOME']}/.am/#{repo} pull --rebase 2>&1) + file = %x(cd #{ENV['HOME']}/.am/#{repo} && git shortlog -ens --no-merges --since "#{days} days ago" -- #{files}) + file.each_line do |line| if line =~ /(\d+)\t(.*) <(.*)>/ count = $1.to_i name = $2 diff --git a/people/BaiJing/credit/2020-08-21.md b/people/BaiJing/credit/2020-08-21.md new file mode 100644 index 0000000..f1357b0 --- /dev/null +++ b/people/BaiJing/credit/2020-08-21.md @@ -0,0 +1,5 @@ +Tong Qunfeng +Yu Chuan +Wei Jihui +Liu Shaofei +Ren Wen -- 2.23.0

1 1

[Crystal-CI] test result for Avx2Neon commit 68856ae605fe09dd253a53314f79a2aef2c8770f
by Li Ping 21 Aug '20

21 Aug '20

Hi Li Ping, Tests for Avx2Neon finished. git_url: https://github.com/bob-billy/AvxToNeon.git commit_id: 68856ae605fe09dd253a53314f79a2aef2c8770f commit_name: expect one fail PASS: 334 FAIL: 1 Attached detailed test log. Crystal-CI test service https://gitee.com/openeuler/crystal-ci

1 0

Re: [PATCH crystal-ci] service/scheduler: optimize json
by Du Kaitian 21 Aug '20

21 Aug '20

On Fri, Aug 21, 2020 at 09:12:22AM +0800, Wu Zhende wrote: >On Fri, Aug 21, 2020 at 12:28:06AM +0800, Du Kaitian wrote: >>On Thu, Aug 20, 2020 at 08:37:26PM +0800, Wu Zhende wrote: >>>1.use job_id not id >>>2.use state not job_state >>既然这里要将参数变化，为啥在之处不用 job_id 及state >>来描述，而要做相关更新 > >Because the job_content is use to update into job. >In our job, is using id not job_id. >job_state is from lkp, add in the url. > >Thanks, >Zhende. 不理解，这样修改的目的是什么,有什么好处谢谢 jimmy > >> >>>3.add testbox in wtmp log >>> >>>Signed-off-by: Wu Zhende <wuzhende1(a)huawei.com> >>>--- >>> src/lib/sched.cr | 7 +++++++ >>> 1 file changed, 7 insertions(+) >>> >>>diff --git a/src/lib/sched.cr b/src/lib/sched.cr >>>index faa3553..d836ace 100644 >>>--- a/src/lib/sched.cr >>>+++ b/src/lib/sched.cr >>>@@ -237,7 +237,13 @@ class Sched >>> >>> @redis.update_job(job_content) >>> >>>+ # json log >>> job_content["job_id"] = job_id >>>+ job_content.delete("id") >>>+ if job_content.has_key?("job_state") >>>+ job_content["state"] = job_content["job_state"] >>>+ job_content.delete("job_state") >>>+ end >>> puts job_content.to_json >>> end >>> >>>@@ -266,6 +272,7 @@ class Sched >>> >>> @redis.update_wtmp(testbox, hash) >>> >>>+ hash["testbox"] = testbox >>> puts hash.to_json >>> end >>> >>>-- >>>2.23.0 >>>

1 0