July 2020 - Virt - mailweb.openeuler.org

Re: Kunpeng920 virtualization performance
by Ying Fang 17 Sep '20

17 Sep '20

On 7/2/2020 3:18 PM, Haibin Zhang wrote: > Hi, Ying Fang. > Hi Haibin, Thanks for report this issue for us. We will verify and response to you later. > I use qemu create a VM (96 cores and 360g ram) on my kunpeng 920-4826 server, then do unixbench tests. > The performance of pipe-based context switching decreases severely, which shows below: > > Guest# ./context1 60 > COUNT|4779535|1|lps > COUNT|4779536|1|lps > > Host# ./context1 60 > COUNT|13990745|1|lps > COUNT|13990746|1|lps > Could you provide more details about your OS and virtualization software version information for us? > As you know, pipe-based context switching measures the number of times two processes can exchange an > increasing integer through a pipe in a duration (like 60 seconds). Times of guest is only 34% as that > of host. Attachment is the context1.c from unixbench. It looks simple, just spawn a child process with > which it carries on a bi-directional pipe conversation. Yes, we had knowledge about this context test now. Thanks. > > Guest# taskset -c 20 ./context1 60 > COUNT|18059443|1|lps > COUNT|18059443|1|lps > > Host# taskset -c 20 ./context1 60 > COUNT|17881974|1|lps > COUNT|17881975|1|lps > > Use taskset to set cpu affinity, which makes results better. > > Can you help me fix this issue? Maybe WFE/WFI traps lead the performance cost? Is there PLE(Pause Loop Exit) feature on Kunpeng? > We had some performance tuning techniques in the openEuler OS. And Xie XiangYou is the expert on this area, maybe he could help you with it. Moreover, you can drop us an issue on gitee via: https://gitee.com/src-openeuler/qemu >

2 20

【Meeting Notice】Virt sig meeting Time: 2020-07-31 14:30-16:30
by Chenzhendong (alex) 30 Jul '20

30 Jul '20

Virt sig会议议程： 1、openEuler 20.09 虚拟化特性进展 alexchen 2、EulerRobot质量体系构建进展 kuhnchen 3、virt 技术路标讨论 all -------- 原始邮件 -------- 发件人： Meeting Book <uMeeting(a)huawei.com<mailto:uMeeting@huawei.com>> 日期： 2020年7月30日周四 10:12 收件人： zdchenhn(a)163.com<mailto:zdchenhn@163.com> 主题：【Meeting Notice】Virt sig meeting Time: 2020-07-31 14:30-16:30 Topic Virt sig meeting Time 2020-07-31 14:30-16:30((UTC+08:00)Beijing) Join Conference Join (External) >><https://welink-meeting.zoom.us/j/623832541> Meeting ID 623 832 541 Convener 陈振东 Tips: Dial the access number to join conference<http://app.huawei.com/eshare/voiceMeetings> 注：仅支持部分国家和地区。( Only some countries and regions are supported.) 如果加入会议提示“会议已结束或会议号不存在”，请在官网下载最新版本入会。立即下载<https://zoom.us/download> If a message is displayed, indicating that the meeting has ended or the meeting ID does not exist, download the latest meeting client and try again.Download<https://zoom.us/download>

1 0

[PATCH] qcow2: flush qcow2 l2 meta for new allocated clusters
by Ying Fang 29 Jul '20

29 Jul '20

From: fangying <fangying1(a)huawei.com> When qemu or qemu-nbd process that uses a qcow2 file and configured with 'cache = none', it will write to the qcow2 file which uses qcow2 with a cache to cache L2 tables, the process will not use L2 tables without explicitly calling the flush command or closing the mirror flash into the disk. Which causes the disk data to be inconsistent with the written data for a long time. If an abnormal process exit occurs here, the written data will be lost. Therefore, we need to flush the changes to the L2 entry to the disk in time for the newly allocated cluster. Signed-off-by: Ying Fang <fangying1(a)huawei.com> diff --git a/block/qcow2-cache.c b/block/qcow2-cache.c index 7444b9c4ab..ab6e812c84 100644 --- a/block/qcow2-cache.c +++ b/block/qcow2-cache.c @@ -266,6 +266,22 @@ int qcow2_cache_flush(BlockDriverState *bs, Qcow2Cache *c) return result; } +#define L2_ENTRIES_PER_SECTOR 64 +int qcow2_cache_l2_write_entry(BlockDriverState *bs, Qcow2Cache *c, + void *table, int index, int num) +{ + int ret; + int i = qcow2_cache_get_table_idx(c, table); + int start_sector = index / L2_ENTRIES_PER_SECTOR; + int end_sector = (index + num - 1) / L2_ENTRIES_PER_SECTOR; + int nr_sectors = end_sector - start_sector + 1; + ret = bdrv_pwrite(bs->file, + c->entries[i].offset + start_sector * BDRV_SECTOR_SIZE, + table + start_sector * BDRV_SECTOR_SIZE, + nr_sectors * BDRV_SECTOR_SIZE); + return ret; +} + int qcow2_cache_set_dependency(BlockDriverState *bs, Qcow2Cache *c, Qcow2Cache *dependency) { diff --git a/block/qcow2-cluster.c b/block/qcow2-cluster.c index a677ba9f5c..ae49a83972 100644 --- a/block/qcow2-cluster.c +++ b/block/qcow2-cluster.c @@ -998,6 +998,9 @@ int qcow2_alloc_cluster_link_l2(BlockDriverState *bs, QCowL2Meta *m) } + ret = qcow2_cache_l2_write_entry(bs, s->l2_table_cache, l2_slice, + l2_index, m->nb_clusters); + qcow2_cache_put(s->l2_table_cache, (void **) &l2_slice); /* diff --git a/block/qcow2.h b/block/qcow2.h index 7ce2c23bdb..168ab5918e 100644 --- a/block/qcow2.h +++ b/block/qcow2.h @@ -748,6 +748,8 @@ int qcow2_cache_destroy(Qcow2Cache *c); void qcow2_cache_entry_mark_dirty(Qcow2Cache *c, void *table); int qcow2_cache_flush(BlockDriverState *bs, Qcow2Cache *c); int qcow2_cache_write(BlockDriverState *bs, Qcow2Cache *c); +int qcow2_cache_l2_write_entry(BlockDriverState *bs, Qcow2Cache *c, + void *table, int index, int num); int qcow2_cache_set_dependency(BlockDriverState *bs, Qcow2Cache *c, Qcow2Cache *dependency); void qcow2_cache_depends_on_flush(Qcow2Cache *c); -- 2.23.0

1 0

Re: openEuler kata补丁
by Zhanghailiang 20 Jul '20

20 Jul '20

From: zhangliang (AG) Sent: Monday, July 20, 2020 11:26 AM To: Zhanghailiang <zhang.zhanghailiang(a)huawei.com>; openeuler(a)126.com; virt(a)openeuler.org Subject: openEuler kata补丁

1 0

Re: 上传到openEuler的kata补丁
by Zhanghailiang 17 Jul '20

17 Jul '20

From: zhangliang (AG) Sent: Friday, July 17, 2020 11:50 AM To: openeuler(a)126.com; virt(a)openeuler.org Cc: Wubin (H) <wu.wubin(a)huawei.com>; wangzhigang (O) <wangzhigang17(a)huawei.com>; Zhanghailiang <zhang.zhanghailiang(a)huawei.com> Subject: 上传到openEuler的kata补丁上传到openEuler的kata补丁

1 0

Virt meeting 会议纪要-0713//RE: 【Meeting Notice】virt sig meeting Time: 2020-07-10 14:15-16:15
by Chenzhendong (alex) 14 Jul '20

14 Jul '20

Virt meeting 会议纪要-0713： openEuler 20.09特性进展 1． KVM支持custom模式---zhanghailiang cpu custom原型完成，正在修改代码，当前仅实现feature的disable，enable，无特性相互依赖的判断处理，当前增加一个与内核交互接口 2． kvmtop---nocjj 完成x86环境适配，精简了部分代码，完成makefile编写，spec编写，增加了虚拟机状态统计功能 3． SmartPolling---miaoyubo Guest halt polling arm侧代码开发及调试，完成60% 4．支持SDEI设备---待定正在分析开源方案 5．双层调度---fanhenglong 6．锁优化---YeZengruan vCPU preempted check和PV qspinlock补丁已完成rebase，补丁先发到openeuler review 7．安全启动---待定 8．可信启动---JackJF 可信启动（aarch64 + vTPM + EDK中使能可信启动）的原型系统功能已经验证过。具体包括Libvirt拉起VM + vTPM，VM暂停启动，快照启动，热迁移。下一步将开源QEMU和EDK2回合到openEuler版本中；确认社区中的Libvrit支持aarch64 vTPM的情况或将目前该更代码提交到openEuler仓库中。 9．热补丁---FangYing 针对qemu场景里面的主线程、IO线程、协程、热迁移线程、vnc线程、vcpu线程和TLS进行热补丁验证，验证结果表示libcare热补丁支持上述场景下的热补丁基本功能。当前rcu线程比较特殊，还不支持热补丁应用，object_patch_verify_safety_single阶段出错导致补丁无法成功激活，正在解决。 From: Chenzhendong (alex) via Virt [mailto:virt@openeuler.org] Sent: Wednesday, July 8, 2020 11:57 AM To: virt(a)openeuler.org; dev(a)openeuler.org; tc(a)openeuler.org Subject: [Virt] 【Meeting Notice】virt sig meeting Time: 2020-07-10 14:15-16:15 virt会议议程： 1．Virt sig事务跟踪 a) qemu/libvirt 代码仓库从src-openeuler切换到openeuelr 2．openEuler 20.09特性进展 a) KVM支持custom模式---zhanghailiang b) kvmtop---nocjj c) SmartPolling---miaoyubo d) 支持SDEI设备---待定 e) 双层调度---fanhenglong f) 锁优化---YeZengruan g) 安全启动---待定 h) 可信启动---JackJF i) 热补丁---FangYing -------- 原始邮件 -------- 发件人： Meeting Book <uMeeting(a)huawei.com<mailto:uMeeting@huawei.com>> 日期： 2020年7月8日周三 11:11 收件人： zdchenhn(a)163.com<mailto:zdchenhn@163.com> 主题：【Meeting Notice】virt sig meeting Time: 2020-07-10 14:15-16:15 Topic virt sig meeting Time 2020-07-10 14:15-16:15((UTC+08:00)Beijing) Join Conference Join (External) >><https://welink-meeting.zoom.us/j/883868749> Meeting ID 883 868 749 Convener 陈振东 Tips: Dial the access number to join conference<http://app.huawei.com/eshare/voiceMeetings> 注：仅支持部分国家和地区。( Only some countries and regions are supported.) 如果加入会议提示“会议已结束或会议号不存在”，请在官网下载最新版本入会。立即下载<https://zoom.us/download> If a message is displayed, indicating that the meeting has ended or the meeting ID does not exist, download the latest meeting client and try again.Download<https://zoom.us/download>

1 0

【Meeting Notice】virt sig meeting Time: 2020-07-10 14:15-16:15
by Chenzhendong (alex) 08 Jul '20

08 Jul '20

virt会议议程： 1．Virt sig事务跟踪 a) qemu/libvirt 代码仓库从src-openeuler切换到openeuelr 2．openEuler 20.09特性进展 a) KVM支持custom模式---zhanghailiang b) kvmtop---nocjj c) SmartPolling---miaoyubo d) 支持SDEI设备---待定 e) 双层调度---fanhenglong f) 锁优化---YeZengruan g) 安全启动---待定 h) 可信启动---JackJF i) 热补丁---FangYing -------- 原始邮件 -------- 发件人： Meeting Book <uMeeting(a)huawei.com<mailto:uMeeting@huawei.com>> 日期： 2020年7月8日周三 11:11 收件人： zdchenhn(a)163.com<mailto:zdchenhn@163.com> 主题：【Meeting Notice】virt sig meeting Time: 2020-07-10 14:15-16:15 Topic virt sig meeting Time 2020-07-10 14:15-16:15((UTC+08:00)Beijing) Join Conference Join (External) >><https://welink-meeting.zoom.us/j/883868749> Meeting ID 883 868 749 Convener 陈振东 Tips: Dial the access number to join conference<http://app.huawei.com/eshare/voiceMeetings> 注：仅支持部分国家和地区。( Only some countries and regions are supported.) 如果加入会议提示“会议已结束或会议号不存在”，请在官网下载最新版本入会。立即下载<https://zoom.us/download> If a message is displayed, indicating that the meeting has ended or the meeting ID does not exist, download the latest meeting client and try again.Download<https://zoom.us/download>

1 0