An automatic verification method for software quality with real business data

TIAN Biao; CUI Wei; HUANG Hui; FENG Xiaolong

doi:10.11959/j.issn.1000-0801.2024071

您当前的位置：

首页 >

文章列表页 >

An automatic verification method for software quality with real business data

Engineering and Application | 更新时间：2024-06-05

- An automatic verification method for software quality with real business data
- Telecommunications Science Vol. 40, Issue 3, Pages: 174-186(2024)
- 作者机构：
  
  1.天翼数字生活科技有限公司，广东广州 510630
  2.中国矿业大学信息与控制工程学院，江苏徐州 221116
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2024071
  CLC： TP319
- Received：26 October 2023，
  
  Revised：05 March 2024，
  
  Published：20 March 2024
- 稿件说明：
移动端阅览
田标,崔伟,黄慧等.基于真实业务数据的软件质量自动校验方法[J].电信科学,2024,40(03):174-186.

TIAN Biao,CUI Wei,HUANG Hui,et al.An automatic verification method for software quality with real business data[J].Telecommunications Science,2024,40(03):174-186.
田标,崔伟,黄慧等.基于真实业务数据的软件质量自动校验方法[J].电信科学,2024,40(03):174-186. DOI： 10.11959/j.issn.1000-0801.2024071.

TIAN Biao,CUI Wei,HUANG Hui,et al.An automatic verification method for software quality with real business data[J].Telecommunications Science,2024,40(03):174-186. DOI： 10.11959/j.issn.1000-0801.2024071.

摘要

软件性能校验结果有助于检验业务集群能否满足访问规模需求，但当前工具存在需要估算参数值、手工输入数据较多、性能偏低、应用复杂等不足。深入分析了JMeter并发机制设计的不足，提出了一种具有一般性的量化访问速度控制机制及基于协程的并发设计方案，给出了相应的测试即服务（TaaS）的架构设计和分布式自动性能测试方案，具有更高的并发性能，能使用真实业务数据并自动调整访问速度或调度更多服务器执行，自动汇总分析全量响应，有助于提高软件质量校验的效果及结果的直观性。

Abstract

Performance tests help to verify whether a business cluster can meet its access scale requirements

but current tools have problems such as evaluating proper parameters and requiring manual inputs

low performance

and difficulty in automation. A comprehensive quantitative request rate control mechanism and concurrent design approach based on coroutines were proposed

in contrast to JMeter's reliance on threads and locks. Furthermore

an architecture design for its corresponding TaaS service and a process automation scheme were introduced. This scheme automatically perceives responses

adjusts access rates accordingly

and schedules additional server executions using real business data

significantly enhancing operational efficiency and result intuitiveness.

关键词

Keywords

references

AYALA-RIVERA V , KACZMARSKI M , MURPHY J , et al . One size does not fit all: In-test workload adaptation for performance testing of enterprise applications [C ] // Proceedings of the Proceedings of the 2018 ACM/SPEC International Conference on Performance Engineering . New York : ACM , 2018 : 211 - 222 .

高文辉 . 基于流量回放的测试平台在线上服务压力测试上的应用 [J ] . IT经理世界 , 2020 , 1 ( 23 ): 62 - 63 .

GAO W H . Application of a testing platform based on traffic replay in online service stress testing [J ] . IT Manager World , 2020 , 1 ( 23 ): 62 - 63 .

唐承玲 , 王虎 , 李光平 , 等 . 基于JMeter的Web性能测试研究 [J ] . 电脑与电信 , 2021 ( 6 ): 65 - 68, 86 .

TANG C L , WANG H , LI G P , et al . Study on the web performance test based on JMeter [J ] . Computer & Telecommunication , 2021 ( 6 ): 65 - 68, 86 .

陈阿妹 , 陈佳丽 , 陈斌仙 . 基于JMeter的Web性能测试的研究 [J ] . 九江学院学报(自然科学版) , 2016 , 31 ( 1 ): 70 - 76 .

CHEN A M , CHEN J L , CHEN B X . Research on web performance testing based on JMeter [J ] . Journal of Jiujiang University (Natural Science Edition) , 2016 , 31 ( 1 ): 70 - 76 .

韦亚军 , 张文文 . 一种标准化的软件性能测试流程设计与研究 [J ] . 计算机测量与控制 , 2022 , 30 ( 8 ): 31 - 37 .

WEI Y J , ZHANG W W . Design and research of a standardized software performance testing flow [J ] . Computer Measurement & Control , 2022 , 30 ( 8 ): 31 - 37 .

李培殿 . 基于Netty框架的性能测试系统的设计与实现 [D ] . 北京 : 北京邮电大学 , 2019 .

LI P D . Design and implementation of performance testing system based on netty framework [D ] . Beijing : Beijing University of Posts and Telecommunications , 2019 .

ABBAS R , SULTAN Z , BHATTI S N . Comparative analysis of automated load testing tools: Apache JMeter, Microsoft Visual Studio (TFS), LoadRunner, Siege [C ] // Proceedings of the 2017 International Conference on Communication Technologies (ComTech) . Piscataway : IEEE Press , 2017 : 39 - 44 .

MOLYNEAUX I . The art of application performance testing-help for programmers and quality assurance [M ] . Nanjing : Southeast University Press , 2009 .

HUERTA-GUEVARA O , AYALA-RIVERA V , MURPHY L , et al . DYNAMOJM: A JMeter tool for performance testing using dynamic workload adaptation [M ] . Cham : Springer International Publishing , 2019 : 234 - 241 .

JMeter socure [EB ] . 2024 .

郑龙 . 多线程锁同步运行时特征分析与调优机制研究 [D ] . 武汉 : 华中科技大学 , 2016 .

ZHENG L . The characteristic analysis and runtime optimization of lock synchronizations in the multithreaded programs [D ] . Wuhan : Huazhong University of Science and Technology , 2016 .

刘书健 . 基于协程的高并发的分析与研究 [D ] . 昆明 : 昆明理工大学 , 2016 .

LIU S J . Analysis and research on high concurrency based on ctrip [D ] . Kunming : Kunming University of Science and Technology , 2016 .

丁燎原 . 基于协程的Web服务器原型的设计与实现 [D ] . 大连 : 大连理工大学 , 2018 .

DING L Y . Design and implementation of Web server prototype based on coroutine [D ] . Dalian : Dalian University of Technology , 2018 .

折波 , 王强 , 董凡 , 等 . IP网络流量资源共享系统设计与实现 [J ] . 深圳大学学报(理工版) , 2020 , 37 ( S1 ): 118 - 127 .

ZHE B , WANG Q , DONG F , et al . Design and implementation of IP network traffic resource sharing system [J ] . Journal of Shenzhen University (Science and Engineering) , 2020 , 37 ( S1 ): 118 - 127 .

阿里巴巴集团控股有限公司 . 一种测试用的压力生成方法及装置 : CN102955721A [P ] . 2013-03-06 .

Alibaba Group Holdings Limited . A pressure generation method and device for testing : CN102955721A [P ] . 2013-03-06 .

HOARE C A R . Communicating sequential processes [J ] . Communications of the ACM , 1978 , 21 ( 8 ): 666 - 677 .

王明松 , 于营 , 秦永佩 . 基于协程(goroutine)的并发编程模型及应用 [J ] . 电子质量 , 2022 ( 6 ): 95 - 98 .

WANG M S , YU Y , QIN Y P . Concurrency programming model and application based on goroutine [J ] . Electronics Quality , 2022 ( 6 ): 95 - 98 .

李文塔 . Go语言核心编程 [M ] . 北京 : 电子工业出版社 , 2018 .

LI W T . Go language core programming [M ] . Beijing : Publishing House of Electronics Industry , 2018

天翼数字生活科技有限公司 . 服务器的元数据修复方法、装置、系统和计算机设备 : CN110262926B [P ] . 2021-10-08 .

E-Surfing Digital Life Technology Co., Ltd . Method , device , system, and computer equipment for repairing server metadata: CN110262926B [P ] . 2021-10-08 .

天翼数字生活科技有限公司 . 数据分析方法、系统、装置、计算机设备和存储介质 : ZL20191 1147117.1 [P ] . 2019-11(2023-09) .

E-Surfing Digital Life Technology Co., Ltd . Data analysis methods , systems , devices, computer equipment , and storage media: ZL20191 1147117.1 [P ] . 2019-11(2023-09) .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Performance emulation and test for 5G massive MIMO base station

Research on Limitation of Snake Flow Test in Routers' Performance Test

Related Author

Xiaolong LIU

Guiming WEI

Xiang ZHANG

Yuxin REN

Jiamo JIANG

Liang Guo

Subin Wang

Junqi Zhao

Related Institution

Guangdong Research Institute of China Telecom Co.,Ltd.

Spirent Comunications Technology Beijing Co., Ltd.

⁰