{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T10:24:26Z","timestamp":1772792666103,"version":"3.50.1"},"reference-count":13,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2004,9,1]],"date-time":"2004-09-01T00:00:00Z","timestamp":1093996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[2004,9]]},"abstract":"<jats:p>This position paper aims at discussing a number of issues that typically arise when performing empirical studies with software testing techniques. Though some problems are general to all empirical disciplines, software testing studies face a number of specific challenges. Some of the main ones are discussed in sequence below.<\/jats:p>","DOI":"10.1145\/1022494.1022541","type":"journal-article","created":{"date-parts":[[2004,10,7]],"date-time":"2004-10-07T17:39:09Z","timestamp":1097170749000},"page":"1-3","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":33,"title":["Empirical studies of software testing techniques"],"prefix":"10.1145","volume":"29","author":[{"given":"Lionel","family":"Briand","sequence":"first","affiliation":[{"name":"Carleton University, Ottawa, Canada"}]},{"given":"Yvan","family":"Labiche","sequence":"additional","affiliation":[{"name":"Carleton University, Ottawa, Canada"}]}],"member":"320","published-online":{"date-parts":[[2004,9]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"269","volume-title":"13th IEEE International Symposium on Software Reliability Engineering (ISSRE'02)","author":"Antoniol G.","year":"2002","unstructured":"G. Antoniol , L. C. Briand , M. Di Penta and Y. Labiche, \"A Case Study Using the Round-Trip Strategy for State-Based Class Testing,\" Proc . 13th IEEE International Symposium on Software Reliability Engineering (ISSRE'02) , Annapolis (MD, USA), IEEE Computer Society , pp. 269 -- 279 , November 12-15, 2002 . G. Antoniol, L. C. Briand, M. Di Penta and Y. Labiche, \"A Case Study Using the Round-Trip Strategy for State-Based Class Testing,\" Proc. 13th IEEE International Symposium on Software Reliability Engineering (ISSRE'02), Annapolis (MD, USA), IEEE Computer Society, pp. 269--279, November 12-15, 2002."},{"key":"e_1_2_1_2_1","volume-title":"Edinburgh","author":"Briand L.","year":"2004","unstructured":"L. Briand , Y. Labiche and Y. Wang , \" Using Simulation to Empirically Investigate Test Coverage Criteria,\" Proc. (to appear) IEEE\/ACM International Conference on Software Engineering , Edinburgh , May , 2004 . L. Briand, Y. Labiche and Y. Wang, \"Using Simulation to Empirically Investigate Test Coverage Criteria,\" Proc. (to appear) IEEE\/ACM International Conference on Software Engineering, Edinburgh, May, 2004."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.520"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.910859"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1978.218136"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/367008.367020"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/257734.257766"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1965114"},{"key":"e_1_2_1_9_1","volume-title":"Net. ObjectDays","author":"Kim S.","year":"2000","unstructured":"S. Kim , J. A. Clark and J. A. McDermid , \" Class Mutation: Mutation Testing for Object-Oriented Programs,\" Proc . Net. ObjectDays , Erfurt, Germany , October 9-12, 2000 . S. Kim, J. A. Clark and J. A. McDermid, \"Class Mutation: Mutation Testing for Object-Oriented Programs,\" Proc. Net. ObjectDays, Erfurt, Germany, October 9-12, 2000."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.4380210704"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/125489.125473"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.241773"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-4625-2","volume-title":"Experimentation in Software Engineering - An Introduction","author":"Wohlin C.","year":"2000","unstructured":"C. Wohlin , P. Runeson , M. Host , M. C. Ohlsson , B. Regnell and A. Wesslen , Experimentation in Software Engineering - An Introduction , Kluwer , 2000 . C. Wohlin, P. Runeson, M. Host, M. C. Ohlsson, B. Regnell and A. Wesslen, Experimentation in Software Engineering - An Introduction, Kluwer, 2000."}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022541","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1022494.1022541","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:25Z","timestamp":1750282885000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1022494.1022541"}},"subtitle":["challenges, practical strategies, and future research"],"short-title":[],"issued":{"date-parts":[[2004,9]]},"references-count":13,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2004,9]]}},"alternative-id":["10.1145\/1022494.1022541"],"URL":"https:\/\/doi.org\/10.1145\/1022494.1022541","relation":{},"ISSN":["0163-5948"],"issn-type":[{"value":"0163-5948","type":"print"}],"subject":[],"published":{"date-parts":[[2004,9]]},"assertion":[{"value":"2004-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}