BESE19: The 1st International Workshop on Benchmark Engineering for Software Engineering Sokos Hotel Viru Tallinn, Estonia, August 27, 2019 |
Conference website | https://psybers.github.io/bese/index.html |
Submission link | https://easychair.org/conferences/?conf=bese19 |
Submission deadline | June 7, 2019 |
In software engineering (SE) research, high-quality program benchmarks play an essential role in evaluating novel approaches. However, SE community lacks proper benchmark engineering (BE) practices. Similar to software engineering, BE should have guidelines for benchmark requirement, design, development and verification. Currently, the existing repositories have unsystematically addressed only the last two items. However, without benchmark requirements and design descriptions, it is difficult for a researcher to assess the benchmark's adequacy for an evaluation. With the advent of frameworks that obtain programs from software repositories, the need of identifying systematic BE processes is especially urgent.
The one-day BESE workshop aims to initiate a dialog on benchmark engineering processes through invited talks, presentations and open discussions on the following topics: the current state of benchmark availability and quality for different SE domains; guidelines for designing high-quality benchmarks; important benchmark features; and improving the usability of benchmarks. BESE solicits short and extended abstract papers outlining the needs of benchmark users, insights and experience from benchmark designers and creators. The workshop's outcome is forming a community of BE researchers.
Submission Guidelines
BESE 2019 invites contributions in the form of 4-page papers, for ideas in the early stages, from researchers and practitioners. Submissions can be research papers, practice papers, position papers, or experience reports. All submissions should describe unpublished work that has been neither previously accepted for publication nor is concurrently submitted for review in another journal, book, conference, or workshop. Submissions are peer-reviewed and accepted papers will appear in the workshop proceedings.
BESE 2019 also invites 2-page presentation abstracts from researchers and practitioners wishing to give a presentation on a topic related to the workshop. These abstracts will not be published. Presentations can be on proposed ideas, early stage research, or previously published topics related to the workshop.
Papers should be submitted electronically at: https://easychair.org/conferences/?conf=bese19
Submissions must follow the ESEC/FSE submission policies and be no more than 2 or 4 pages (including references).
NOTE: The official publication date is the date the proceedings are made available in the ACM Digital Library. This date may be up to two weeks prior to the first day of your conference. The official publication date affects the deadline for any patent filings related to published work. (For those rare conferences whose proceedings are published in the ACM Digital Library after the conference is over, the official publication date remains the first day of the conference.)
Committees
Program Committee
- Cristian Cadar, Imperial College London
- Robert Dyer, Bowling Green State University
- Michael Eichberg, Technische Universität Darmstadt
- Ben Hermann, Universität Paderborn
- Darko Marinov, University of Illinois at Urbana-Champaign
- Meiyappan Nagappan, University of Waterloo
- Chris Parnin, North Carolina State University
- Hridesh Rajan, Iowa State University
- Elena Sherman, Boise State University
Organizing committee
- Robert Dyer, Bowling Green State University
- Elena Sherman, Boise State University
Contact
Website:
https://psybers.github.io/bese/
Twitter:
@BESE_Workshop