posted by system || 1485 views || tracked by 6 users: [display]

EMP 2014 : First International Workshop - Empirical 2014

FacebookTwitterLinkedInGoogle

Link: http://2014.empirical-ws.org
 
When May 26, 2014 - May 26, 2014
Where Crete, Greece
Submission Deadline Mar 6, 2014
Categories    semantic web
 

Call For Papers

The Empirical 2014 workshop is a half-day workshop that will open the Extended Semantic Web Conference 2014 and seeks to gather people from all fields to work together to enhance our evaluation methodology. Please see the Call for Papers.

Statistical inference using hypothesis-testing methods is not commonly used to support empirical results reported in the Semantic Web literature. Thus, given the impact that these statistical methods may have on different domains, attendees may see the workshop as a venue to discuss the applicability of these methods in their current studies. Trivial use of hypothesis testing is not in the scope of the workshop. The primary focus, as will be detailed in the call for papers, is on statistical methods to evaluate assertions on performance of complex systems. Hitherto, the focus of the community has been on benchmarking. Currently, it suffers from several problems, e.g., lack of summary statistics, no hypothesis tests, no structured approach to control of experiments, oversimplification of the benchmark in face of complex problems, etc.

Topics to be included (not limited):

Foundations of hypothesis formulation: triangularization, common constructs in the Semantic Web (e.g., performance, completeness) and their validity, typical operationalizations, and quantifiability.
Statistical methods to demonstrate significance and levels of confidence of experimental studies on Semantic Web technologies and empirical results.
Experimental methodologies to design reproducible experimental studies in the context of Semantic Web technologies.
Critical examinations of assumptions inherent in statistical practices in Semantic Web research (e.g., assuming normal distribution of populations).
Limitations of existing statistical methods on empirical studies of Big Data.
Statistical techniques to analyze benchmarks.

Related Resources

EMNLP 2018   2018 Conference on Empirical Methods in Natural Language Processing
WI 2018   2018 IEEE/WIC/ACM International Conference on Web Intelligence
ESEM 2018   Empirical Software Engineering and Measurement
KEOD 2018   10th International Conference on Knowledge Engineering and Ontology Development
ECSA 2018   CFP: 12th European Conference on Software Architecture
ACM MEDES - SCADE 2018   10th ACM MEDES Conference - special track on Soft Computing & Applications in Digital Ecosystems (SCADE'18)
SWQD 2019   Software Quality Days 2019
OnTheMove 2018   ▶ CFP: OntheMove Federated Conferences 2018, Valletta, Malta, 22-26 October 2018
WSESE@ICSE2018   1st International Workshop on Methodological Issues with Empirical Studies involving Human Subjects - An ICSE2018 Workshop
CESI@ICSE 2018   6th International Workshop on Conducting Empirical Studies in Industry