Current Situation Strong tradition going back to the 1980s (with very little changes even if community has exploded) Highly competitive/selective conferences.

Slides:



Advertisements
Similar presentations
Two Issues Concerning Research Conferences Dave Patterson October 2004.
Advertisements

1 What Makes a Good Paper? Anja Feldmann Deutsche Telekom Laboratories TU-Berlin, Germany.
Enlighten: Glasgows Universitys online institutional repository Morag Greig University Library.
QU Academic Promotion Policies Prof. Nitham M. Hindi November 26, 2008.
Some Do’s and Don’ts of Grant Writing Gord McCalla Department of Computer Science University of Saskatchewan Saskatoon.
Beyond The Numbers To Student Success. Rainey Knight, Ph.D Superintendent since 1999.
ALEXANDER RUTHERFORD SCHOLARSHIP
Strategies for Successful Journal Publications Rachael E. Goodhue University of California, Davis.
Writing a conference paper Lin Norton Faculty of Education Liverpool Hope University 14 March
Queensland University of Technology CRICOS No J How can a Repository Contribute to University Success? APSR - The Successful Repository June 29,
1 Quality Control in Scholarly Publishing. What are the Alternatives to Peer Review? William Y. Arms Cornell University.
P. Boyce 1 Use of Astronomy’s Info System : The Highly Productive User Peter B. Boyce Maria Mitchell Association and Past Executive Officer American Astronomical.
CPSC 699. Summary Refereeing is the foundation of academic word: it promotes equity, diversity, openness, free exchange of ideas, and drives the progress.
Responsible Conduct of Research, Scholarship, and Creative Activities Peer Review Responsible Conduct of Research, Scholarship, and Creative Activities.
Implementing the new Workload Policy Heads of School Workshop April 2010.
Calice Meeting DESY 13/2/07David Ward Guidelines for CALICE presentations Recently approved by the Steering Committee.
September1999 October 1999 ICML-03 Mini-Tutorial The Three R’s of Publishing Machine Learning Papers: Research, ‘Riting, and Reviews Marie desJardins Rob.
Reading the Literature
CS 152 & CS 154 Bill Crum, Lecturer Bill White, Instructional Coordinator Earth Chandrraungphen, Lab TA.
Committee Charges Identify and implement local actions in response to the scholarly communications issues raised by the committee. Consider actions that.
FISH 521 Peer review. Peer review Mechanics Advantages Challenges Solutions.
International publications in Sociology: what can we do (better)? Jaak Billiet CeSO & Central Coordination of ESS PhD seminar Dec
Publication Process Submitting and peer review. Overview Submit –Where to submit –How to submit Editor –Sends to Reviewers –Reads it themselves –Sends.
Research and Publication for Business and Management Researchers: The Way Forward Prof Dr T C Melewar Prof of Marketing and Strategy Brunel University,
Building Open Science Luis Ibáñez Kitware, Inc. The Insight Journal.
NIMAC for New EOTs: Everything You Wanted to Know About NIMAC but Were Afraid to Ask! November 2013 Nicole Gaines.
ACCESS TO UK RESEARCH OUTPUTS The developing RCUK position
CMPT 880/890 Reviewing. Outline What is peer review Why review? The review process Types of reviews How to review.
Database Publication Practices Surajit Chaudhuri Microsoft Research.
So you want to publish an article? The process of publishing scientific papers Williams lab meeting 14 Sept 2015.
Publishing Your Work Not a Question, But rather an Execution Who? Why? When? Where? How? รัตติกร ยิ้มนิรัญ สาขาวิชาฟิสิกส์ สำนักวิชา วิทยาศาสตร์ มหาวิทยาลัยเทคโนโลยีสุรนารี
Leadership Growth & Development Series Senior Cabinet Session 2.
1 How to review a paper by Fabio Crestani. 2 Disclaimer 4 There is no fixed mechanism for refereeing 4 There are simple rules that help transforming a.
Primoz Juznic, University of Ljubljana, Slovenia 1 Using a decision grid process to evaluate library collections on the way to post-print times Primoz.
Managing Opportunities Lori A. Clarke Department of Computer Science University of Massachusetts, Amherst.
Preparing for the renewal and tenure processes Bernard Robaire Department of Pharmacology and Therapeutics MAUT Tenure Workshop April 24, 2015 – Faculty.
The Role of TODS in Database Publishing and VLDB-to-SIGMOD Resubmission Christian S. Jensen With contributions from Richard T. Snodgrass.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA2 – Dissemination, Outreach and Communication.
Ratemaking Research Working Party Stewart Gleason, Ph.D., ACAS, ASA, MAAA CAS Research Initiatives Coordinator Senior Vice President Guy Carpenter & Company,
Geant4 Publication Procedures Geant4 Collaboration Meeting 23 September 2013 Dennis Wright (SLAC)
Open Archive Workshop, CERN th March 2001 Peer Review - the HEP View Mick Draper, CERN ETT Division
LAWRENCE P. KANE, PH.D. DEPT OF IMMUNOLOGY UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE PUBLISHING IN THE 21 ST CENTURY.
Publication Strategies Gregg Rothermel Professor and Jensen Chair of Software Engineering Department of Computer Science and Engineering University of.
Page 1 Plagiarism Concerns in IAS Manuscript Submissions March 2014
Heritage Science A New Journal Richard Brereton
The number of published articles has doubled over the past decade.
The peer-review process. The Peer-Review Process Refereeing Practices and Policies My focus will be on the situation at The Astrophysical Journal, but.
INFO 4990: Information Technology Research Methods Guide to the Research Literature Lecture by A. Fekete (based in part on materials by J. Davis and others)
Publication Etc.. Disclaimer This is a complex and emotional topic. – There are many facets of the problem. – Any “solution” will have good and bad points.
Scientific Peer Review Yixin Chen, Associate Professor Computer & Information Science University of Mississippi April 9, 2013.
Publishing Papers© Dr. Ayman Abdel-Hamid, CS5014, Fall CS5014 Research Methods in CS Dr. Ayman Abdel-Hamid Computer Science Department Virginia.
Scholarship Skills Andrew Black 1 Lecture 13 Conference Papers Andrew Black & Tim Sheard Portland State University.
Writing scientific papers and publishing your research 1) Writing a paper helps you identify missing information 2) Helps develop new ideas 3) Documents.
REPORTING YOUR PROJECT OUTCOMES HELEN MCBURNEY. PROGRAM FOR TODAY: Report Reporting to local colleagues Reporting to the Organisation Tips for abstract.
Reporting your Project Outcomes Helen McBurney. Program for today: Report Reporting to local colleagues Reporting to the Organisation Tips for abstract.
IEEE TCRTS Survey for Conference Planning
Overview of APEC project procedures
PROBLEM SOLVING June 2010 CANADIAN COAST GUARD AUXILIARY - PACIFIC.
How to write successfully for IATEFL Conference Selections
The importance of project management
Publication Strategies
CSC 682: Advanced Computer Security
Considerations in Engineering
The Process of Getting Published: Reviews and Rejection
Reading - How to read Fausto Giunchiglia Literature:
Writing an Honors Project Proposal
Writing scientific papers and publishing your research
Chapter 18: Submitting a paper
Tenure and CUNY Matt Brim and Shelly Eversley FFPP Academic Directors.
Computer Science Publications
Presentation transcript:

Current Situation Strong tradition going back to the 1980s (with very little changes even if community has exploded) Highly competitive/selective conferences Reviews by best qualified people High review load Same paper gets reviewed multiple times; often unmodified T ime pressure for both reviewers and authors

Limitations of current model Speed: conferences not very fast (6-7 months between submission and formal publication) other subjects have faster turn around times for journals journal very slow Reputation “only a conference paper” (problem in broader community) LNCS is exploding, so reputation is shrinking Citations in ISI only as proceedings (need to rely on Google Scholar and Microsoft Academic Search) Quality (full peer review of the proofs and details) few (10%) final versions appear in journals (too slow?) about 50% (?) has unreviewed full version on eprint we have multi-round refereeing but do not recognize this retractions/corrections to papers are never published officially Bandwidth limitation (hard to go beyond 45 papers) Complex multiple versions of all papers (e-print, IACR, Springer, Full Version, Journal Version) – sometimes double publish (conference/journal)

Results We are competing against physics, maths, chemistry, biology for funds, promotion and status Policy makers do not take us seriously, as we don’t take our own scientific process seriously Senior people find it hard to convince university management and funding agencies to support our work/people If we think proofs are important, we should referee them Or at least make presenting papers with invalid/no-proofs a high risk strategy for authors People with experience of fighting for Crypto against other subjects not in CS realizes we are fighting with one hand behind our back When we started, the current model made sense. We were young and child like. It’s Time To Grow Up!

A Solution Proceedings of the IACR Follows model of other learned societies This is a “journal” to replace LNCS, not to replace JoC The Proceedings would be full “Open Access” (Gold) Holds papers “submitted” to our conferences Multi-round refereeing (duration depends on length) No submission deadline: so no “deadline” rush Full papers are refereed and published The above is the basic idea, what follows are possible knock on consequences and implementation details.

Implications For Authors: You submit to journal at any time (VLDB model) Guaranteed first response in 2 months (Accept, Reject, Maybe) Would be longer for longer papers. Max time 4 months For Maybe’s you have 1 month to respond and make changes Final decision in another 2 months All acceptable papers are published Top papers are asked to present at either AC, EC or CR. Alternative all are presented at some meeting in the year Authors can “request” consideration for presentation at specific venue (cannot be guaranteed) A conference paper cannot be resubmitted in full version to JoC. Since the full version is already published

Implications For Referees A “PC” member (called referee below) is appointed for 2 years Instead of agreeing to referee 20 papers in 6 weeks, asked to referee (with sub-referees) over a period of 2 years 20 papers with a delay of 6 weeks (plus 2 weeks for discussion) A year’s PC is “run” by a committee of six co-chairs. To replicate our current AC, EC, CR PC chair model Each co-chair appoints a set of referees, who themselves appoint sub-referees (keep the pyramid structure) Alternative: pool of referees can be shared by all co-chairs Referees chosen to represent geographic and subject diversity Idea is to reduce reviewing burden

Implications For Conferences PC Chairs pick the papers for a conference of those which have been accepted in last 6 (or 12) months Or perhaps the committee of reviewers, or a subcommittee, or.... Taking into account Author preferences Diversity of Programme Which papers would make good talks Celebrate the best work Conferences become about exchanging ideas and learning Stop short talks which no one listens to and no one understands Encourage industry/government back into the fold

Knock On Questions Should PKC, TCC, FSE and CHES stick to their current conference/LNCS model? If not what happens to them? Would suspect CHES would probably continue due to industrial interest. Others workshops we are less sure about. Would they be rolled into the same model? Is this a problem? What about short papers, can we create a very fast turnaround ? e.g.a “Bulletin of the IACR” If we move to a journal model,what about anonymous submissions?

Why Now? Springer contract is up for renewal in four years. If we are to make a change in 2017, this impacts choice of PC chairs to be made in 2015 We need to set up software, negotiate agreements Need a decision by end of 2014 We need the community to discuss/understand any changes Register for the discussion forum on e-print NOW to get involved in the discussion.