Program Committee Meetings Considered Harmful Robbert van Renesse Cornell University.

Slides:



Advertisements
Similar presentations
Two Issues Concerning Research Conferences Dave Patterson October 2004.
Advertisements

1 What Makes a Good Paper? Anja Feldmann Deutsche Telekom Laboratories TU-Berlin, Germany.
Final year projects – trying to keep everyone happy Dr John Maskall School of Geography, Earth and Environmental Sciences University of Plymouth.
We are Under Attack. We are Under Attack By the Least Publishable Unit.
Some first observations & lessons learned by Klaus Hüfner, Audit Coordinator of the IREG Ranking Audit and Carla van Cauwenberghe, Dutch Inspectorate of.
Stručná informace o ICDM Jan Rauch. 2 IEEE International Conference on Data Mining
Session B Wrap-up Summary and Commentary Roman Barták Charles University (Czech Republic)
Scaling Internet Research Publication Processes to Internet Scale Jon Crowcroft University of Cambridge S. Keshav University of Waterloo Nick McKeown Stanford.
AVUTA BUDGET TIMELINE 10 FEB :00 PM DISTRICT CONFERENCE ROOM A AVUTA BUDGET MEETING PURPOSE- DEVELOP INITIAL BUDGET ATTENDEES: * EXECUTIVE BOARD.
Selected Results from the Robert Noyce Teacher Scholarship Program Evaluation Frances Lawrenz Christina Madsen University of Minnesota.
Decision Making. Learning Goals Managers constantly engaged with issues that have no optimal answers. How do you make these decisions. Help to prepare.
Reshef Meir Jeff Rosenschein Hebrew University of Jerusalem, Israel Maria Polukarov Nick Jennings University of Southampton, United Kingdom COMSOC 2010,
Bieber et al., NJIT © Slide 1 Excelling as a Ph.D. Student Michael Bieber Information Systems Department College of Computing Sciences New Jersey.
Reshef Meir School of Computer Science and Engineering Hebrew University, Jerusalem, Israel Joint work with Maria Polukarov, Jeffery S. Rosenschein and.
HSS Student-Faculty Conference Presentation April 5 th, 2008.
Combining Keyword Search and Forms for Ad Hoc Querying of Databases Eric Chu, Akanksha Baid, Xiaoyong Chai, AnHai Doan, Jeffrey Naughton University of.
Would you like to be able to do some or all of your study from home over the internet rather than come to class every day? Why?/Why not? Are distance learning.
OPENING SPEECHES. Opening Speech: what is it?  Beginning of formal debate (Speaker’s List)  A summary of your position paper!  Your country’s basic.
2008 SSO:USA Society for the Study of Occupation : USA Member Survey.
How to obtain funds from IEEE Foundation The IEEE Foundation Grants Program Antonio C. Bastos, 2011 Vice President, Grants Regional Meeting April 6 – 9,
Advance and the Electronic Packet Advance and the Electronic Packet April 5,
Weighted Grades Committee Recommendation Presented to Boonville R-I Board of Education March 19, 2014.
Key concepts the creative problem solving process Problem Finding Preparation Incubation Illumination and Idea Generation Evaluation This process can take.
IEEE Power Electronics Society Long Range Planning Report Tom Habetler Chair, Long Range Planning Committee PELS Meeting Series – APEC 2013, Long Beach.
Letter of intent By to predefined format (Word file, see guidelines) Chair Scientific Committee Coordination EO To all members of.
By Christopher Webber. Introduction Going green when it comes to your printing needs is simple and easy. Use recycled paper. Use Cheaper plant based toners.
THE ART OF DEBATE. What is debate?  A debate is a discussion between sides with different views.  Persons speak for or against something before making.
ASPLOS 2015 Debate Onur Mutlu
BE Awards Submission Process The following slides outline the 2008 BE Awards online submission Online submissions only – hardcopy not available Participation.
1 Applying Collaborative Filtering Techniques to Movie Search for Better Ranking and Browsing Seung-Taek Park and David M. Pennock (ACM SIGKDD 2007)
4) It is a measure of semi-independence and your PI may treat you differently since your fellowship will be providing salary support. 2) Fellowship support.
Apropos Climate Change: Related Aspects of Teacher’s Development Interactive part of the workshop.
CloudCom 2010 Program  Over 250 submissions from 41 countries  48 main conference papers (less than 25% acceptance rate)  23 work in progress papers.
IEEE-SA myBallot TM myBallot ™ IEEE Standards Association New Electronic Balloting System Sponsor Tools.
Faculty Senate Survey 11/7/ How committed are you to adopting/adhering to the teacher scholar model in your own professional performance? Not committed.
Certificate in Employability Skills EL3
Jeff Waddoups Chair, Sabbatical Leave Committee Department of Economics
Question Wording Pierre-Auguste Renoir: The Ball at the Moulin de la Galette (1876)
ACL-IJCNLP-09 General Chair Report Keh-Yih Su August 2nd, Singapore.
ACCREDITATION, SELF-STUDIES, AND FACULTY ROLES
District Conference Awards. Documents Letter Rotary District 7570 Awards Awards Application Award Criteria Award Evaluation Form.
Developed by University of Missouri community development specialists Larry Dickerson, John Gulick, Connie Mefford, and Georgia Stuart-Simmons Build Your.
Massachusetts Association of Realtors - Leadership Conference Presented By: Roger Turcotte, CBR, DREI, GRI.
Micro 2012 Lightning Session Onur Mutlu PC Chair December 3, 2012 Vancouver, BC, Canada.
1 Thoughts on how to improve reviews Paul Francis (Presented by Robbert Van Renesse) Cornell.
Presidents & Governors Forum September 22-23, 2013 ASCE Headquarters Reston VA Utilize Governors John Frauenhoffer, P.E., S.E., M.ASCE Region 3 Director.
Musical Links Investigation Criteria for writing, formatting, developing, and revising.
Group Definition  A group is a collection of two or more people who work with one another regularly to achieve common goals.  Groups: Help organizations.
GA Voting Session Explained. Who Can Vote Voting members include: All nationally recognised projects All branches Priority campaigns Non-priority campaigns.
Silver Wars C/ Cornay. Overview What it is? How it works Winning prize Summary Questions.
Membership Committee Activity: Annual Summary. Membership Committee Report Bi-monthly meetings with supplemental work sessions as necessary Bi-monthly.
What is an editorial? Where have you seen examples of editorials before? What are some qualities of a well-written editorial? Please respond to the following.
Relay for Life May FUNDRAISING! This is the most important part of Relay! – The money goes to research to save lives, programs to help patients.
ESP: Scholarships, Grants and Recognition Graham Cochran, Chair Beth Claypoole, Committee Member Bob Ohlensehlen, Exec Dir.
Be it on someone’s birthday, anniversary, housewarming, farewell, baby shower, wedding or any other occasion, on the portal you will get awesome selections to order online personalized gifts from Giftalove.com.
IEEE TCRTS Survey for Conference Planning
How to manage papers and submit reviews as a PC Member/Reviewer
Bell work question: What conflicts do you think might exist between large and small states? Why?
Peer Reviewing Sergej Sizov.
MGT 312 RANK Education for Service-- mgt312rank.com.
Spearman Rank Order Correlation Example
Portfolio for Tenure & Promotion
أنماط الإدارة المدرسية وتفويض السلطة الدكتور أشرف الصايغ
The Legislative Process
Decision Making.
Welcome to PLOS 2011! Sixth Workshop on Programming Languages and Operating Systems Cascais, Portugal October 23, 2011.
№96 сонли умумий ўрта мактабининг ўқитувчиси Эшанкулова феруза
Simulation of the plenary session
Review of Protocols for ACI Reports
CPSC 699 Fall 2014 PubliCATIONS.
Presentation transcript:

Program Committee Meetings Considered Harmful Robbert van Renesse Cornell University

Bad things about PC meetings Sometimes unproductive meeting dynamics –Overly assertive PC members –Waves of negativity Skewed representation –For many too much travel for one-day meeting

Harm to the environment

Time and money? In two days, a PC could generate – additional reviews, or –Small group on-line discussion + review summary for each paper (a la NSF) Travel money saved could send more students to conference

Alternative Two or three PC chairs PC committee scores papers –On-line discussions for controversial papers initiated by PC chairs PC chairs come up with ranking function and select highest ranked papers One opportunity for PC members to disagree with selection (perhaps)

Evaluation 150 submissions 25 papers to accept 100 experiments Equipment: –Powerbook G4 –Mac OS X

Which works better: ranking or voting?

Conclusion Does anyone strongly believe that a PC meeting improves the quality of the reviewing process sufficiently to offset the disadvantages I have presented?