First in the World (FITW) Program Validation Competition Webinar May 15, 2015

2 Disclaimer The purpose of this webinar is to provide information about the Validation competition in the FITW program. The webinar provides the U.S. Department of Education’s interpretation of various statutory provisions and does not impose any requirements beyond those included in the FITW notice inviting applications (NIA) for the 2015 grant competition; and other applicable laws and regulations. In addition, it does not create or confer any rights for or on any person. Do not rely solely on the information in this webinar. Please refer to the NIA published in the Federal Register for additional information. This is the official document governing the competition. T he application package is in

General Information A Frequently Asked Questions (FAQ) document is on the FITW Web site: The FITW staff is unable to address applicant specific questions at any time during the competition. There will be a webinar on evidence standards on May 19, 2015 at 3:00 p.m., Washington DC time. 3

The FITW Program (2015) Development competition—pilot and test strategies for meeting postsecondary challenges Validation competition—replicate tested strategies across multiple entities in postsecondary education These competitions have separate NIAs and application packages. 4

Purpose of FITW Part of a national agenda to lead the world in proportion of citizens with postsecondary degrees, credentials, and certifications Focus on high-need students for persistence and completion Focus on evaluation based on published evidence standa Establish a database of proven, effective practices 5

Dates to Remember May 11, 2015 application period opens Development webinar May 14, Validation webinar May 16, Evidence webinar May 19 June 30, 2015 at 4:30:00 application period closes July 1 – September 30 review of proposals September 30, 2015 FITW awards announced October 1, 2015 grant period begins 6

Cautions from 2014 Submit early—The deadline is June 30, 2015, 4:30:00 p.m. Register for SAM in time--can take up to two weeks to complete. It takes hours to activate in Grants.gov Write clearly—Peer reviewers have only your writing as a basis for scoring Understand eligibility—Applications are ineligible if they do not meet all program requirements READ THE NIA AND FAQs. UNDERSTAND THE REQUIREMENTS. PLAN AHEAD. 7

Validation Competition Profile Central purpose is replication of tested and validated strategies and practices Central structure is broad-based and far-ranging partnerships. See the definition in the NIA. Focus on large numbers of high-need students within the partnerships. See the definition in the NIA. Based on defined and separate evidence standards for eligibility and for end results 8

9 Validation Competition Profile Total appropriation for Development and Validation is $60,000,000 with up to $16,000,000 set aside for MSIs Validation Competition: 0-5 awards Estimated Range: $6,000,000 - $10,000,000 (budgets may not exceed range cap but may be below estimated range)

Validation Competition Profile Four Absolute Priorities—select one for project focus Four Selection Criteria Four-year grant period. Forward funded. Each year is October 1 - September 30 Validation competition is an evidence-based competition Evidence Standard for Eligibility Evidence Standard for Evaluation Design 10

Key Requirements Address one absolute priority Focus on large numbers of “high-need” students Large scale partnerships Independent and external evaluation “Up Front” Applications for a Validation grant must be supported by at least one study that meets the What Works Clearinghouse Moderate Evidence of Effectiveness with or without reservations “Back End” Project evaluation for a Validation grant must be designed and implemented to see how well it would meet the “Moderate Evidence of Effectiveness” without reservations 11

Key Requirements All eligible Applicants must replicate strategies or interventions that focus in “high-need” students High-need students means a student at risk of educational failure or otherwise in need of special assistance and support such as adult learners, working students, part-time students, students from low income backgrounds, students of color, first-generation students, students with disabilities, and students who are English learners. Note: To be eligible for a Validation grant, an applicant must identify how the proposed project serves high-need students. The definition provides examples of such students but is not an inclusive list. Applicants must identify how their project serves high-need students 12

First? Read! Notice Inviting Applications (NIA) in Federal Register and on FIPSE Web site Download application package in Grants.gov (84.116X) FAQs on FIPSE Web site 13

Who is eligible? FIPSE statute: “Institutions of higher education, combinations of such institutions, and other public and private non-profit institutions and agencies” FITW is a limited submission program 1. Only Validation applications are eligible for a Validation award 2. Applicants may submit only one FITW application in 2015 (Development or Validation but not one application in both) Development grantees may not apply for 2015 Development competition but may apply for 2015 Validation competition. 14

MSI Eligibility 1/2 Applicants applying for MSI eligibility must indicate MSI status request on the “Abstract and Information Page.” Institutions qualify as an MSI if they meet one of the following conditions: 1)Have participated in the FY 2014 designation of eligibility process and received an approval letter to apply for grant programs under Title III and Title V; 2)Have an open grant under one of the Department’s Title III or Title V programs; or 3)Have been designated as an HBCU or a Tribally Controlled College or University. 15

MSI Eligibility 2/2 If an applicant does not meet any of the criteria in the previous slide, IPEDS data will be used to determine the proportion of minority students served. In some cases, applicants must also meet the needy student and E&G expenditure requirements. For more information see the Eligibility section in the application package. Eligibility for an MSI application is determined solely by the status of the lead institution. 16

Questions? 17

18 Absolute Priorities (focus on “high need” students) Improving Success in Developmental Education Courses Improving Teaching and Learning Improving Student Services Influencing the Development of Non-cognitive Factors

Selection Criteria The project narrative should be organized in four labeled sections that correspond and follow the order of the four selection criteria. Each selection criterion includes up to four sub-criteria factors. Reviewers use these criteria to assign points and ratings to the applications. The maximum score that any applicant may receive on the four selection criteria is 100 points. The page limit for addressing these four criteria is

Significance (up to 20 points) Focus should be on tested and effective strategies as a basis for replication Focus on how successful replication can lead to even wider dissemination Focus on successful replication in different settings 20

Project Design (up to 30 points) Is the design of the project based on valid and published studies? Are the core components of the studies similar to the core components of the project? Are modifications explained? How will be project continue after the grant period? 21

22 Adequacy of Resources (up to 20 points) Describe the specific resources related to the successful implementation of the project such as facilities, equipment, and supplies. Letters of support must be submitted to demonstrate the institutional level of commitment to the project. Requested funds should be reasonable and support activities directly related to control and comparison groups. Peer reviewers will evaluate the qualifications of the project director. This should not be a placeholder for someone hired later.

Quality of Project Evaluation (up to 30 points) Make sure that every project goal and objective is specified and measurable Describe how the evaluation design and implementation will implement the evidence standard of Moderate Evidence of Effectiveness without reservation. Evaluation experts will review the qualifications of the evaluator in designing and conducting studies that meet What Works Clearinghouse evidence standards. 23

Review Process Single stage review Content reviewers score only selection criteria 1, 2, and 3 (Significance, Project Design, and Resources) Reviewers with expertise in evaluation score only selection criterion 4 (Evaluation) A rank order of all applications will be developed based on the raw scores of peer reviewer evaluations 24

25 Review Process Peer reviewers will review and score applications against the established selection criteria. Reviewers will be selected from the pool of individuals from ED’s G5 Grants Management System (G5). Peer reviewers will come from varied postsecondary backgrounds and professions, including college and university educators, researchers, and others with evaluation expertise. All reviewers will be thoroughly screened for conflicts of interest to ensure a fair and competitive review process.

Budget Budgets should reflect the scale and scope of the project. Budgets may not exceed estimated range of $6-$10 million. Budgets may be lower than estimated range. Budgets will be evaluated twice. First, peer reviewers will assess for relevance and appropriateness. Second, FITW staff will review budgets to ensure that proposed costs are reasonable and allowable. Budgets must use ED standard form 524 and a budget narrative that includes costs and justification of costs. 26

Budget No cost share or matching funds. The indirect cost rate is 8 percent. Program Specific Instructions. Scholarships and all forms of student financial assistance are not an allowable cost. For detailed information see the FAQs on the FITW website and the program specific budget instructions in the application package. Contact FITW staff if you have questions about allowable costs. General Cost Principles. Information about general cost principles are in EDGAR, ( and in the cost principles contained in CFR (formerly Office of Management and Budget (OMB) Circular: A-21 for institutions of higher education ( vol1-part220/content-detail.html). vol1-part220/content-detail.html 27

Application Checklist  Application for Federal Assistance (SF 424)  Department of Education Supplemental Information for SF 424  Budget Summary (ED Form 524)  Abstract and Information Page  Project Narrative Form Responses to the Selection Criteria –Significance –Quality of the Project Design –Quality of Project Personnel –Quality of the Project Evaluation  Other Attachments Form –Project director resume –Key personnel resumes –Evaluator resume –Letters of commitment –Budget narrative form  Assurances/Certifications –GEPA Section 427 –Assurances – Non-Construction Programs (SF 424B) –Certification Regarding Lobbying (formerly ED form) –Disclosure of Lobbying Activities (SF-LLL) 28

29 Grants.gov Electronic submission required through grants.gov unless you have a waiver. The application uploading process is time consuming. Please submit your application several days before the closing date. On grants.gov homepage, go to the “Apply for Grants” link. Use the search engine and type in “First in the World.” If you are experiencing problems submitting your application through Grants.gov, please contact the Grants.gov Support Desk, toll free, at You must obtain a Grants.gov Support Desk case number and keep a record of it. You can also contact them via at

30 Registering for SAM.gov Submitting an application in Grants.gov, requires registration in the System for Award Management (SAM). The SAM registration process can take approximately seven business days, but may take upwards of several weeks, depending on the completeness and accuracy of the data entered into the SAM database. Allow sufficient time to obtain and register your DUNS number and TIN. Information about SAM is available at To further assist you with obtaining and registering your DUNS number and TIN in SAM or updating your existing SAM account, the Department prepared a SAM.gov tip sheet at faqs.htmlwww.sam.govhttp://www2.ed.gov/fund/grant/apply/sam- faqs.html

Resources FIPSE/First in the World Web site: Notice Inviting Applications: for-new-awards-first-in-the-world-program-validation-grants for-new-awards-first-in-the-world-program-validation-grants Application Package: Keyword = first in the worldhttp:// FAQs: Questions about the FITW Validation competition: 31

Contact Information Frank Frankfort, Validation Gary Thomas, Development Sarah Beaton Kelly Harris

Questions? 33