NISE Network Evaluation: What We’ve Learned and Where We’re Headed Network-Wide Meeting December 2012.

Slides:



Advertisements
Similar presentations
School of Medicine FACULTY OF MEDICINE AND HEALTH Does interprofessional education and working have any impact on perceptions of professional identity.
Advertisements

Dr Linda Allin Division of Sport Sciences The value of real life evaluation research for student learning and employability in Sports Development.
Community Engagement. ISLE Vision for the Future - Examples Connect to mentors. Find student organizations. Find challenges. Connect to project management.
Creating a Culture of Assessment in Financial Aid Erika M. Cox Associate Director, Student Financial Aid and Enrollment Services University of Texas at.
Intro. Website Purposes  Provide templates and resources for developing early childhood interagency agreements and collaborative procedures among multiple.
Focus on Instructional Support
Evaluation What, How and Why Bother?.
Best Start Conference January Peel Health Great Beginnings Initiative  In 1999, McCain and Mustard’s Early Years Study documented the importance.
Bilingual NanoDays y Más: Tools and strategies to start, or enrich, your bilingual programs
Developing Programs to Reach Bilingual Audiences.
An Overview of the NISE Network Presentation Overview NISE Network Network Community Educational Products Get More Involved.
THE ADVANCED TECHNOLOGY ENVIRONMENTAL AND ENERGY CENTER (ATEEC) Summative External Evaluation July 1, 2013 – June 30, 2014 PRELIMINARY OUTLINE.
Teacher Professional Development Network-Wide Meeting December 2012.
Across the Arctic, Teachers Experience Field Research Janet Warburton Arctic Research Consortium of the U.S. Steve Marshall King’s Fork High School Dennis.
Reflective practice Session 4 – Working together.
Assessment Activities and Plans Daniel Knight July 21, 2014.
Welcome What’s a pilot?. What’s the purpose of the pilot? Support teachers and administrators with the new evaluation system as we learn together about.
Local Evaluation Overview and Preliminary Findings Diane Schilder, EdD.
An Overview of the NISE Network Reviewers said... The NISE net has done an impressive job the first five years of building a large core.
NanoDays! JUNE 2015 NETWORK-WIDE MEETING NISENET.ORG.
Communication Degree Program Outcomes
COMMUNITY OF PRACTICE SESSION STEM Education: Communication Tools and Collaboration Opportunities May 20, /20/11Superintendents Community of Practice.
A comparison of two methods of synchronous (real time) interaction in distance learning Jane Montague University of Derby
Evaluation & Research What We’ve Learned About NISE Net’s Effects on the Public Marjorie Bequette, Chair NISENET.ORG.
Student Learning Outcomes: Interpretations, Validity, and Factor Development Krista Soria and Laura Gorny This project was funded by the Undergraduate.
SPDG Day Presentation July 18, 2011 Cynthia Glimpse Technical Assistance Coordination Center.
Museum and Community Partnerships.
School Leadership Module Preview This PowerPoint provides a sample of School Leadership Module PowerPoint. The actual Overview PowerPoint is 73 slides.
Team-Based Inquiry ASTC Preconference Workshop, October 18
An Overview of the NISE Network Presentation Overview NISE Network Network Community Educational Products Evaluation and Research.
UW MRSEC Interdisciplinary Education Group Utilizes Museum Partnership to Increase Dissemination of Educational Materials Juan J. De Pablo, University.
Engaging the Public in Conversations about Nanotechnology & Society Network-Wide Meeting December 2012.
Planning a Museum & Community Partnership Project Brown-Bag Workshop | Wednesday, September 30, Welcome (Kayla Berry) 2.Introduction (Rae Ostman)
Small footprint exhibitions. Overview 1.Nano small footprint exhibition 2.Possible future directions 3.Discussion.
A System Wide Look at Professional Development Opportunities for Afterschool Professionals Afterschool in Oregon: Professional Development.
November 1, 2012 Professional Development Pathways for the Future of Science TnSELA Annual Conference.
The Iowa Distance Mentoring Model (DMM) for Early ACCESS promotes the systematic implementation of family guided routines based intervention (FGRBI) for.
Learning Focused Observations BEST Leadership Roundtable February 1 st, 2012.
School Improvement Partnership Programme: Summary of interim findings March 2014.
Connecting the dots from “Hand Outs” to Research- based Pedagogy: the SERC Pedagogic Service Sean Fox, Ellen Iverson, Cathy Manduca Science Education Resource.
Science Case Network Welcome RCN-UBE Project #
Fabrication. Fabrication in 5 easy steps: 1.Choosing vendors 2.Ordering materials 3.Fabricating materials 4.Packing materials 5.Shipping materials.
Engaging Visitors in Nanotechnology & Society
Science Bulletins A model for sharing current scientific visualizations with Informal Science Institutions NOAA SoS Workshop Jan 22 – 24, 2007.
NanoDays nisenet.org. Presentation Overview Intro to NanoDays NanoDays nationwide Our NanoDays event Engaging the public in nano What is nano? NanoDays.
Association of Muslim Schools UK INSET Day November 2009.
District Leadership Module Preview This PowerPoint provides a sample of the District Leadership Module PowerPoint. The actual Overview PowerPoint is 73.
Team-Based Inquiry Making Evaluative Thinking Part of Your Work Network-Wide Meeting December 2012.
Please take one copy of the photograph and the analysis tool to your seat.
The Middle Years Programme. Middle Years Programme is for students between the ages of 11 and 16 is for students between the ages of 11 and 16 helps develop.
Teacher Refresher Course Professional Learning Program Program 1 Learning Leaders: Jill Flack Maureen O’Rourke.
Urban Mathematics Education Leadership Academy Session 2 May , 2009 Irving, TX.
BUILDING COLLABORATIONS NISE Net’s educational materials are designed to engage a wide range of audiences in learning about complex scientific content—in.
ATP Meeting September 18, Overview Key components of the 2016 Plan Public Participation Plan Discussion.
Standards for Student Learning Standard 1: The student who is information literate accesses information efficiently and effectively. Standard 2: The student.
Creative Curriculum and GOLD Assessment: Early Childhood Competency Based Evaluation System By Carol Bottom.
Highland Community School District Instructional Rounds October 15, 2009.
MY TIME, OUR PLACE Framework for School Age Care In Australia Prepared by: Children’s Services Central April 2012 Team Meeting Package.
Investing in Innovations: Investing in Innovations: Implementing Virtual Classroom Observations in Project ELLA-V Dr. Rafael Lara-Alecio Dr. Beverly Irby.
Youth in Focus. Young people’s voices “ money issues are a key thing for me” “the right kind of support is really important to me” “ forming relationships.
The Big Interview Amy Fouts EDU 650 Teaching, Learning, and Leading in the 21 st Century Instructor Richard Newman.
Hello scientists! In the past your school has helped me solve many a problem. Now I have a new one for you! Could you could get your heads together and.
Earth Educators’ Rendezvous Workshop Leader Webinar Introduction Workshop Design Best Practices Utilizing the Web Tools Evaluation Instruments David McConnell,
CREATING A SOCIAL STUDIES CLASSROOM
Big Ideas & Problem Solving A look at Problem Solving in the Primary Classroom Lindsay McManus.
Reading & Writing to Succeed on the EAS
Universal Design Workshop July 30-31, 2013
STEM Ambassadors – an overview
Working Together WORKSHOP 4
Nanotechnology & Society
Presentation transcript:

NISE Network Evaluation: What We’ve Learned and Where We’re Headed Network-Wide Meeting December 2012

Presenters Elizabeth Kunz Kollmann, Museum of Science, Boston, Juli Goss, Museum of Science, Boston, Liz Rosino, Oregon Museum of Science and Industry, Gina Svarovsky, Science Museum of Minnesota,

NISE Network Evaluation Team Composed of evaluators from: Museum of Science, Boston Oregon Museum of Science and Industry Science Museum of Minnesota

Evaluation Team Structure Summative Evaluation Professional Impacts Public Impacts Formative Evaluation Team-Based Inquiry Annual Partner Survey / Data Mining

Network Communication Study

6 Study purpose and focus A study of communication within and between the tiers… Because this is a network, studying communication highlights the ideas holding us all together.

7 Study purpose and focus 4 primary communication components: NanoDaysRegional hub structure Face-to-face meetings nisenet.org

8 Methods -Total of 24 professionals Broad Reach Partners TIER 3 Core Partners TIER 1 Nano-infused Partners TIER 2 Tier 1 -7 focus groups with 3-4 people each

9 Methods -All participants considered “actively engaged” -Various museum types, sizes, and geographic region Broad Reach Partners TIER 3 Core Partners TIER 1 Nano-infused Partners TIER 2 Tiers 2 & individual interviews

10 Findings The communication that happens through various Network components

11 NanoDays says…

12 NanoDays says… You can do Nano!

13 NanoDays says… You can do Nano! Nano is important!

14 NanoDays says… You can do Nano! Nano is important! Communication and dissemination of information is important!

15 Face-t0-face meetings say…

16 Face-t0-face meetings say… We are here for you!

17 Face-t0-face meetings say… We are here for you! You are part of a community!

18 Regional Hub Structure says…

19 Regional Hub Structure says… We are your go-to resource!

20 Regional Hub Structure says… We are your go-to resource! You are also part of a local community!

21 Regional Hub Structure says… We are your go-to resource! You are also part of a local community! Please contact us!

22 Nisenet.org website says…

23 Nisenet.org website says… You can do MORE nano!

24 Nisenet.org website says… You can do MORE nano! Here is a wealth of Network info and resources!

25 The Nano Bite and social networking says…

26 The Nano Bite and social networking says… We have some interesting and timely information for you!

Communication that Network partners desire Ideas, information, and practices that Network partners wished they heard more about. 27

How do I convey challenging content? I guess it’s the SEI stuff, the societal and ethical implication stuff… I think it’s a bigger question that the field is struggling with. What kind of information can we provide to the other partners to get them to feel comfortable with reaching out to diverse audiences? 28 Desired Communication

How are partners engaging the public in nano? I would love to be able to know or gauge partners’ interest… have we created things that they really want to use? One of the things that would be helpful for me, and I’m sure for other people, is to sort of have people’s experiences with these NanoDays kits and these activities somehow recorded. 29 Desired Communication

How can we communicate more? I wish I knew more about the [NanoDays] evaluation, like what they’re finding out is more effective…. I’ve never heard them talk directly about the data that’s being collected. I would just like to have more , even if it’s just notices of new things coming out of whatever the national network is as well…maybe give me a menu of things to sign up for. 30 Desired Communication

Reflections 31 Directionality of NISE Network communication components

-NanoDays reports -Educational product evaluation -Network Communication Study Learn more about evaluation nisenet.org/catalog/eval

Learn more about evaluation Evaluation of educational products

Learn more about the Network Subscribe here! The Nano Bite nisenet.org/community/nanobite

Learning more about the Network Community nisenet.org/community -Find your Regional Hub leader and talk to a real person! -Use the social networking links to connect with others in your region!

Annual Partner Survey What was the purpose? Consolidate requests for information about partners Who did we want to hear from? 1,020 individuals considered ‘currently active’ in the Network How did we collect the data? Online survey in late October Who responded? 296 individuals from 199 organizations

Professional Impacts How does the Network impact professionals’… Community Learning Use 3 years Annual Partner Survey Interviews

Public Impact of the Nano exhibition

Nano mini-exhibition 400 sq. ft Seven core components and seating area 70 identical copies going to Network Partners

Evaluation of Nano Formative Evaluation main focus: provide feedback for improvement Do individual pieces work for visitors? Summative Evaluation main focus: measure impact What does the overall experience look like? What does visitor learning look like?

Summative evaluation: Context Five sites, variety of installations Science Museum of Minnesota Duluth Children’s Museum Science Spectrum (Lubbock, TX) Oregon Museum of Science & Industry Port Discovery (Baltimore, MD) Data collected observations surveys and interviews counting tallies

Data analysis General Visitors SMM (n=100) Duluth (n=103) Port Discovery (n=32) OMSI (n=25) Science Spectrum (n=16) General Visitors SMM (n=100) Duluth (n=103) Port Discovery (n=32) OMSI (n=25) Science Spectrum (n=16) Spanish-Bilingual Visitors OMSI (n=25) Science Spectrum (n=22) Spanish-Bilingual Visitors OMSI (n=25) Science Spectrum (n=22) Visitors with Disabilities Port Discovery Museum of Science Visitors with Disabilities Port Discovery Museum of Science

Early findings: Use

Visitors dig it! High visitor contact High dwell times

Early findings: Use Visitors dig it! High visitor contact High dwell times Visitor views of experience Interesting and enjoyable “interactive”, “family-friendly”, “Informative” emphasis on connection of nano to daily life

Early findings: Learning Visitors are learning! 60% report increase in confidence Similar proportions of increase across levels of prior nano knowledge

Early findings: Learning Visitors are learning! 60% report increase in confidence Similar proportions of increase across levels of prior nano knowledge NISE Net content map areas Visitor responses touched on all four areas of the content map Most common: connection to daily life This specific answer was more common that general responses about nano or science

Emerging differences group dwell times/visitor contact levels of interest & enjoyment changes in confidence Institutional comparisons

Spanish-bilingual comparisons prior nano knolwedge group dwell times slightly different confidence gains Spanish bilingual audience

Further analysis and next steps Exploring other relationships between use and learning; demographic data Additional analysis of bilingual data Analysis of data from visitors with disabilities Additional estimates for number of visitors who come in contact with Nano Next Public Impacts study: Focus on NanoDays

Questions and Discussion?