1. Systems Integration and Data Management Presented By Greg Devine Director, Higher Education Blackboard Consulting April 14, 2005

2. Welcome Session Objectives: –Introduce 2-3 key points Innovation –Insert Results/Outcomes –Insert

3. An overview of the process, tools and operations For Blackboard Learning System™ (Release 6.2) Blackboard ® Snapshot Integration What Data = Which Files Snapshot Components Snapshot Tool –Modes, Operators, Syntax Data Sources and Data Source Keys Field Ownership Remote Snapshots Snapshot Controller

4. IMS Entities Integration Entities = Snapshot Files Enterprise Data COLLEGE ENR_FA02 CRS_FA02 ENR_SP03 CRS_SP02 MembershipsGroupsPeople LAW USR ENR* STAFF ORGMEM CRS ORG

5. Other Data Types Additional Enterprise Data Portal Roles courselink_ FA02 courselink_ FA02 ORG_CATEGORY CRS_CATEGORY category courselink_ SP03 courselink_ SP03 Courses & Organizations Institution Roles Content System Roles ORG_CATEGORY_MEM CRS_CATEGORY_MEM Course and Organization Catalog Users PORTAL_ROLE_MEM

6. File Formats XML –All data in one file –Reusable –Standardized (IMS+) Delimited (preferred) –Easy to Manipulate –Multiple Files –Smaller Blackboard University 39450210223 swang Mr. Stanley Wang Jr. Wang,Stanley Wang Stanley Franklin Mr. Jr. 2 1959-01-01 Swang5@Blackboard_university.com 3104591276 3104591200 Twin Oaks Valley Rd attn: S. Wang San Marcos CA 92096-0001 US Blackboard University 0 144532 rpeterson Blackboard University 39450210223 swang Mr. Stanley Wang Jr. Wang,Stanley Wang Stanley Franklin Mr. Jr. 2 1959-01-01 Swang5@Blackboard_university.com 3104591276 3104591200 Twin Oaks Valley Rd attn: S. Wang San Marcos CA 92096-0001 US Blackboard University 0 144532 rpeterson EXTERNAL_PERSON_KEY|USER_ID|SYSTEM_ROLE|INSTITUTION_ROLE|FIRSTNAME|LASTNAME|EMAIL 0142270|sait.tarhan|none|role_11|Sait|Tarhan|sait.tarhan@college.edu 0001129|marcha.hunley|none|role_11|Marcha|Hunley|marcha.hunley@college.edu 0001613|steven.yelton|none|role_11|Steven|Yelton|steven.yelton@college.edu 0003970|dorothy.mann|none|role_11|Dorothy|Mann|dorothy.mann@college.edu 0099821|sherry.hutton|none|role_11|Sherry|Hutton|sherry.hutton@college.edu 0000311|gary.webster|none|role_11|Gary|Webster|gary.webster@college.edu 0173103|carla.gesell-streeter|none|role_11|Carla|Gesell|carla@college.edu 0000612|olivia.watts|none|role_11|Olivia|Watts|olivia.watts@college.edu 0000381|robert.eveslage|none|role_11|Robert|Eveslage|robert.eveslage@college.edu 0000987|debra.lierl|none|role_11|Debra|Lierl|debra.lierl@college.edu 0225494|robert.nields|none|role_11|Robert|Nields|robert.nields@college.edu 0000982|charalee.allen|none|role_11|Charalee|Allen|charalee.allen@college.edu 0295293|david.hoctor|none|role_11|David|Hoctor|david.hoctor@college.edu 0001393|colleen.meyer|none|role_11|Colleen|Meyer|colleen.meyer@college.edu 00294456|clark.stull|none|role_11|Clark|Stull|clark.stull@college.edu 0000577|julie.webster|none|role_11|Julie|Webster|julie.webster@college.edu 0074937|george.armstrong|none|role_11|George|Armstrong|george.armstrong@college.edu EXTERNAL_PERSON_KEY|USER_ID|SYSTEM_ROLE|INSTITUTION_ROLE|FIRSTNAME|LASTNAME|EMAIL 0142270|sait.tarhan|none|role_11|Sait|Tarhan|sait.tarhan@college.edu 0001129|marcha.hunley|none|role_11|Marcha|Hunley|marcha.hunley@college.edu 0001613|steven.yelton|none|role_11|Steven|Yelton|steven.yelton@college.edu 0003970|dorothy.mann|none|role_11|Dorothy|Mann|dorothy.mann@college.edu 0099821|sherry.hutton|none|role_11|Sherry|Hutton|sherry.hutton@college.edu 0000311|gary.webster|none|role_11|Gary|Webster|gary.webster@college.edu 0173103|carla.gesell-streeter|none|role_11|Carla|Gesell|carla@college.edu 0000612|olivia.watts|none|role_11|Olivia|Watts|olivia.watts@college.edu 0000381|robert.eveslage|none|role_11|Robert|Eveslage|robert.eveslage@college.edu 0000987|debra.lierl|none|role_11|Debra|Lierl|debra.lierl@college.edu 0225494|robert.nields|none|role_11|Robert|Nields|robert.nields@college.edu 0000982|charalee.allen|none|role_11|Charalee|Allen|charalee.allen@college.edu 0295293|david.hoctor|none|role_11|David|Hoctor|david.hoctor@college.edu 0001393|colleen.meyer|none|role_11|Colleen|Meyer|colleen.meyer@college.edu 00294456|clark.stull|none|role_11|Clark|Stull|clark.stull@college.edu 0000577|julie.webster|none|role_11|Julie|Webster|julie.webster@college.edu 0074937|george.armstrong|none|role_11|George|Armstrong|george.armstrong@college.edu

7. Snapshot Integration Components 3 Primary Software Components –Generator (client developed) –Tool (Blackboard Learning System core) –Controller (Blackboard Consulting deliverable) Snapshot Controller SIS Blackboard Snapshot Files Snapshot Generator Snapshot Tool SIS

8. Default Snapshot Configuration Administrative Systems Snapshot Files Blackboard Academic Suite™ Database FTP Snapshot Controller Snapshot Generator SIS Snapshot Tool JDBC

9. Remote Snapshot Operations Campus System(s) Snapshot Data Files Blackboard Client Blackboard Learning System On CampusRemote (ASP) FTP Application Snapshot Controller Snapshot Generator SIS Snapshot Tool SOAP Database JDBC

10. Snapshot Security Campus System(s) Snapshot Data Files Blackboard Client Blackboard Learning System On CampusRemote (ASP) Database Application Snapshot Controller Snapshot Generator SIS Snapshot Tool VPN HTTPS SFTP, SCP

11. Available/Unavailable vs. Enabled/Disabled –Availability (Y/N) is set via the GUI, Snapshot or Event –Row Status (enabled/disabled) is set via snapshot only. Data States Available_IndRow_Status User 1YEnabled User 2NEnabled User 3YDisabled User 4NDisabled See Integration Manual or Data Planning Workbook for detailed behavior of users, enrollments and courses.

12. Manual (MANUAL) –Simplest mode, adds and updates records –Used to manage partial data sets. Snapshot (SNPSHT) –Adds, updates and disables records –Used to manage full data sets. Remove (REMOVE) –Removes records Copy Into* (COPYINTO) –Copies content between courses or organizations Snapshot Tool - Modes

13. Adding Records Snapshot Tool – Modes Bb User_IDAvailable_IndRow_StatusUser_IDAvailable_IndRow_StatusUser1YenabledUser1YenabledUser1Yenabled ADD User1YenabledUser2YenabledUser3Yenabled Adding records is the same in both Snapshot and Manual modes Blackboard Database Snapshot File

14. Updating Records Snapshot Tool – Modes Bb Updating records is the same in both Snapshot and Manual modes User_IDAvailable_IndRow_StatusUser_IDAvailable_IndRow_StatusUser1YenabledUser2YdisabledUser3NenabledUser4YenabledUser1YenabledUser2Yenabled User3YenabledN No Change update User4Yenabled disabled update No Change Blackboard Database Snapshot File

15. Bb Blackboard Database Snapshot File Missing Records Snapshot Tool – Modes The difference between Manual and Snapshot is seen when records are no longer found in the file. User_IDAvailable_IndRow_StatusUser_IDAvailable_IndRow_StatusUser1YenabledUser2YenabledUser4YenabledUser1YenabledUser2Yenabled User3Yenabled ignore User4Yenabled Manual mode just adds and updates. disable Snapshot mode disables missing records. disabled

16. ..\blackboard\apps\snapshot –\bin DSM – data source manager SNAPSHOT – snapshot tool SNAPSHOT_OVERRIDE – snapshot tool –\config ENV - connection info, class path and connection type –\data SNAPSHOT.PROPERTIES – primary snapshot configuration IMS-EP01.dtd – DTD for XML snapshots Snapshot Tools

17.  snapshot –V bbls.abc.edu –f CRS_SNAPSHOT –t..\data\SIS_CRS_SP2003 –C..\data\snapshot.properties  snapshot –V bbls.abc.com –f USR_MANUAL –t..\data\SIS_USR -C..\data\snapshot.properties  snapshot –V bbls.abc.org –f STAFF_REMOVE –t..\data\SIS_MEM_FA2003 -C..\data\snapshot.properties  snapshot –V bbls.abc.gov –f CRS_COPYINTO –t..\data\SIS_CRS_SU2002 –C..\data\snapshot.properties snapshot -V -f -t -C Snapshot Tools – Command Lines

18.  snapshot_override “-Ddata.source.key=DL_CRS” –V bbls.abc.edu –f CRS_SNAPSHOT –t..\data\SIS_CRS_SP2003 –C..\data\snapshot.properties  Snapshot_override “-Dmax.error.count=0” –V bbls.abc.com –f USR_MANUAL –t..\data\SIS_USR -C..\data\snapshot.properties Snapshot Tools – Snapshot Override –Snapshot override allows you to override settings from the properties file.

19. # Maximum errors to process. # If you want all valid records to be processed, use -1 which indicates unlimited # If you want an all or none transaction, use 0 # Otherwise, pick some reasonable number of errors max.error.count=-1 # Snapshot process settings # delimteter used for parsing snapshot files data.delimeter=| # Used to denote datasource to use for operation. data.source.key=SIS # Determines if password field should be encrypted encrypt.password=Y # Denotes string used to mark the beginning of errors error.delimeter=(!) # Determines character used to escape delimeter escape.character=/ # Designates flag to handle header validation for configuration property file header.validation=Y # Determines if logged information should be sent to console. log.stdout=N # Designates flag to establish handling of enumerated values. parse.allow.default=N # Designates maximum size of database transaction snapshot.batch.size=300 # Used to configure pause between persistence actions wait.length=-1 # Snapshot controlled field settings for Blackboard override of data # fields for category entities category.bb.controlled.fields= # Maximum errors to process. # If you want all valid records to be processed, use -1 which indicates unlimited # If you want an all or none transaction, use 0 # Otherwise, pick some reasonable number of errors max.error.count=-1 # Snapshot process settings # delimteter used for parsing snapshot files data.delimeter=| # Used to denote datasource to use for operation. data.source.key=SIS # Determines if password field should be encrypted encrypt.password=Y # Denotes string used to mark the beginning of errors error.delimeter=(!) # Determines character used to escape delimeter escape.character=/ # Designates flag to handle header validation for configuration property file header.validation=Y # Determines if logged information should be sent to console. log.stdout=N # Designates flag to establish handling of enumerated values. parse.allow.default=N # Designates maximum size of database transaction snapshot.batch.size=300 # Used to configure pause between persistence actions wait.length=-1 # Snapshot controlled field settings for Blackboard override of data # fields for category entities category.bb.controlled.fields= Operations Properties –delimiter, batch size, error count –data source key Ownership –bb.controlled fields Course Copy Operations –content areas, settings, memberships Snapshot Properties

20. # Snapshot controlled field settings for Blackboard override of data # fields for category entities category.bb.controlled.fields=AVAILABLE_IND # fields for link entities categorymembership.bb.controlled.fields= # fields for group entities group.bb.controlled.fields=AVAILABLE_IND,COURSE_NAME # fields for user entities person.bb.controlled.fields=INSTITUTION_ROLE # fields for membership entities membership.bb.controlled.fields=ROLE # Snapshot controlled field settings for Blackboard override of data # fields for category entities category.bb.controlled.fields=AVAILABLE_IND # fields for link entities categorymembership.bb.controlled.fields= # fields for group entities group.bb.controlled.fields=AVAILABLE_IND,COURSE_NAME # fields for user entities person.bb.controlled.fields=INSTITUTION_ROLE # fields for membership entities membership.bb.controlled.fields=ROLE Ownership = Control –Fields “owned” by Blackboard are not updated by the snapshot process. –Fields not owned by Blackboard may be overwritten by the snapshot. Ownership properties are set and stored in snapshot.properties –Fields owned by Blackboard listed under “bb.controlled” –Fields are Specific for Each Entity Snapshot Properties - Ownership

21. Bb User_IDFirstNameLastNameUser1JosephSmithUser2AngelaFreedUser3JennieBrownUser4FrankJonesUser_IDFirstNameLastNameUser1JosephSmith User2AngelaFreed User3JennieBrown User4FrankJones 1. Snapshot creates user records. Smithe Jones-Smith 2. Data is updated via the UI. 3. Data is updated in SIS. 4. Snapshot runs again and last names are updated, first names are left alone. Freedman Francis User1JosephSmith User2AngelaFreedman User3JennieBrown User4FrancisJones Joe Angie Jen Frank Ownership - Example –FirstName is owned by Blackboard –LastName is owned by SIS Blackboard Database Snapshot File

22. Data Source Keys can be used to separate and identify data from different sources. SIS Alumni HR Blackboard Data Sources and Data Source Keys

23. Data Source Keys can also be used to separate and identify data from different logical groups. Fall Summer Spring SIS Data Sources and Data Source Keys

24. –Blackboard database records are mapped to a particular data source key. –Anything entered via the GUI is mapped to the “SYSTEM” DSK. course_IDcourseNameext_crs_keydataSourceKey Course1BiologyBio01_02F2005fa_crs_2005 Course2HistoryHist03_06F2005fa_crs_2005 Course3FrenchFre01_05P2005sp_crs_2005 Course4French2Fre02_01P2005sp_crs_2005 Course5SpanishCourse5*SYSTEM * Note: Course_ID & Ext_Crs_Key will be identical for GUI entered records.

25. Bb DSK = “Law” DSK = “Medical” 111-11-1111 222-22-2222 888-88-8888 666-66-6666 555-55-5555 444-44-4444 777-77-7777 333-33-3333 111-11-1111 222-22-2222 888-88-8888 666-66-6666 555-55-5555 444-44-4444 777-77-7777 333-33-3333 Medical Law Medical Law Medical external_person_keyDSK 111-11-1111 222-22-2222 888-88-8888 666-66-6666 The DSK ensures that only the “right” records are updated. Without DSK the “Law” records would be disabled when the “Medical” snapshot is processed. 555-55-5555 444-44-4444 777-77-7777 333-33-3333Law Using Data Source Keys

26.  dsm –V bbls.abc.edu –f CREATE –b BBCRS_FA2005 –d Fa05_Courses  dsm –V bbls.abc.com –f DISABLE_PERSON –b BBUSERS –t 20050305  dsm –V bbls.abc.org –f PURGE_MEMBERSHIP –b BBSTAFF_FA2005  dsm –V bbls.abc.gov –f MODIFY –b BBCAT –r BBCAT_FA05 DSM -V -f Only disabled records will be removed using the PURGE operation. Snapshot Tools – Data Source Manager

27. Closing Slide Innovating Together in ‘05: –Recap top 2-3 points Resources Available: –Any links, resources available for attendees to learn more Follow up Contact(s): –Insert IF YOU ONLY REMEMBER 1 THING: –Insert