Documenting LabVIEW Data & Data Mining with LabVIEW and DIAdem Presentation with self paced training exercises.

Slides:



Advertisements
Similar presentations
Autodesk Integrations Overview SmartDesk A seamlessly integrated, affordable, out-of-the-box, Windows based drawing and document management tool for.
Advertisements

Gruppo di Misure Meccaniche e Termiche UNIBS - DIMI A. File Formats At their lowest level, all files written to your computers hard drive are a series.
Access 2007 ® Use Databases How can Microsoft Access 2007 help you structure your database?
DAQmx下多點(Multi-channels)訊號量測
Continued Investment in ATML
C6 Databases.
PHP for Server-Side Preprocessing Chapter 08. Overview and Objectives Present a brief history of the PHP language Discuss how PHP fits into the overall.
Apache Struts Technology
Data Manipulation Overview and Applications. Agenda Overview of LabVIEW data types Manipulating LabVIEW data types –Changing data types –Byte level manipulation.
1 AutoCAD Electrical Seminar Advanced Micro Systems, Inc.
Wincite Introduces Knowledge Notebooks A new approach to collecting, organizing and distributing internal and external information sources and analysis.
Achieving Competitive Advantage and ROI with MetaManager  Metadata Management  Content Enhancements  Standardization  Security and more…
John Porter Why this presentation? The forms data take for analysis are often different than the forms data take for archival storage Spreadsheets are.
Software Requirements
Floyd, Digital Fundamentals, 10 th ed EET 2259 Unit 13 Strings and File I/O  Read Bishop, Chapter 9.  Lab #13 and Homework #13 due next week.
Chapter 1 Overview of Databases and Transaction Processing.
Infinity-project.org Engineering education for today’s classroom The Infinity Project SM LabVIEW for The Infinity Project.
Linux Operations and Administration
Chapter 11 Databases.
1 DATABASE TECHNOLOGIES BUS Abdou Illia, Fall 2007 (Week 3, Tuesday 9/4/2007)
Databases C HAPTER Chapter 10: Databases2 Databases and Structured Fields  A database is a collection of information –Typically stored as computer.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
ChemStation Integration with ECM November 7, 2006 Integration of ChemStation with OpenLAB ECM Life Sciences Solutions Unit Susanne Kramer, Application.
Data-mining & Data As we used Excel that has capability to analyze data to find important information, the data-mining helps us to extract information.
Data Acquisition Data acquisition (DAQ) basics Connecting Signals Simple DAQ application Computer DAQ Device Terminal Block Cable Sensors.
99ATS Turbocharge your Hiring Process !!. ON TARGET Solution offered by 99ATS Overview Introduction Gaps in Recruitment Process Screenshot overview of.
Plenary meeting 2015 – Chania - Crete CASCADE Data Services Yusuf Yigini, Panos Panagos, Martha B. Dunbar Joint Research Centre - European Commission.
Ni.com Seven Habits of Highly Effective LabVIEW ™ DAQ Programmers Reid Lee Staff Software Engineer Wed Aug 16 10:15-11:30 a.m., 12:00-1:15 p.m., 3:30-4:45.
Eurotrace Hands-On The Eurotrace File System. 2 The Eurotrace file system Under MS ACCESS EUROTRACE generates several different files when you create.
10 May Microsoft Access 2010 Relational databases’ program Part of the Microsoft Office package Administer relational database Update database through.
Supporting High- Performance Data Processing on Flat-Files Xuan Zhang Gagan Agrawal Ohio State University.
EARTH SCIENCE MARKUP LANGUAGE Why do you need it? How can it help you? INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
Database Essentials. Key Terms Big Data Describes a dataset that cannot be stored or processed using traditional database software. Examples: Google search.
EMM – SAP Error Messages Management Tool OMKAR Solutions Inc. Version 1.0.
SE: CHAPTER 7 Writing The Program
C6 Databases. 2 Traditional file environment Data Redundancy and Inconsistency: –Data redundancy: The presence of duplicate data in multiple data files.
Andrew S. Budarevsky Adaptive Application Data Management Overview.
The european ITM Task Force data structure F. Imbeaux.
The Glance Project ATLAS Management January 2012.
Introducing HingX now with Capacity Development Network.
MD – Object Model Domain eSales Checker Presentation Régis Elling 26 th October 2005.
1 Metadata –Information about information – Different objects, different forms – e.g. Library catalogue record Property:Value: Author Ian Beardwell Publisher.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
4 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved. Computer Software Chapter 4.
Term 2, 2011 Week 1. CONTENTS Problem-solving methodology Programming and scripting languages – Programming languages Programming languages – Scripting.
Access 2007 ® Use Databases How can Microsoft Access 2007 help you structure your database?
6 th Annual Focus Users’ Conference 6 th Annual Focus Users’ Conference Import Testing Data Presented by: Adrian Ruiz Presented by: Adrian Ruiz.
DataMaster 3000 Data Acquisition and Control Software.
DATA RESOURCE MANAGEMENT
WebDat: A Web-based Test Data Management System J.M.Nogiec January 2007 Overview.
NTFS Filing System CHAPTER 9. New Technology File System (NTFS) Started with Window NT in 1993, Windows XP, 2000, Server 2003, 2008, and Window 7 also.
C REATING & D ESIGNING A D ATABASE 1. C REATING A D ATABASE 2 There are two different ways to create a new Access database: 1. Start from scratch with.
PREPARED BY: PN. SITI HADIJAH BINTI NORSANI. LEARNING OUTCOMES: Upon completion of this course, students should be able to: 1. Understand the structure.
Presented By:. What is JavaHelp: Most software developers do not look forward to spending time documenting and explaining their product. JavaSoft has.
LabVIEW Course Course 2.
Excel Services Displays all or parts of interactive Excel worksheets in the browser –Excel “publish” feature with optional parameters defined in worksheet.
QLIKVIEW ONLINE TRAINING Techverze. Introduction to Qlikview QlikView is the most flexible Business Intelligence platform for turning data into knowledge.
The HDF Group Introduction to HDF5 Session Two Data Model Comparison HDF5 File Format 1 Copyright © 2010 The HDF Group. All Rights Reserved.
Chapter 1 Overview of Databases and Transaction Processing.
1 Section 1 - Introduction to SQL u SQL is an abbreviation for Structured Query Language. u It is generally pronounced “Sequel” u SQL is a unified language.
Metadata for the SKA - Niruj Mohan Ramanujam, NCRA.
Overview of MDM Site Hub
Database Database is a large collection of related data that can be stored, generally describes activities of an organization. An organised collection.
Geographic Information Systems
Databases.
WMO, World Weather Watch, Data Processing and Forecasting Systems)
Database Design Hacettepe University
Metadata The metadata contains
Supporting High-Performance Data Processing on Flat-Files
Presentation transcript:

Documenting LabVIEW Data & Data Mining with LabVIEW and DIAdem Presentation with self paced training exercises

Presentation Overview Saving data using LabVIEW Data storage VIs Exercise 1- Using the LabVIEW data storage VIs Mining technical data using LabVIEW and DIAdem Exercise 2- Data Mining with LabVIEW and DIAdem

File I/O Choices for LabVIEW Users BeginnerIntermediateAdvanced Simple ASCII Files Databases TDM Files Custom Binary & XML Files LVM Files Complexity End User

TDM- Intersection of Easy-to-Use and Flexible BeginnerIntermediateAdvanced Simple ASCII Files Databases TDM Files Custom Binary & XML Files LVM Files Complexity Easy Flexible End User

LabVIEW Data Storage VIs

Looking From the Acquisition Side Acquire itLook at itSave it Forget About it Business as usual

The Challenge Read itLook it Spending time filling in the gaps Data is often missing key descriptive information necessary to interpret the results properly ?

Problems Compound ? Preventing the efficient flow of information, creating extra work for all ? Data ProducersData Consumers

The Solution Conditions external to the test: Operator’s name Date / Time Location Temperature of the environment Etc… Test characteristics: Test name Unit Comments Maxima, minima Etc… Test values Flexible data storage model improves the efficient flow of information

Comparing Traditional File I/O Pro’sCon’s Binary Fast, Small Footprint Not self describing Requires strict control over format Spreadsheet (ASCII) Flexible, Exchangeable Limited Capacity No Structure (Flat 2D Table) XML Flexible National Instruments TDM Files Combines XML + Binary Flexible Small footprint Easy to create (Complete API) Easy to extend, customize Designed for measurement data Evolution of Traditional File I/O

TDM Files Root Description Title Author etc Group Name Description etc. Groups Channel Name Comment Unit Max & Min etc Channels XML Header (*.TDM) Binary (*.TDX)

LabVIEW Storage VIs Write TDM Files Capable of storing: Analog waveforms 1D arrays of numeric values, strings, time stamps DAQmx waveform attributes Additional user defined properties Combining the flexibility and structuring of XML together with the compactness that Binary files offer

Exercise 1: Storage VIs Demo Acquire & Write data TDM file LabVIEW Data Viewer Read data

Part II Data Mining

Where is Your Test Data? 1.Can you easily locate test data that you need to work with? 2.Do you know what tests your coworkers have run? “Data Chaos” ? ? ? ? ? ? ? ? ?

What are the Relationships in Your Data? 1.What happened in tests with similar conditions? 2.Was there a test run with these specific conditions? 3.What tests were run last week? “Data Mining”

What do the Analyzed Results Look Like? 1.Are you analyzing and reporting results consistently? 2.Is reporting test results is tedious, boring and time intensive? f(x) “Data Analysis and Report Generation”

Solution Overview Analyzing f(x) MiningStoring

The First Step to Data Mining, is Creating a Data Index Data Index Test NameOperatorUUT… ABCDJ.DoeA922WX… EFGT. JohnASW2EE… HIJohn DoeDFR44… Data Indexing 1.Consolidates all descriptive information into a searchable table 2.Automatically sweeps descriptive properties into the Data Index 3.Data Index contains links to original data file path & location 4.In this solution the actual data is not saved in the Data Index

Example LabVIEW Application for Data Mining 1.Self configuring data mining example application built in LabVIEW. 2.Get both the source code and EXE 3.Does not require MS Access to run Datamine

Self configuring, data mining application that provides advanced searching on your test data Automatically imports all meta information from TDM files and all files supported by a DataPlugin* into a self configuring data management system Automatically updates Data Index as new data files become available Features of Example d ata mining Application *see ni.com/dataplugins Hey, I found a new data file!

Exercise 2: Data Mining using LabVIEW and DIAdem “Data Mining” Find all the tests where…..

Exercise 2 set up Distortion & Linearity Test Demo Set Up 1.Characterizing op amps 2.Testing generates 100’s of datasets 3.Looking to characterize offset voltages 4.Searching for chips with very specific operational parameters 5.Comparing and analyzing data posttest

Additional Information Please contact ( ) for additional information regarding this