Introduction
Course Objectives
Expression Transformation
Using local variables: self and forward references
Lagging technique
Building large surrogate keys
Aggregator Transformation
Sorted input
De-normalizer
Aggregate functions
Lab 1: local variables and de-normalizer
Joiner Transformation
Sorted input
Caching
Self joins
Lab 2: self join
Transaction Control
Transaction control and commit points
Transaction based processing
Lab 3: transaction based processing
Stored Procedures
Pre and Post load stored procedures
Calling unconnected stored procedures
Lab 4: unconnected stored procedure with multiple return parameters
Parameters and Variables
Mapping, workflow, session and server parameters
Parameter file syntax
Incremental loads
Labs 5 & 6: Mapping parameters, using a mapping to rebuild a parameter file
Lookup Transformation
Lookup caches
SQL override, more effective lookup query
Sharing lookup caches
Lab 7: lookup SQL overrides
Unconnected lookups
Lab 8: de-normalizing with unconnected lookups
Dynamic lookups and dimensional updates
Labs 9 & 10: type 2 dimension update, type 1, 2 & 3 mixed dimension update.
Debugger Tips
Evaluating expressions
Discarding versus not discarding data
Error Handling
At the mapping level
At the session level
At the workflow level
Catching data errors
Duplicate keys and full table audits
Lab 11, 12 & 13: building a flexible rule based error handling system using XML metadata
Workflow Techniques
Building the Workflow
From Design to Testing
Workflow Error Handling
Using session instances for debugging
Lab 14: workflow error handling with email tasks
Performance Tuning
Understanding the server architecture
Getting baseline data
Using performance counters
Identifying bottlenecks
Lab 15: optimizing the mapping
Partitioning
Guidelines and considerations
Partition points and methods
Partitioning a session
Labs 16, 17, 18 & 19: key range, pass-through, flat file and round robin partitioning
Command Line Utilities
Overview
pmcmd
pmrep
pmrepagent
MX Views
Overview
Viewing dependencies
Viewing historical session performance
Creating documentation