Wiley 978-0-470-52576-0 Datasheet

Browse online or download Datasheet for Software manuals Wiley 978-0-470-52576-0. Wiley Microsoft SQL Server 2008 Integration Services: Problem, Design, Solution User Manual

  • Download
  • Add to my manuals
  • Print
  • Page
    / 32
  • Table of contents
  • BOOKMARKS
  • Rated. / 5. Based on customer reviews
Page view 0
SSIS Solution Architecture
Imagine that this is the first day of a new internal or client project. You will have responsibility on
the data and processing layer of the solution, which involves processing data a lot of data
from several sources, and then either integrating systems, or maybe consolidating data for
reporting. Maybe your background is a developer, or a database administrator (DBA), or a data
designer, and you know SSIS fairly well. But now they are calling you the data and ETL
architect.
ETL is the acronym for Extraction, Transformation, and Loading, which is used to describe the
data-processing layer in a data - integration or data warehouse solution.
The project manager approaches you and says that the Vice President of Technology has asked the
team to give him an estimate of the infrastructure needed. Furthermore, the business owner wants
a high - level overview of how the solution architecture will help the company achieve the business
need most efficiently. The project manager also wants your thoughts on the best way to approach
the solution, how the development should be coordinated between team members, and how
deployment should be handled.
Three meetings are scheduled for tomorrow to address these things, and you ve been asked to
provide your feedback in those areas.
Where do you start? How should you approach the solution design with SSIS as the main
technology? How should all the pieces work together?
c01.indd 1c01.indd 1 9/24/09 11:26:26 AM9/24/09 11:26:26 AM
COPYRIGHTED MATERIAL
Page view 0
1 2 3 4 5 6 ... 31 32

Summary of Contents

Page 1 - COPYRIGHTED MATERIAL

SSIS Solution Architecture Imagine that this is the first day of a new internal or client project. You will have responsibility on the dat

Page 2 - Problem

Chapter 1: SSIS Solution Architecture10 Overall Solution Architecture The reality is that creating a perfectly efficient enterprise data ecosy

Page 3

Chapter 1: SSIS Solution Architecture11 The tendency when developing a new integration or ETL system is to get it done as quickly as possible. What of

Page 4

Chapter 1: SSIS Solution Architecture12 In this diagram, data from different systems is integrated. Often, a master data management service (sometimes

Page 5

Chapter 1: SSIS Solution Architecture13reporting of information to show trending and data summaries, the ETL part of a data warehouse is important and

Page 6 - Figure 1-3

Chapter 1: SSIS Solution Architecture14 Project Planning and Team Development This is not a project methodology book, but you should give some thoug

Page 7 - Infrastructure Challenges

Chapter 1: SSIS Solution Architecture15 Estimate your data volumes in one of the initial development cycles so that you can purchase the right hardwa

Page 8 - Design

Chapter 1: SSIS Solution Architecture16 Table 1 - 2 provides some details for element tracking. Table 1-1Item DescriptionTable or filename This na

Page 9 - Choosing the Right Tool

Chapter 1: SSIS Solution Architecture17 Table 1 - 3 provides some details for entity tracking. Table 1-3Item DescriptionTable name This is the dest

Page 10

Chapter 1: SSIS Solution Architecture18 Just as a review, this discussion only addresses the tracking of data elements, and is supplementary to the ov

Page 11

Chapter 1: SSIS Solution Architecture19 In this example, a couple of data flows and a few other tasks support the processing. In all, ten tasks are in

Page 12 - Data Warehouse ETL

Chapter 1: SSIS Solution Architecture2 This chapter examines how to lay the foundation for successful solutions based on SQL Server Integration Servic

Page 13

Chapter 1: SSIS Solution Architecture20the Execute Package Task to tie together the modular child packages so that they execute in the right order. Lo

Page 14 - Agile Benefits

Chapter 1: SSIS Solution Architecture21 Each Execute Package Task ties to a package either stored in the file system, or in the msdb database packa

Page 15 - Data Element Documentation

Chapter 1: SSIS Solution Architecture22 Development and Test Servers For mission - critical ETL processes, you must have a test environment that mi

Page 16 - Table 1-2

Chapter 1: SSIS Solution Architecture23 Disk Volumes and Configuration Following are some general principles to follow as you try to estimate your d

Page 17 - Table 1-4

Chapter 1: SSIS Solution Architecture24 Package Execution Location When you are planning out your SSIS solution architecture, you must consider your

Page 18 - Package Design Patterns

Chapter 1: SSIS Solution Architecture25 For the Execute SQL Task and Bulk Insert Task, the SQL code or BCP command is executed on the machine that t

Page 19 - Master Packages

Chapter 1: SSIS Solution Architecture26 The source server will both provide the extracted data and handle the data flow transformation logic, and the

Page 20 - Figure 1-8

Chapter 1: SSIS Solution Architecture27 Following are some of the benefits of executing a package on a destination server: Limited impact on your so

Page 21 - Server Hardware

Chapter 1: SSIS Solution Architecture28 In this case, the impact on both the source and destination machines is reduced because the SSIS server would

Page 22 - Storage Hardware

Chapter 1: SSIS Solution Architecture29 The chapters in this book flow in the natural progression that you may go through when designing your SSIS sol

Page 23

Chapter 1: SSIS Solution Architecture3 The problem with Figure 1 - 1 is that this mess didn ’ t happen overnight! It grew into this twisted unorganize

Page 24 - Package Execution Location

Chapter 1: SSIS Solution Architecture30different extraction requirements (such as optimization, incremental or targeted extraction, change data captur

Page 25

Chapter 1: SSIS Solution Architecture31 Advanced ETL: Scripting, High Availability, and Performance The final three chapters of this book deal with

Page 26

c01.indd 32c01.indd 32 9/24/09 11:26:45 AM9/24/09 11:26:45 AM

Page 27 - Standalone SSIS Servers

Chapter 1: SSIS Solution Architecture4 Unknown and uncontrollable data processing — The operations that process data are not centralized, and, in

Page 28 - Solution

Chapter 1: SSIS Solution Architecture5 The overly complex control flow shown in Figure 1 - 2 is similar to an overly complex data flow, where too many

Page 29

Chapter 1: SSIS Solution Architecture6 Figure 1 - 3 shows the command - line output of an example SSIS package execution. Figure 1-3c01.indd 6c01

Page 30

Chapter 1: SSIS Solution Architecture7 If you were to consider spending time trying to work through this output when trying to figure out what went wr

Page 31 - Summary

Chapter 1: SSIS Solution Architecture8 The bottom line is that you will most likely have a disk I/O bottleneck in your data-processing operations, and

Page 32

Chapter 1: SSIS Solution Architecture9 Choosing the Right Tool This book is about applying SSIS. You are probably reading it because you assume that

Comments to this Manuals

No comments