ETL Components
May 28, 2008
Buildmasters have been involved with moving data from A to B for a number of years and have seen all manner of ETL architectures and designs. One thing we have learnt is that no implementation is ever the same, however there are a series of common principles that should be applied in any ETL project in order to guarantee success and avoid delivering something into production that is a monster to support.
The golden rule in Buldmasters ETL is ‘Keep It Simple’. We have seen all manner of over-engineered ETL frameworks and ‘toolsets’, usually constructed hastily by a large consulting firm as part of a ‘value-add’ toolkit. More often than not they are not worth the silicon they are written on and only serve to lock you into bringing in more and more overpriced consultants.
Some of our more recent projects have been our most complex and we have found the simplest approaches have paid off in the end. We have used Microsoft SQL Server Integration Services, considered a low-end ETL tool, and found it to be more than able to deliver a scalable, robust and performant solution.
Comments
Got something to say?

