ETL Components
May 28, 2008
Buildmasters have been involved with moving data from A to B for a number of years and have seen all manner of ETL architectures and designs. One thing we have learnt is that no implementation is ever the same, however there are a series of common principles that should be applied in any ETL project in order to guarantee success and avoid delivering something into production that is a monster to support. Read more
Enterprise ETL - Keep It Simple Stupid
May 28, 2008
I wish I had a dollar for every time I see a consultancy roll in with a development framework of one sort or another that is the answer to all our problems. More often than not these cobbled-together code-bundles are merely a foot in the door for bringing in legions of more consultants to utilise the framework to build the solution. It’s all a big con. The value added by these frameworks is often less than the value of building the solution from scratch.
Personally I always apply the KISS principle. Keep It Simple (Stupid!). If the solution isn’t lean and straight-forward then it is likely to be more trouble than it’s worth.
Generally a simple ETL design can be applied for the majority of development. Ensuring that adequate coding standards are developed in conjunction with templates, can help with code consistency, simplicity and maintainability.
