Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Data warehousing appliances...

Data warehousing appliances...

Data warehousing appliances...

Does anyone have any experience with these, such as Netezza, Datallegro, Teradata, Greenplum, etc... We're starting a data warehousing project to consolidate our data, normalize it, and setup a standard data model.

Right now, we draw data from multiple source systems and stick the feeds(transformed by Informatica) into a data mart(we have an extensive amount of these) and have a different data model for each data mart.

The problem with this is that that same source system could be feeding multiple data marts but being transformed differently. This makes it difficult for us to figure out which is the "Truth" I guess i would call it. Then multiply that by the 200-300 terabytes of data we have (yes terabytes), it makes it very difficult to properly use our analytical tools to their fullest potential.

I've uploaded a mock up of how the data flows. http://www.sendspace.com/file/95t6ad

RE: Data warehousing appliances...

Sorry, but I have no knowledge of any of those.
From your description, I should say you definitely need to conform the data.

Beware that you need the business to define what the 'truth' is for your situation. Otherwise you will remain stuck in this swamp of different truths. When I was working on a datawarehouse for a large bank/insurance company I encountered the same situation. We wanted to get to 1 definition of the truth, one member of the board of directors told us: No, as long as the organisation does not, by itself come with an initiative to define 1 version of the truth, you must be able to provide many version of the truth. That is a technical problem, so it is solveable. If we do otherwise, we are pushing our technology onto the business. Which is the same mistake ICT has made for several years.

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members! Already a Member? Login

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close