Monday, September 10, 2012

Part 1: Data Modeling Overview




1.1: Prerequisites for this Session

Pre-Requisites

  • Should be aware of DBMS ConceptsS
  • Should be aware of Data warehouse concepts
  • Should be aware of Data base concepts (any database)
  • Should have 2+ years of experience on any ETL Tool

1.2 : Expectations from Session 




1.3: Scope of the Session
 

1. Data Model Overview
2. Data Models
3. How to Model Data
4. Data Modeling
Conceptual Data Model
Relational Data Modeling
Dimensional Data Modeling
Logical Data Modeling
Physical Data Modeling
5. Data Warehouse Database Administration and Performance Improvements
6. Data Modeling for Data Warehouse Environment
7. Introduction to Erwin Tool

Data Model Overview




1.4: Introduction to Data Models

Fundamentals of Database Systems
 
Data
A known fact that can be recorded and that have implicit meaning

Database
  A collection of related data with the following implicit properties
A Database represents some aspect of real world, sometimes called the Universe of Discourse (UoD)
A database is a logically coherent collection of data with some inherent meaning
A Database is designed, built, and populated with data for a specific purpose
                                   
 Database Management System (DBMS)
A collection of programs that enables users to create and maintain a database
A general purpose software system that facilitates the process of defining, constructing and manipulating database for various applications
Database System
Database and DBMS software together forms a database system

What is Data Modeling?

Data modeling is a technique for exploring the data structures needed to support an organization’s information need.
It would be a conceptual representation or a replica of the data structure required in the database system.
A data model focuses on which data is required and how the data should be organized.
At the conceptual level, the data model is independent of any hardware or software constraints.
 Why Use Data Modeling?
        Leverage
Data model serves as a blueprint for the database system.
Conciseness
Data model functions as an effective communication tool for discussions with the users.
Data Quality
        Data model acts as a bridge from real-world information to database storing relevant data content. 

 What Makes a Good Data Model?
Completeness
Ensure that every piece of information required for a System is recorded and maintained.
Non-Redundant
One fact should be recorded only once. Repetition may result in inconsistency and increased storage requirements.
Adherence to Business Rules
The collected data is to be recorded by considering all business rules. It should not violate any rule.
 Data Reusability
Design a data structure to ensure re-usability.
Stability and Flexibility
A model needs to be flexible enough to adopt to new changes without forcing the programmer to re-write the code.
Elegance
A data model should neatly present the required data in the least possible number of groups or tables.
Communication
A model should present the data in a manner understandable to all stakeholders.
Integration
A good model is compatible with the existing and future systems.
1.5: Sample ER Data Model

1.6: Challenges, Benefits &  Opportunities
Challenges
Organizations today have vast quantities of data. Although this data contains information that is useful to the business, it can be extremely difficult to gather and report on this information. There are several key challenges that need to be addressed:
Ø  Discovering, collecting, and transforming data into a single source of record.
Ø  Ensuring that data is relevant and accurate for business reporting.
Ø  Storing historical data in a format that enables fast searches across large amounts of data.
Opportunities
If the data that a business holds can be unlocked and provide meaningful information to business users, there are several opportunities:
Ø   Business users can have access to relevant information to enable them to    make informed decisions.
Ø   Fast queries make data more accessible and historical data enables trends to be identified.
Ø   Data can be assessed at every level -- from an individual purchase to the total sales of a multinational corporation.
 
Benefits
Designing data warehouses correctly by using a data model will help meet many of today’s data challenges. Key benefits include:

Ø    Designing structures specifically to enable fast querying for business-centric reporting.
   
Ø   Ensuring that business requirements are met, and reports are accurate and meaningful.
Ø  Documenting source and target systems correctly to aid development, ensure effective version control, and enhance understanding of the systems.
 1.7: Why data modeling Tool
 
Why Data modeling tool
Ø   Improves productivity among developers when database designs are divided, shared, and reused
Ø   Establishes corporate modeling standards
Ø  Creates good documentation (metadata) in variety of useful formats
Ø   Ensures consistency, reuse, and integration of enterprise data
Ø   Enable creation the data model in one notation and conversion it to another notation without losing the meaning of the model
Ø    Saves time by accelerating the creation of high-quality, high-performance physical database from logical model
Ø    Conserves resources and improves accuracy by synchronizing model and database
1.8: Requirements for a good data modeling Tool
Requirements for a good data modeling tool
Ø   Diagram Notation
  Both ER & dimensional modeling notation must be available
Ø   Reverse Engineering
   Creation of a model based on the source data in the operational environment as well as from other external sources of data
Ø   Forward Engineering
    Creation of the data definition language (DDL) for the target tables in the data warehouse databases
Ø    Source to Target Mapping
     Linking of source data in the operational systems and external sources to the data in the databases in the target data warehouse
Ø    Data Dictionary or Repository
     Contains metadata that describes the data model

1.9: Overview of Data Model Tools

 
Data Modeling tools available in market
AllFusion ERwin Data Modeler (www.ca.com) An industry-leading   data modeling solution that can help you create and maintain databases,   data warehouses and enterprise data models
PowerDesigner(www.sybase.com) Designs and generates the database   schema through true bi-level (conceptual and physical) relational   database modeling supports data warehouse specific modeling   techniques
Oracle Designer (www.oracle.com)
ER/Studio (www.embarcadero.com)
IBM VisualAge DataAtlas (www.software.ibm.com)
Popkin System Architect (www.popkin.com)
CAST DB-Builder (www.castsoftware.com)
For Data Warehouse Data Modeling tools, please refer to
http://www.databaseanswers.org/modelling_tools.htm

Summary
 
In this module, you learned about the following:
Data Model Overview
Prerequisites for this Course
Expectations from this training
Scope of the training
Introduction to Data Models
Fundamentals of database Systems
Definition of a Model
What is Data Modeling
Why use Data Modeling
What Makes a Good Data Model
Sample Data Models
Data Model Tools

49 comments:

  1. In any case, at the center, it's information investigation that changed the course of strategizing. data science course in pune

    ReplyDelete

  2. Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. I would like to state about something which creates curiosity in knowing more about it. It is a part of our daily routine life which we usually don`t notice in all the things which turns the dreams in to real experiences. Back from the ages, we have been growing and world is evolving at a pace lying on the shoulder of technology. data science course will be a great piece added to the term technology. Cheer for more ideas & innovation which are part of evolution.

    ReplyDelete
  3. I feel very grateful that I read this. It is very helpful and very informative and I really learned a lot from it.
    pmp certification in bangalore

    ReplyDelete
  4. I recently came across your article and have been reading along. I want to express my admiration of your writing skill and ability to make readers read from the beginning to the end. I would like to read newer posts and to share my thoughts with you.
    Data Analytics Course in Mumbai

    ReplyDelete
  5. Such a very useful Blog. Very interesting to read this article. I have learn some new information.thanks for sharing. know more about

    ReplyDelete
  6. A great website with interesting and unique material what else would you need.
    ExcelR Data Analytics courses

    ReplyDelete
  7. This is a wonderful article, Given so much info in it, These type of articles keeps the users interest in the website, and keep on sharing more ... good luck.
    data analytics course in hyderabad

    ReplyDelete
  8. You completed certain reliable points there. I did a search on the subject and found nearly all persons will agree with your blog.
    ExcelR Courses in Business Analytics

    ReplyDelete
  9. I am looking for and I love to post a comment that "The content of your post is awesome" Great work!

    artificial Intelligence course

    machine learning courses in mumbai

    ReplyDelete
  10. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    pmp certification

    ReplyDelete

  11. Nice information, this is will helpfull a lot, Thank for sharing, Keep do posting i like to follow this informatica online training
    informatica online course
    informatica bdm training

    ReplyDelete

  12. I have recently visited your blog profile. I am totally impressed by your blogging skills and knowledge.
    Data Science Course in Hyderabad

    ReplyDelete
  13. With this training, you can acquire the skills, knowledge, expertise and technology for a successful career. This field is quite vast, and it will continue to get bigger in the future. 360DigiTMG data science course in hyderabad

    ReplyDelete
  14. This comment has been removed by the author.

    ReplyDelete
  15. This was not just great in fact this was really perfect your talent in writing was great. ExcelR PMP Certification

    ReplyDelete
  16. hi was just seeing if you minded a comment. i like your website and the thme you picked is super. I will be back. buy instagram likes uk no paypal

    ReplyDelete
  17. After reading your article I was amazed. I know that you explain it very well. And I hope that other readers will also experience how I feel after reading your article.

    artificial intelligence course

    ReplyDelete


  18. This post is great. I reallly admire your post. Your post was awesome.
    data science course in Hyderabad

    ReplyDelete
  19. This is exactly the information I'm looking for, I couldn't have asked for a simpler read with great tips like this... Thanks! ExcelR PMP Certification

    ReplyDelete
  20. Wow! Such an amazing and helpful post this is.
    Thanks for sharing. Great websites!
    Data Science Course Training in Hyderabad

    ReplyDelete
  21. Very interesting to read this article.I would like to thank you for the efforts. I also offer Data Scientist Courses data scientist courses

    ReplyDelete

  22. You actually make it look so easy with your performance but I find this matter to be actually something which I think I would never comprehend. It seems too complicated and extremely broad for me. I'm looking forward for your next post, I’ll try to get the hang of it!
    data science courses

    ReplyDelete
  23. Very nice blogs!!! i have to learning for lot of information for this sites…Sharing for wonderful information. Thanks for sharing this valuable information to our vision. You have posted a trust worthy blog keep sharing, data scientist courses

    ReplyDelete
  24. I like your article about Advanced Data Modeling
    Thanks for sharing valuable information with us. Excellent Article! I would like to thank for the efforts you have made in writing this post. Here also how Information Technology Company in Virginia introducing the new way of study.

    ReplyDelete
  25. If AWS is a job that you're dreaming of, then we, Infycle are with you to make your dream into reality. Infycle Technologies offers the best AWS Training in Chennai, with various levels of highly demanded software courses such as Oracle, Java, Python, Hadoop, Big Data, etc., in 100% hands-on practical training with specialized tutors in the field. Along with that, the pre-interviews will be given for the candidates, so that, they can face the interviews with complete knowledge. To know more, dial 7502633633 for more.No.1 AWS Training Institute in Chennai | Infycle Technologies

    ReplyDelete
  26. Grab the extraordinary Oracle Course with PLSQL from Infycle Technologies, the best software training institute in Chennai. Infycle offers the Best Oracle PLSQL Training in Chennai, with various IT demanding courses such as Big Data, Python, DevOps, Selenium, Full-Stack development, etc., in complete hands-on practical training with professional tutors in the field. In addition to that, the mock interviews will be done for the candidates so that they can face the interviews with total confidence. To have all these within your hands, call 7502633633 for a free demo.
    Best Oracle PLSQL Training in Chennai | Infycle Technologies

    ReplyDelete
  27. Improved Customer Service and Support. Salesforce provides your company with an easy and sustainable way to improve the customer service and support options. Salesforce training in India

    ReplyDelete
  28. Thank you for your post. This is excellent information. It is amazing and wonderful to visit your site.
    Visit us: .net online training india
    Visit us: Dot Net Training Online India

    ReplyDelete
  29. Its very informative blog and useful article thank you for sharing with us , keep posting

    ReplyDelete
  30. Its very informative blog and useful article thank you for sharing with us , keep posting
    Servicenow Training In Hyderabad

    ReplyDelete
  31. I read this blog, a Nice article...Thanks for sharing and waiting for the next...
    Java Training Institute in Chennai
    Best Java Training Institute in Chennai

    ReplyDelete
  32. If you are looking for data science course training, AI Patasala is the best choice for you. AI Patasala trainers will teach you how to become an expert in data science with practical knowledge.
    AI Patasala Data Science Course in Hyderabad

    ReplyDelete
  33. Very useful post. This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. Really its great article. Keep it up.
    business analytics training in hyderabad

    ReplyDelete
  34. Avast premier Key has continually been delivering you aided by the security that tools that happen to be finish are validated to operate 100%. The optimum defense goes beyond your explicit computer system. This will give protection to your neighborhood and your router, including the firewall. Avast Premier allows https://freeprosoftz.com/avast-premier-license-key-crack-patch/

    ReplyDelete
  35. Compares to having your own sister. A relation and somebody with whom you’ll share your childhood recollections and life experiences. somebody with whom you’ll laugh, weep, and continually trust. Sisters Day Quotes In English

    ReplyDelete
  36. I just happened upon your blog and wanted to say that I've truly enjoyed reading your article posts, This is excellent software. I'm glad I discovered this and had the chance to read it.
    csi etabs ultimate crack
    adobe audition cs6 crack
    download eviews full crack
    quickbooks 2022 crack activation key torrent free download 2022

    ReplyDelete


  37. it is the best website for all of us. it provides all types of software which we need. you can visit this website.
    liveprosoftware
    getlivecrack
    crackfullpc
    hpatterntechm

    ReplyDelete
  38. I have read many data science posts online previously, but none has managed to captivate my attention like this one. This is truly a masterpiece, and a perfect guide for all data science aspirants. Thanks to the writer for spelling out the concepts clearly, and using just the right words and structure.data science course training in faridabad

    ReplyDelete
  39. Microsoft Office 2013 Product Key
    Microsoft Office 2013 is excellent program which seems to use for various purpose of operating system and modifications. .

    ReplyDelete
  40. This comment has been removed by the author.

    ReplyDelete