Products

About

©2018 StudyMode.com

Big Data

Topics: Data warehouse, Business intelligence, Data management Pages: 15 (1492 words) Published: March 21, 2013
Turning data into information

© Copyright IBM Corporation 2007 Course materials may not be reproduced in whole or in part without the prior written permission of IBM.

4.0.3

Unit objectives
After completing this unit, you should be able to: Explain how Business and Data is correlated Discuss the concept of turning data into information Describe the relationships between DW, BI, and Data Insight Identify the components of a DW architecture Summarize the Insight requirements and goals of a business

© Copyright IBM Corporation 2007

Business and data

Business World

Data World

© Copyright IBM Corporation 2007

The challanges Customer Business Issues
Too much information and not knowing what’s important
– Not using demand signals to drive supply chain – Not using customer analysis to tailor marketing and sales – Not leveraging valuable unstructured information

Multiple versions of the truth
– Problems managing customer, product and partner interactions – Regulatory compliance inhibited by poor transparency

Lack of trusted information
– Incomplete, out-of-date, inaccurate, misinterpreted data – Difficult to understand or control how information is used

Lack of agility
– Inability to take advantage of opportunities for innovation – Escalating costs due to inflexible systems and changing needs © Copyright IBM Corporation 2007

Data, Information, Insight
● ● ● ● ● Insights and context from the mind Requires reflection and synthesis Difficult to structure, capture on machines, and transfer Often tacit

Insight

Information

● Data endowed with relevance and purpose ● Need consensus on meaning ● Human mediation necessary

Data

● Discrete, objective facts about the world ● Easily structured and captured ● Easily transferred © Copyright IBM Corporation 2007

Data

Data has in itself little semantic content: For example:

PRICE: US$ 20000

Data will have more meaning, when presented as a part of a structure (context):

© Copyright IBM Corporation 2007

Information
Information is relevant if it makes a difference to receive it or not

PRICE: US$ 20000

JEEP CHEROKEE

2007

© Copyright IBM Corporation 2007

Insight
Information is the source of insight:
JEEP CHER. JEEP CHER. JEEP CHER. JEEP CHER. JEEP CHER. JEEP CHER. 2007 2007 2007 2007 2007 2007 New New New Used Used Used © Copyright IBM Corporation 2007

0 miles 0 miles 10 miles 2000 miles 5000 miles 7000 miles

US$ 20000 US$ 25000 US$ 20000 US$ 20000 US$ 19000 US$ 18000

Insight is not enough
Insight
Business flexibility and responsiveness

Information

e iv t ip cr s re p

Action

Data

pa ss iv e
Business value
© Copyright IBM Corporation 2007

ac tiv e

What is ...

Data Warehouse

Dynamic Warehouse

Data Mart

Decission Support System MDM

© Copyright IBM Corporation 2007

Data decision challange

© Copyright IBM Corporation 2007

Different data for different users

Operational systems Order Entry Payroll Accounts Receivables Personnel

Informational systems Product Sales Trend Analysis Ad-Hoc Queries Data Mining

© Copyright IBM Corporation 2007

Operational versus Informational data
Application-Oriented Limited Integration Constantly Updated Current Values Only Supports Day-to-Day Operation Subject-Oriented Integrated Nonvolatile Values Over Time Supports Management Decisions

Operational data

Informational data
© Copyright IBM Corporation 2007

Where is informational data?
Operational Data Informational Data
Data Warehouse Environment

User Access

Knowledge

Data Warehouse

© Copyright IBM Corporation 2007

What is a Data Warehouse?
Data Source
Data Warehouse Environment

Two-tier Data Warehouse

Data Warehouse

One-tier Data Warehouse
Management Information System

ODS

Virtual Data Warehouse

© Copyright IBM Corporation 2007

Logical tiers in a Data Warehouse

Data Source Operational Data OLTP...
Continue Reading

Please join StudyMode to read the full document

You May Also Find These Documents Helpful

  • Ibm Big Data Essay

    ...IBM Software Database management solutions for the era of big data Manage, optimize and increase availability of your IBM DB2 for Linux, UNIX and Windows database and applications— delivering valuable intelligence to help your business users make informed decisions, fast Database management solutions for the era of big data 1 Introduction Accelerate development 2 Optimize performance 3 4 Increase availability 5 Give your business a competitive edge Database management solutions for the era of big data Introduction In today’s competitive global environment, businesses must become more nimble, adapting and responding to changes in market conditions or customer preferences at a moment’s notice. Access to timely, accurate information is critical for enterprises that are striving to better serve their customers, compete successfully and foster innovation. But delivering the key information required to make informed decisions, given explosive growth in the amount of data collected and consumed daily, is a tall order. For IT managers, managing and delivering data is more challenging than ever. You must bring new applications online quickly to improve the performance of databases, applications and work teams. At the How can you balance information-driven demands with the need for a robust, dependable, flexible...

    Read More
    3400 Words 18 Pages
  • Big Data Architecture, Goals and Challenges Essay

    ... Big Data Architecture, Goals and Challenges Cipson Jose Chiriyankandath Dakota State University Abstract Big Data inspired data analysis is matured from proof of concept projects to an influential tool for decision makers to make informed decisions. More and more organizations are utilizing their internally and externally available data with more complex analysis techniques to derive meaningful insights. This paper addresses some of the architectural goals and challenges for Big Data architecture in a typical organization. Overview In this fast paced information age, there are many different sources on corporate networks and internet is collecting massive amounts of data, but there is a significant difference in this data compared to the conventional data, much of this data is semi-structured or unstructured and not residing in conventional databases. “Big data” is essentially a huge data set that scales to multiple petabytes of capacity; it can be created, collected, collaborated, and stored in real-time or any other way. However, the challenge with big data is that it is not easily handled using traditional database management tools. It typically consists of unstructured data, which includes text, audio...

    Read More
    2200 Words 8 Pages
  • Data Warehouse Essay

    ...Data Warehouse Concepts and Design Contents Data Warehouse Concepts and Design 1 Abstract 2 Abbreviations 2 Keywords 3 Introduction 3 Jarir Bookstore – Applying the Kimball Method 3 Summary from the available literature and Follow a Proven Methodology: Lifecycle Steps and Tracks 4 Issues and Process involved in Implementation of DW/BI system 5 Data Model Design 6 Star Schema Model 7 Fact Table 10 Dimension Table: 11 Design Feature: 12 Identifying the fields from facts/dimensions: MS: 12 Advanced business analytics techniques -- optimization, data mining and regression 14 Optimization: Creating Distributed Tables 15 The Data Mining Process 16 Data Mining Tasks 16 Analysis of the given data in the excel 17 a. Optimization 17 b. Data mining 19 C. Regression Analysis: 21 References: 27 1. Degenerate dimension and how is it used. Available from:: http://www.information-management.com/news/7844-1.html 27 7. Role-Playing Dimensions. Available from: http://pic.dhe.MS.com/infocenter/cbi/v10r1m1/index.jsp?topic=%2Fcom.MS.swg.ba.cognos.ug_fm.10.1.1.doc%2Fc_bp-multiplerelationships.html 27 Abstract This analysis report explains how the Kimball method to architecting and building data warehouses using an Organization’s and how the system works for a real time multinational organization with MS Parallel Data (PDW) Warehouse. This report also shows...

    Read More
    4241 Words 25 Pages
  • The Big Data Challenges Essay

    ...Click the link above to submit your assignment. Students, please view the "Submit a Clickable Rubric Assignment" in the Student Center. Instructors, training on how to grade is within the Instructor Center. Case Study 1: The Big Data Challenges Due Week 3 and worth 100 points Big Data is a term used to describe the voluminous amount of structured and semi-structured data generated by companies. The term is used when referring to petabytes (PB), exabytes (EB), and zettabytes (ZB) of data. Companies face challenges when it comes to capturing, storing, searching, and analyzing Big Data. The Volvo Car Corporation faced this problem because of the massive amount of data it was streaming from its vehicles. Study the Volvo Car Corporation case study titled, “Converting data into business value at Volvo”, located here. Write a two to four (2-4) page paper in which you: 1.Judge how Volvo Car Corporation integrated the cloud infrastructure into its networks. 2.Explain how Volvo Car Corporation transforms data into knowledge. 3.Identify the real-time information systems implemented and evaluate the impact of these implementations. 4.Argue how the Big Data strategy gives Volvo Car Corporation a competitive advantage. 5.Use at least three (3) quality resources in this assignment. Note:...

    Read More
    1396 Words 5 Pages
  • Big Data Essay

    ...1 Big Data, Data Mining and Business Intelligence Techniques 2 What is Data? • Data is information in a form suitable for use with a computer. • There are two types of data ▫ Structured ▫ Unstructured • The total volume of data is growing 59% every year. • The number of files grow at 88% every year. 3 What is Big Data? Exa Analytics on Big Data at Rest Up to 10,000 Times larger Peta Data Scale Giga Data at Rest Tera Data Scale Mega Traditional Data Warehouse and Business Intelligence Data in Motion Up to 10,000 times faster Analytics on Big Data in Motion Kilo yr mo wk day hr min sec … ms s Occasional Frequent Real-time Decision Frequency 4 Big Data • Data sets so large and complex that they become awkward to work with using on-hand database management tools. • Late 2011 the term Big Data is applied to data sets that exceed 100 TB. 5 Growth Of Big Data • Analytics market expect to grow 40% over the next 3 years • Big Data is growing at a rate of about 7 times & within Big...

    Read More
    476 Words 6 Pages
  • Data Mining Essay

    ...Data mining is a concept that companies use to gain new customers or clients in an effort to make their business and profits grow. The ability to use data mining can result in the accrual of new customers by taking the new information and advertising to customers who are either not currently utilizing the business's product or also in winning additional customers that may be purchasing from the competitor. Generally, data are any “facts, numbers, or text that can be processed by a computer.” Today, organizations are accumulating vast and growing amounts of data in different formats and different databases. This includes operational or transactional data such as, sales, cost, inventory, payroll, and accounting. Data mining also known as “knowledge discovery”, is the process of analyzing data from different perspectives and summarizing it into useful information- information that can then be used to increase revenue, cuts costs, and continue the goals outlined for the company. Data mining consists of five major elements: “Extract, transform, and load transaction data onto the data warehouse system, store and manage the data in a multidimensional database system, provide data access to business analysts and information technology professionals, analyze the data by application software, present the...

    Read More
    2354 Words 7 Pages
  • Big Data Essay

    ...A glimpse of Big Data Jan. 2013 What is big data? “Big data is not a precise term; rather it's a characterization of the never ending accumulation of all kinds of data, most of it unstructured. It describes data sets that are growing exponentially and that are too large, too raw or too unstructured for analysis using relational database techniques. Whether terabytes or petabytes, the precise amount is less the issue than where the data ends up and how it is used.”------Cite from EMC’s report “Big data: Big opportunity to create business value”. When explosion happened in mobile network, cloud computing and internet technology, more and more different information appeared. In the past, the numerous terabyte data could be a disaster for any company, because it means high cost of storage and high performance CPU. However, in nowadays, companies discovered many facts they haven’t thought about these data before. Companies started to use data analytics technology to find business values from these terabyte or petabyte data. It seems to be a big opportunity instead of disaster for companies now. Data is not only defined as structured data. When we talking about big data, it...

    Read More
    1900 Words 6 Pages
  • Introduction to Analytics and Big Data

    ...PRESENTATION TITLE Analytics Introduction toGOES HERE and Big Data - Hadoop Rob Peglar EMC Isilon SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA unless otherwise noted. Member companies and individual members may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced in their entirety without modification The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. Introduction to Analytics & Big Data – Hadoop © 2013 Storage Networking Industry Association. All Rights Reserved. 2 BIG DATA AND HADOOP Data...

    Read More
    2962 Words 34 Pages

Popular Essays

Become a StudyMode Member

Sign Up - It's Free