Big Data‚ Data Mining and Business Intelligence Techniques 2 What is Data? • Data is information in a form suitable for use with a computer. • There are two types of data ▫ Structured ▫ Unstructured • The total volume of data is growing 59% every year. • The number of files grow at 88% every year. 3 What is Big Data? Exa Analytics on Big Data at Rest Up to 10‚000 Times larger Peta Data Scale Giga Data at Rest Tera Data Scale Mega Traditional Data Warehouse
Premium Data analysis Business intelligence Data
DATA COMPRESSION The word data is in general used to mean the information in digital form on which computer programs operate‚ and compression means a process of removing redundancy in the data. By ’compressing data’‚ we actually mean deriving techniques or‚ more specifically‚ designing efficient algorithms to: * represent data in a less redundant fashion * remove the redundancy in data * Implement compression algorithms‚ including both compression and decompression. Data Compression
Premium Data compression
Introduction Data communications (Datacom) is the engineering discipline concerned with communication between the computers. It is defined as a subset of telecommunication involving the transmission of data to and from computers and components of computer systems. More specifically data communication is transmitted via mediums such as wires‚ coaxial cables‚ fiber optics‚ or radiated electromagnetic waves such as broadcast radio‚ infrared light‚ microwaves‚ and satellites. Data Communications =
Premium Twisted pair Electromagnetic radiation Wave
Data Analysis‚ Presentation & Interpretation Prof. Dr. Md. Nazrul Islam Ph.D 1 Data Analysis Plan The appropriate methods of data analysis are determined by your data types and variables of interest‚ the actual distribution of the variables‚ and the number of cases. 2 Data Management 3 Why prepare a plan for processing and analysis of data? All information has been collected in a standardized way Not collected unnecessary data which will never be analyzed A statistical analysis plan should
Premium Statistics Data Bar chart
Troy Wilson* suggest a way for preserving and enhancing the value of exploration data E very year explorationists‚ industrywide‚ collect billions of dollars worth of data. Yet‚ when it comes time for geologists to extract value from their information‚ they often find that value has been lost through poor practices in data management. There is no reliable record of the data that has been collected or data is not where it should be - it has been misplaced or corrupted. Re-assembling information
Premium Rio Tinto Group Mining Data
Components of DSS (Decision Support System) Data Store – The DSS Database Data Extraction and Filtering End-User Query Tool End User Presentation Tools Operational Stored in Normalized Relational Database Support transactions that represent daily operations (Not Query Friendly) Differences with DSS 3 Main Differences Time Span Granularity Dimensionality Operational DSS Time span Real time Historic Current transaction Short time frame Long time frame Specific Data facts Patterns Granularity Specific
Premium Data warehouse
PRINCIPLES OF DATA QUALITY Arthur D. Chapman1 Although most data gathering disciples treat error as an embarrassing issue to be expunged‚ the error inherent in [spatial] data deserves closer attention and public understanding …because error provides a critical component in judging fitness for use. (Chrisman 1991). Australian Biodiversity Information Services PO Box 7491‚ Toowoomba South‚ Qld‚ Australia email: papers.digit@gbif.org 1 © 2005‚ Global Biodiversity Information Facility Material
Premium Data management
DATA COMMUNICATION (Basics of data communication‚ OSI layers.) K.K.DHUPAR SDE (NP-II) ALTTC ALTTC/NP/KKD/Data Communication 1 Data Communications History • 1838: Samuel Morse & Alfred Veil Invent Morse Code Telegraph System • 1876: Alexander Graham Bell invented Telephone • 1910:Howard Krum developed Start/Stop Synchronisation ALTTC/NP/KKD/Data Communication 2 History of Computing • 1930: Development of ASCII Transmission Code • 1945: Allied Governments develop the First Large Computer
Premium OSI model Data transmission
and Kimball’s definition of Data Warehousing. Bill Inmon advocates a top-down development approach that adapts traditional relational database tools to the development needs of an enterprise wide data warehouse. From this enterprise wide data store‚ individual departmental databases are developed to serve most decision support needs. Ralph Kimball‚ on the other hand‚ suggests a bottom-up approach that uses dimensional modeling‚ a data modeling approach unique to data warehousing. Rather than building
Premium Data warehouse
Data mining is a concept that companies use to gain new customers or clients in an effort to make their business and profits grow. The ability to use data mining can result in the accrual of new customers by taking the new information and advertising to customers who are either not currently utilizing the business ’s product or also in winning additional customers that may be purchasing from the competitor. Generally‚ data are any “facts‚ numbers‚ or text that can be processed by a computer.” Today
Premium Data mining