Letter Request For A Business Intelligence And Big Data Infrastructure

Big Data is an expansive phrase for data sets so called big, large or complex that they are very difficult to process using traditional data processing applications. Challenges include analysis, capture, curation, search, sharing, storage, transfer, visualization, and information privacy. In common usage, the term big data has largely come to refer simply to the use of predictive analytics. Big data is a set of techniques and technologies that need or require new forms of integration to expose large invisible values from large datasets that are diverse, complex, and of a massive scale. When big data is effectively and efficiently captured, processed, and analyzed, companies

Meanwhile, data sharing is a large part of Boston’s efforts to improve the quality of life for their residents. And the City of Boston eagers to improve BAR from a data collection effort to a citywide performance management system accessible in real-time from any device. Big data provides an unprecedented opportunity to deliver improved services. It is a good chance to analyze large data sets, find the value of data and tell the story of the City of Boston in new way.

The emergence of big data has provided different avenues for organizations to use data to improve different aspects of their respective operations. Be it customer service, research and development, or market position, Big Data has the potential to be a significant driving force in all these areas. However, there’s still a significant gap between the ability of Big Data to produce insightful analytical information based on real-time data and the ability of organizations to capture and utilize this readily available tool. This is, in part, due to the fact that the systems and processes necessary to fully maximize the usefulness of Big Data is currently lacking in most organizations. This lack of a conducive habitat for Big Data is further magnified in new organizations without any knowledge of Big Data. For organizations that have that have little to no knowledge of Big Data, there must be a thorough assessment of the benefits of big data and how they could improve the organizations overall place in the market. There also needs to be steps taken towards the design of frameworks that will enable the organization to better capture and utilize Big Data.

Big Data has many challenges and opportunities associated with it, which necessitates us to rethink on aspects such as data management in order to attain desirable outputs. The next generation of BDA lies in its data management and its associated systems, principles and platforms. This will indeed make Big Data in creating a new wave of technological advancements.

Now that we have figured out how to harvest the free and ubiquitous big data, the next huge challenge is to figure out how to analyze and display the information in a useful and meaningful way. The big question today is how you present big data in a way that human beings can quickly understand and make decision. Most big corporations and government entities are drowning in a pool of their own data, because they lack the corresponding manpower to understand the data and extract meaningful knowledge out of it (Bizer, Boncz, Brodie, & Erling, 2012).

Today, the data consumption rate is tremendously expanding, the amount of data generated and stored is nearly imperceivable and highly growing. Big data that is nothing but a large volume of unstructured or structured data that runs in and out in to a business on daily basis. This big data is analyzed in order to achieve prominent business growth and improved business strategies [1]. Every year there is at least 40% increase in the amount of data growth on global level, leading to which companies have started adopting new data analytic techniques and tools and also have stepped ahead moving their data towards the cloud for their big data analytic requirements and for better analysis.[3][2] In big data analysis it is not the amount of data that is essential but how efficiently we handle, process and analyze it is the key factor. Big data analysis doesn’t revolve around how much data we occupy, it deals with how well you make use

Big Data has taken the business world by storm. By 2020, it is expected that the amount of digital information in existence will have grown from 3.2 zettabytes in 2014 to 40 zettabytes. Companies are doing all they can to capture this digital information and turn it into actionable insights. Currently, the total amount of data being captured and stored by industry is doubling every 1.2 years. Therefore, companies must find increasingly efficient solutions to store and analyze this incredible amount of data.

According to a report from The International Business Machines Corporation, known as IBM, 90% of the data in the world has been generated in the last two years. Frank J. Ohlhorst (2013) explains how the concept of collecting data for use in business is not new, but the scale of data that has been collected recently is so large that it has been termed Big Data (p. 1). Company executives who choose to ignore Big Data are denying their companies an advantage over their competitors. Big Data analysis is fundamental for all fields of work; it provides an insight to large amounts of data that will answer questions and make discoveries to improve efficiency in all areas of the world.

Big data is an extremely important topic for future developments, growth trends and similarities between certain things. From a Microsoft blog published in 2013 big data is “the process of applying serious computing power” (HowieT, 2013). Another article describes big data as data that “exceeds the processing capacity of conventional database systems” (Dumbill, 2012). Based on these definitions and many more alike, big data refers to or can be described as recorded information that exceeds capacity. As brief as this is, data can be recorded using many instruments and even through observation. This topic is interesting to research and develop as new technologies are more capable at storing and reading mass data. With technology advancements, a method that took half a day, more than ten years ago, would only take a couple of minutes using present technologies. As big data is getting more widely used more businesses and enterprises will be interested in the trends shown.

The world is changing with respect to the growth in big data and to the way in which it is used. Growth in big data brings with it many challenges, but it also presents new opportunities. Figure 1, helps understand some of the big data related activities that are taking place in the world with respect to volume of data that is being consumed by these activities over the next 5 years.

Big data is defined as “large data sets or to systems and solutions developed to manage such large accumulations of data, as well as for the branch of computing devoted to this development.” (“Big Data”) This definition of big data was not added to the dictionary until 2014. The next big thing in business analytics is a relatively new, yet, explosive business practice known as data mining: the collection and analysis of big data. (Fayyad) These large, seemingly random, sets of data are condensed and analyzed for patterns and trends by people with a very broad set of skills. These people are known as data scientists and are considered unicorns in today’s job market.

Big data is not a hype, but it is the future. The big data industry continues to advance, and big data service providers are making it easier for companies to work with big data in driving their businesses. Progressively, greater volumes and varieties of data will be incorporated with more business processes to support better decision making and greater insight. Moreover,

Big Data is the data that surpasses the processing limit of the customary database frameworks. The data is huge, moves with more speed and does not fit the structure of the conventional database frameworks.

Data is a powerful weapon as well as a resource. Having data does not make you powerful but what you do with it makes all the difference. Companies like Amazon, eBay and Netflix are already using data to predict user behavior and utilizing that to increase their revenue. But processing data in real time is not an easy task. The data today has great volume, is veracious in nature and is increasing at an enormous rate and hence has been given the term Big Data. There is a constant research going on to find a solution to process such huge amount of data in real time.

This article discusses firms that are at the leading edge of developing a big data analytics capability. Business firms and other types of organizations are feverishly exploring ways of taking advantage of the big data phenomenon. Big data is increasingly the cornerstone on which policy making is based. Firms that are currently enjoying the most success in this area are able to use big data not only to improve their existing businesses but to create new businesses as well. Putting a strategic emphasis on big data requires adding an analytics capability to the existing organization. This transformation process results in power shifting to analytics experts and in decisions being made in real time.