Skip main navigation

Big Data in Motion

To finish off our introduction to big data, Graeme will demonstrate some of the options available to you when operating with a high-velocity problem.

To finish off our introduction to big data, Graeme will demonstrate some of the options available when working with a high-velocity problem when your data is in motion (when there is an incoming stream of data to be reported).

Data in motion

This data has no beginning or end. When dealing with a stream of incoming information, the first step is to capture the data reliably. Various technological solutions are available to do so within the Azure platform. As we capture, want to perform stream processing.

Aggregations & Real-Time Reporting

Often our aim with real-time data is to draw conclusions and general sentiments rather than specific values. The values may change over time, but the way they change presents information that can be used to establish trends or identify problems.

Storage

We may also want to write to a data store and combine this with historic data. This is generally referred to as Lambda architecture.

If you’d like to know more about best practices when working with big data, take a look at the documents and links in the See also section below.

This article is from the free online

Microsoft Future Ready: Fundamentals of Big Data

Created by
FutureLearn - Learning For Life

Our purpose is to transform access to education.

We offer a diverse selection of courses from leading universities and cultural institutions from around the world. These are delivered one step at a time, and are accessible on mobile, tablet and desktop, so you can fit learning around your life.

We believe learning should be an enjoyable, social experience, so our courses offer the opportunity to discuss what you’re learning with others as you go, helping you make fresh discoveries and form new ideas.
You can unlock new opportunities with unlimited access to hundreds of online short courses for a year by subscribing to our Unlimited package. Build your knowledge with top universities and organisations.

Learn more about how FutureLearn is transforming access to education