Skip main navigation

£199.99 £139.99 for one year of Unlimited learning. Offer ends on 28 February 2023 at 23:59 (UTC). T&Cs apply

Find out more

How can you use data mining to foretell the future?

Ian Witten introduces this week's first Big Question

I’m sorry, but you can’t really use data mining to foretell the future. ☹️

What we’re going to look at is a particular kind of data called “time series data”. This involves an attribute or attributes, typically numeric, whose value evolves over time. Each instance has a time-stamp – which may or may not be spaced at regular intervals.

We often use linear regression to extrapolate the attribute’s value to future instances. You’ll be asking, isn’t that a bit mundane? – straight-line extrapolation. And you’ll probably be surprised (as I was) to learn that there are simple ways of augmenting the dataset to allow it to model cyclic phenomena using linear regression. Augmenting datasets manually is a frustrating experience, and we’ll learn how to use Weka’s time series forecasting package, which automates this and other related functions. During the week you’ll analyze historical airline passenger data, and wine sales. (Unfortunately you do not get to drink the wine.)

This week our end-of-week example of a data mining application is about inferring properties of soil samples from infrared data. We’ll also look at some general challenges for data mining applications.

At the end of this week you will be able to explain the role of “lagged variables” in time-series analysis. You’ll be experienced in the use of Weka’s time series forecasting package, and be able to work with data that varies on an hourly, daily, weekly, monthly, and yearly basis. You’ll understand that the standard holdout and cross-validation methods simply do not work for time series, and know what to do about it. And you’ll be able to explain what “overlay data” is and how valuable it can be. Oh yes, and you’ll have even more experience of that perennial problem of overfitting, and how to detect it.

This article is from the free online

Advanced Data Mining with Weka

Created by
FutureLearn - Learning For Life

Our purpose is to transform access to education.

We offer a diverse selection of courses from leading universities and cultural institutions from around the world. These are delivered one step at a time, and are accessible on mobile, tablet and desktop, so you can fit learning around your life.

We believe learning should be an enjoyable, social experience, so our courses offer the opportunity to discuss what you’re learning with others as you go, helping you make fresh discoveries and form new ideas.
You can unlock new opportunities with unlimited access to hundreds of online short courses for a year by subscribing to our Unlimited package. Build your knowledge with top universities and organisations.

Learn more about how FutureLearn is transforming access to education