NCDC Weather Data : AdHoc - Content Processing

In this chapter

This chapter explains about importing NCDC weather data and querying it using mapreduce job.

Importing NCDC Weather Data

NCDC (National Climate Data Center) data consist of weather related from 1929 to 2013. You can import this data through FTP service of QueryIO.

Go to Data > Data Import/Export and click "Import". FTP Import details are :

Import process will take multiple hours to complete. In case you need to test with lesser number of files, Import data for a particular year rather than all the data.

Provide FTP Source Path as /pub/data/gsod/2012 or /pub/data/gsod/2013.

NCDC MapReduce Job with AdHoc Analytics Support

Following are the steps for executing NCDC MapReduce job:



Copyright 2017 QueryIO Corporation. All Rights Reserved.

QueryIO, "Big Data Intelligence" and the QueryIO Logo are trademarks of QueryIO Corporation. Apache, Hadoop and HDFS are trademarks of The Apache Software Foundation.