Pandas Library

In this course, we import data from spreadsheet and learn how to manipulate it using one of the most successful packages called pandas.
There is an exercise file that you should attempt to complete. You will learn the following :

Pandas: The pandas package is one of the main reasons for the success of Python in Data Science. It allows us to create, import, manipulate, analyse, and plot data.

Importing Data: It is most common to have data saved as a spreadsheet file. The best format in Data Science is the comma separated values (CSV) file. Microsoft Excel, Google Sheets, and database application can export data as CSV files. They strip away all the extraneous additions that these applications add to data. These include formatting and colouring. We only need the actual values when analysing data. Pandas makes it easy to import data files.

Extracting Data: In many cases we only require a subset of our data for analysis. Here we learn how to use pandas to manipulate and extract our data.

Filtering Data: We can narrow our search by filtering out any unnecessary information.

Updating and Changing Data: Pandas allows for updating of data values and the addition and removal of data. These are required tasks as we explore the information contained in data.

Sorting Data: Many tests require sorting of data whether it be alphabetical or numerical. It is also a useful task when visualising data.

Missing Data: It can be rare to find a data set that contains values for all subjects and variables. Dealing with missing data has a direct impact on data analyses.

Dates and Times: There are many date and time formats. Computer hardware and software applications can be set to default formats, often in competing formats on the same computer. Data for dates and times can also be entered in many formats. Dealing with dates and times in a data set is challenging. Here we learn how to use Pandas to standardise formats for analyses.

Course Author: Juan Klopper

Distributed under Creative Commons Attribution-ShareAlike
CC BY - NC - SA