Practical Data Analysis with Python

PracticalDataAnalysiswithPython



AnitaRaichand





ThisworkislicensedunderaCreativeCommonsAttribution-NonCommercial3.0

UnportedLicense

TableofContents

Groupingandaggregating

PracticalDataAnalysiswithPython-Visualization

Datavisualization

PracticalDataAnalysiswithPython-TimeSeries

Introduction

Theaimofthisbookistoshowhowtoapplydataanalysisprinciplestoapracticaluse

casescenariousingPythonasthedataanalysislanguage.We’llgoonthisjourneyby

lookingatthethedataworkflowfrommungingtogroupingdatatovisualizingandalso

includesometime-seriesanalysisaswell.Theformatincludesaskingquestionsofthe

dataandshowingtheprogrammingstepsneededtoanswerthequestion.Bytheendof

PracticalDataAnalysiswithPython-DataMunging

Background

customerisdefinedassomeoneusingeitherthetwenty-fourhourorthreedaypasses.

Currently(Sept2014),itcostsninedollarsfortwenty-fourhours,twenty-twodollarsfor

threedays,andeight-eightdollarsfortheyear.Overtimefeesarefourdollarsforanextra

thirtyminutesandsevendollarsforeachthirtyminutesafterthat.Dataonthefirstsix

monthsofoperationswerereleasedaspartofadatachallenge.Thedataincludedthree

filesfortriphistory,weatherinformation,anddockavailability.Themergeddatawasused

forthefollowinganalysis.

DataMungingandCarpentry

First,we’llreadinthedataandinspectthedatacolumnsanddatatypesandthinkabout

whatquestionswewanttoaskourdataandwhatthingsareweinterestedinlearningabout

mergedthedatainRaswestartedasimilaranalysistherebutreallywantedtouse

IPythonandthesuperbtimeseriesfunctionalityinPandas.We’llleaveittothereaderto

mergethecsvfilesandthenyou’llbeabletoreproducetheanalysis.

Optionally,onecancacheorlogthecodeinIPythonwiththefollowingtwocommands.

%load_extipycache

%logstart

Activatingauto-logging.Currentsessionstateplusfutureinputsaved.Filename:

ipython_log.py

Mode:rotate

Outputlogging:False