EN-MakeYourOwnNeuralNetwork.pdf

Make Your Own Neural Network by

Tariq Rashid

Contents





Prologue

TheSearchforIntelligentMachines

ANatureInspiredNewGoldenAge







Part1HowTheyWork

EasyforMe,HardforYou

ASimplePredictingMachine

ClassifyingisNotVeryDifferentfromPredicting

TrainingASimpleClassifier

SometimesOneClassifierIsNotEnough

Neurons,Nature’sComputingMachines

FollowingSignalsThroughANeuralNetwork

HowDoWeActuallyUpdateWeights?

WeightUpdateWorkedExample

PreparingData





Part2DIYwithPython

Python

InteractivePython=IPython

AVeryGentleStartwithPython

NeuralNetworkwithPython

YourOwnHandwriting

InsidetheMindofaNeuralNetwork

CreatingNewTrainingData:Rotations





Epilogue





AppendixA:

AGentleIntroductiontoCalculus

Patterns

FunctionsofFunctions

YoucandoCalculus!





AppendixB:

DoItwithaRaspberryPi

InstallingIPython

MakingSureThingsWork

TrainingAndTestingANeuralNetwork

Prologue

andreplicateitinsomekindofmachinethinkingmachines.



We’venotbeensatisfiedbymechanicalorelectronicmachineshelpinguswithsimpletasks

flintsparkingfires,pulleysliftingheavyrocks,andcalculatorsdoingarithmetic.



Instead,wewanttoautomatemorechallengingandcomplextaskslikegroupingsimilarphotos,

recognisingdiseasedcellsfromhealthyones,andevenputtingupadecentgameofchess.

Thesetasksseemtorequirehumanintelligence,oratleastamoremysteriousdeepercapability

ofthehumanmindnotfoundinsimplemachineslikecalculators.



IBMDeepBluecomputerin1997wefearedthepotentialofmachineintelligencejustasmuch

aswecelebratedthathistoricachievement.



Sostrongisourdesireforintelligentmachinesthatsomehavefallenforthetemptationtocheat.

TheinfamousmechanicalTurkchessmachinewasmerelyahiddenpersoninsideacabinet!







ANatureInspiredNewGoldenAge

Optimismandambitionforartificialintelligencewereflyinghighwhenthesubjectwasformalised

inthe1950s.Initialsuccessessawcomputersplayingsimplegamesandprovingtheorems.

Somewereconvincedmachineswithhumanlevelintelligencewouldappearwithinadecadeor

so.





Afteraperiodofnotmuchprogressanincrediblypowerfulideaemergedtoliftthesearchfor

machineintelligenceoutofitsrut.Whynottrytobuildartificialbrainsbycopyinghowreal

biologicalbrainsworked?Realbrainswithneuronsinsteadoflogicgates,softermoreorganic

reasoninginsteadofthecoldhard,blackandwhite,absolutisttraditionalalgorithms.



Scientistwereinspiredbytheapparentsimplicityofabeeorpigeon'sbraincomparedtothe

complextaskstheycoulddo.Brainsafractionofagramseemedabletodothingslikesteer

flightandadapttowind,identifyfoodandpredators,andquicklydecidewhethertofightor