We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Profile, Optimize, Repeat: One Core Is All You Need™

00:00

Formal Metadata

Title
Profile, Optimize, Repeat: One Core Is All You Need™
Title of Series
Number of Parts
131
Author
Contributors
License
CC Attribution - NonCommercial - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this
Identifiers
Publisher
Release Date
Language

Content Metadata

Subject Area
Genre
Abstract
Your data analysis pipeline works. Nice! Could it be faster? Probably. Do you need to parallelize? Not yet. Discover optimization steps that boost the performance of your data analysis pipeline on a single core, reducing time & costs. This walkthrough shows tools to identify bottlenecks via profiling, and strategies to mitigate those, demonstrating them in an example. To improve our memory and runtime performance we will use numpy, numba jit-ing and pybind11 extensions.
User profileCore dumpOrder of magnitudeForestLocal ringRandom numberComputer-generated imageryPredictionCodeRange (statistics)Array data structureStack (abstract data type)Cartesian coordinate systemProfil (magazine)System callMathematical optimizationGraph coloringFunctional (mathematics)Visualization (computer graphics)outputCodeTwitterMathematical analysisBlogSoftwareScalabilityMedical imagingVirtual machinePredictabilityMultiplication signRow (database)Scaling (geometry)Parallel portWorkloadProgrammschleifeRandomizationComputer configurationReduction of orderMultiplicationMachine learningSoftware engineeringPattern languageSocial classDimensional analysisCASE <Informatik>MeasurementBasis <Mathematik>DialectForestDifferent (Kate Ryan album)2 (number)Classical physicsSubject indexingBitLevel (video gaming)PixelFunction (mathematics)Electronic mailing listPoint cloudPoint (geometry)Gene clusterSemiconductor memoryCore dumpMiniDiscComputer fileStructural loadShape (magazine)Right angleAlgorithmMappingDigital electronicsComputer animationLecture/Conference
User profileMeasurementSemiconductor memorySemiconductor memoryMathematical optimizationMultiplication signProfil (magazine)Disk read-and-write headDifferent (Kate Ryan album)CodeVirtual machineComputer animation
CodeSemiconductor memoryDeterminismMeasurementBlock (periodic table)Function (mathematics)Overhead (computing)System callCodeInformationSemiconductor memoryProfil (magazine)Functional (mathematics)Block (periodic table)BefehlsprozessorDifferent (Kate Ryan album)State of matterType theoryComputer programmingMultiplication signResultantVirtual machineOverhead (computing)Bit rateMereologyScaling (geometry)MultilaterationComputer animation
Visualization (computer graphics)Graphics processing unitBefehlsprozessorSemiconductor memoryData typeBit error rateMultiplication signSemiconductor memoryCodeVisualization (computer graphics)Profil (magazine)Parameter (computer programming)Revision controlComputer programmingDifferent (Kate Ryan album)Scaling (geometry)BefehlsprozessorBlogElectronic mailing listRight angleFunction (mathematics)Bookmark (World Wide Web)System callComputer animation
InformationRun time (program lifecycle phase)Line (geometry)Physical systemMereologyLibrary (computing)Multiplication signArithmetic meanProfil (magazine)Line (geometry)2 (number)Physical systemNumberComputer programmingComputer fileRight angleSubject indexingGraph coloringSocial classComputer animation
File formatBinary fileSystem of linear equationsWebsiteBinary fileLink (knot theory)MiniDiscComputer fileMultilaterationDifferent (Kate Ryan album)BenchmarkComputer configurationData storage deviceSemiconductor memoryComputer animation
Type theoryProfil (magazine)Multiplication signVector spacePoint (geometry)Drop (liquid)Computer animation
Read-only memoryCompact spaceRepresentation (politics)Core dumpOverhead (computing)Type theorySubject indexingUniqueness quantificationSocial classDampingArray data structureMultiplication signPrice indexGraph coloringSubject indexingFunctional (mathematics)SpacetimeDimensional analysisCalculationShape (magazine)Vector spaceProgrammschleifeNumberType theoryCodeElement (mathematics)Interface (computing)Different (Kate Ryan album)Semiconductor memoryUniqueness quantificationMedical imagingOperator (mathematics)DataflowVariety (linguistics)Cartesian coordinate systemFinite differenceComputer animation
Run time (program lifecycle phase)Physical systemMultiplication signSocial classProfil (magazine)Price indexSemiconductor memoryFunction (mathematics)Array data structureoutputComputer animation
Computer engineeringPredictionMusical ensembleComputer programmingSemiconductor memoryStructural loadArray data structureMultiplication signMedical imagingProfil (magazine)Social classComputer animation
Reduction of orderSemiconductor memoryType theoryLoop (music)Broadcasting (networking)Line (geometry)Data typeProgrammschleifeDifferent (Kate Ryan album)Data storage deviceNumberSlide ruleBroadcasting (networking)Maxima and minimaSemiconductor memoryType theoryArray data structureCartesian coordinate systemElectronic mailing listSocial classSubject indexingCalculationDefault (computer science)BitGreatest elementSpeicherbereinigungOverhead (computing)Computer animation
Meta elementDrop (liquid)Physical systemLine (geometry)Run time (program lifecycle phase)Multiplication signType theoryRun time (program lifecycle phase)Computer animation
Element (mathematics)CodeCASE <Informatik>Pattern languageLoop (music)NeuroinformatikSemiconductor memoryOverhead (computing)Element (mathematics)Structural loadRun time (program lifecycle phase)TesselationGraph coloringFunction (mathematics)Program slicingPosition operatorDimensional analysisLatent heatComputational complexity theoryResultantAreaSingle-precision floating-point formatData storage deviceMereologyNumberDefault (computer science)Computer fileSubject indexingTransformation (genetics)ProgrammschleifeoutputComputer configurationExterior algebraObject (grammar)Positional notationArray data structureOperator (mathematics)Functional (mathematics)Line (geometry)BitSquare numberPixelScaling (geometry)Moment (mathematics)LogicIterationUniform resource locatorComplete metric spaceCoroutineComputer animation
Element (mathematics)Raw image formatMultiplication signFunctional (mathematics)Data structurePointer (computer programming)Run time (program lifecycle phase)Level (video gaming)Electronic signatureNumberArithmetic meanoutputFunction (mathematics)Different (Kate Ryan album)Subject indexingPrice indexSubsetPrimitive (album)Semiconductor memoryCasting (performing arts)InferenceElement (mathematics)TesselationRevision controlArrow of timeWritingType theoryRepository (publishing)Maxima and minimaCalculationLoop (music)PixelProcess (computing)Limit (category theory)Game controllerExterior algebraCodeExtension (kinesiology)Array data structureProgrammschleifeGraph coloringAsynchronous Transfer ModeParameter (computer programming)Medical imagingCASE <Informatik>Error messageDampingLine (geometry)BitElectronic mailing listComputer animation
Level (video gaming)User profileLine codeVector spaceSemiconductor memoryDirection (geometry)outputBroadcasting (networking)Level (video gaming)Grand Unified TheoryArray data structureRevision controlCode2 (number)Multiplication signProgrammschleifeBitScaling (geometry)Reduction of orderType theoryGame controllerComputer programmingTesselationNumberComputer animationPanel painting
Multiplication signCore dumpMathematical optimizationLipschitz-StetigkeitScaling (geometry)Profil (magazine)CodeMehrprozessorsystemConfidence intervalComputer animation
BlogDifferent (Kate Ryan album)NumberLibrary (computing)CodeProfil (magazine)Slide ruleQR codeComputer animation
MIDIBit error rateAbstract syntax treeProfil (magazine)BefehlsprozessorMaxima and minimaMultiplication signFile formatRepresentation (politics)LengthTracing (software)Functional (mathematics)Array data structureDeterminismString (computer science)Run time (program lifecycle phase)Physical systemDecision theoryMathematical optimizationType theorySemiconductor memoryCodeResultantParsingNumeral (linguistics)Revision controlMereologyDigital photographySocial classFerry CorstenDifferent (Kate Ryan album)Resource allocationNatural numberCASE <Informatik>Structural loadGoodness of fitBitCodierung <Programmierung>outputSystem callFunction (mathematics)Binary codeMiniDiscData compressionPlotterSoftwareCycle (graph theory)Binary fileMemory managementInformationLibrary (computing)DampingProof theoryCartesian coordinate systemLecture/ConferenceMeeting/InterviewComputer animation
Transcript: English(auto-generated)