We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Balancing Database Storage Latency And Throughput

00:00

Formal Metadata

Title
Balancing Database Storage Latency And Throughput
Subtitle
PostgreSQL for Secure Enterprises
Title of Series
Number of Parts
31
Author
Contributors
License
CC Attribution 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language
Production PlaceOttawa, Canada

Content Metadata

Subject Area
Genre
Abstract
by Greg Smith The easiest type of benchmark to run on a database is checking its throughput: the total transactions processed during some period of time. But throughput isn't what application users care about. They want low latency. Latency and throughput have a complex dependency on each other, and you'll need a whole new type of test to balance them well. Recent advances in benchmarking tools, like the rate limit in pgbench 9.4, make it possible to analyze latency in a way that highlights this difficult to see area. The graphics and reports of the pgbench-tools package make it possible to see how tuning changes impact both latency and throughput. That that lets you test the "lore" for how best to tune your PostgreSQL server to find out what really works. Using these new tools, this talk will look at the tricky correlation between throughput and latency and how to measure each usefully in common situations. We'll look at three different storage stacks with very different latency profiles: regular disk, disk with battery-backed write cache, and SSD. We'll then look at exactly how checkpoint spikes play out on each and what you can do about them. You'll never trust a simple transactions per second count again!
Data storage deviceDatabaseEnterprise architectureScripting languageBit rateStress (mechanics)Operations researchRevision controlServer (computing)Magnetic-core memoryMiniDiscAutomationSoftware testingTwin primeMaxima and minimaQuery languageDatabase transactionAsynchronous Transfer ModeClient (computing)Thread (computing)DivisorDependent and independent variablesAverageInverse elementBitGraph (mathematics)ResultantQuicksortNumberDatabase transactionPulse (signal processing)2 (number)Operator (mathematics)Data storage deviceRevision controlContext awarenessServer (computing)Block (periodic table)DatabaseGroup actionClient (computing)Graph (mathematics)Task (computing)Multiplication signThread (computing)Internet forumSeries (mathematics)Data centerSoftware development kitPower (physics)Software testingGreatest elementDependent and independent variablesConcurrency (computer science)Right angleWorkloadMaxima and minimaCycle (graph theory)Scaling (geometry)Data bufferProcess (computing)Semiconductor memoryElectronic mailing listReal numberComputer hardwareSet (mathematics)Line (geometry)Point (geometry)Device driverMeasurementPerturbation theoryStress (mechanics)WaveType theoryHard disk driveRepresentation (politics)FrequencyStructural loadCASE <Informatik>Normal (geometry)AverageGoodness of fitMiniDiscCache (computing)Computer animation
Execution unitWritingCache (computing)Semiconductor memoryTask (computing)Perspective (visual)Single-precision floating-point formatView (database)Graph (mathematics)Semiconductor memoryGraph (mathematics)MassMereologyPhysical systemMultiplication signFrequencyDataflowDatabase transactionQuicksortForm (programming)Sheaf (mathematics)Table (information)Inverse elementCartesian coordinate systemDrop (liquid)DatabaseMiniDiscBitPhase transitionRight angleParameter (computer programming)Query languageSoftware testingPoint (geometry)CASE <Informatik>Operating systemHard disk driveCache (computing)Process (computing)Cycle (graph theory)Data bufferDoubling the cubeMechanism designDimensional analysis2 (number)Arithmetic progressionNumberClient (computing)Division (mathematics)Goodness of fitStudent's t-testVery-high-bit-rate digital subscriber lineSystem callData storage deviceFitness functionDigital watermarkingDifferent (Kate Ryan album)SynchronizationComputer animationDiagram
SummierbarkeitBitWritingSemiconductor memoryCache (computing)Infinite conjugacy class propertyOperator overloadingComputer hardwareMathematical optimizationConvex hullComplete metric spaceQuicksortProcess (computing)Multiplication signFrequency1 (number)Parameter (computer programming)Reading (process)Maxima and minimaInformationPhysical systemDatabase transactionBit rate2 (number)CASE <Informatik>Flow separationGraph (mathematics)Classical physicsWeightOperator (mathematics)Operating systemInterface (computing)Software testingRight angleGraph (mathematics)Extension (kinesiology)Point (geometry)StatisticsMiniDiscMereologyWorkloadFront and back endsEvent horizonNumberSemiconductor memoryTunisSlide ruleOverlay-NetzProduct (business)Order (biology)Computer hardwareState of matterStructural loadDatabaseCache (computing)Characteristic polynomialView (database)DataflowShift operatorBitLoginDiagram
Bit rateLimit (category theory)Cache (computing)WritingDefault (computer science)Scheduling (computing)Kernel (computing)Queue (abstract data type)Military operationHorizonIdeal (ethics)MiniDiscDatabase transactionClient (computing)WorkloadDatabaseDynamic random-access memoryMaxima and minimaScheduling (computing)Point (geometry)Database transactionStructural loadBit rateSemiconductor memorySoftware testingParallel portMultiplication signCache (computing)Default (computer science)RAIDComplete metric spaceGraph (mathematics)Channel capacityQuicksortChainAxiom of choiceReal numberMiniDiscMemory card2 (number)Interface (computing)Physical systemClient (computing)FrequencyWritingCASE <Informatik>Maxima and minimaArithmetic meanMathematicsExtension (kinesiology)Fitness functionMereologyAverageRight angleHydraulic jumpWorkloadBitState of matterLimit (category theory)WeightParameter (computer programming)Game controllerOnline helpNumberBlack boxLocal ringComputer animationDiagram
WritingCache (computing)Military operationIdeal (ethics)HorizonSemiconductor memoryMiniDiscData storage deviceDatabase transactionClient (computing)WorkloadDatabaseBit rateMaxima and minimaExecution unitIntelComplete metric spaceMathematicsSoftware testingLimit (category theory)Thread (computing)Query languageAsynchronous Transfer ModeDivisorData storage deviceSemiconductor memoryParameter (computer programming)Cellular automatonComputer filePhysical systemConnectivity (graph theory)Perspective (visual)Real numberOnline help2 (number)Hard disk driveClient (computing)Term (mathematics)In-Memory-DatenbankProcess (computing)PlanningBit ratePatch (Unix)Database transactionComputer-assisted translationChannel capacityPoint (geometry)Graph (mathematics)Cache (computing)Operator (mathematics)Right angleWorkloadNumberMechanism designMiniDiscQueue (abstract data type)Scheduling (computing)Multiplication signAverageArithmetic meanEndliche ModelltheorieFrequencyMassRandomizationGreatest elementInformationMereologyKernel (computing)Fraction (mathematics)Line (geometry)Task (computing)Graph (mathematics)Block (periodic table)Operating systemFlow separationHorizonCASE <Informatik>MeasurementDatabaseCausalityElement (mathematics)WritingoutputTunisNP-hardDirection (geometry)Hydraulic jumpBuildingAreaRegular graphData loggerSoftware testingDiagram
Execution unit10 (number)TouchscreenWeb pageSingle-precision floating-point formatProof theoryContent (media)Table (information)Zoom lensThumbnailDatabase transactionQuery languageDivisorAsynchronous Transfer ModeClient (computing)Thread (computing)Maxima and minimaBit rateCache (computing)Kernel (computing)Queue (abstract data type)MiniDiscMultiplication signRight angleCache (computing)Context awarenessVideo projectorQueue (abstract data type)Slide ruleException handlingWebsiteMultilaterationProcess (computing)DatabaseKernel (computing)Bit rateDatabase transactionWritingEntropie <Informationstheorie>Semiconductor memoryBitScheduling (computing)Stack (abstract data type)LogicMultiplicationPhysical systemData buffer2 (number)MereologyLevel (video gaming)Matching (graph theory)Data storage deviceRevision controlQuicksortResultantAreaProgram flowchartComputer animation
Computer animation
Transcript: English(auto-generated)