Chef CTO Keynote

Video in TIB AV-Portal: Chef CTO Keynote

Formal Metadata

Chef CTO Keynote
Title of Series
CC Attribution - ShareAlike 3.0 Unported:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal and non-commercial purpose as long as the work is attributed to the author in the manner specified by the author or licensor and the work or content is shared also in adapted form only under the conditions of this license.
Release Date

Content Metadata

Subject Area
Laptop Point (geometry) Game controller Implementation Service (economics) Multiplication sign Data recovery Branch (computer science) Stack (abstract data type) Disk read-and-write head Theory Wave packet Neuroinformatik Twitter Product (business) Mathematics Goodness of fit Different (Kate Ryan album) Operator (mathematics) Endliche Modelltheorie Physical system Condition number Enterprise architecture Focus (optics) Shift operator Touchscreen Graph (mathematics) Inheritance (object-oriented programming) Weight Theory Physicalism Cartesian coordinate system Degree (graph theory) Category of being Digital photography Message passing Film editing Software Logic Website Right angle Object (grammar) Quicksort Cycle (graph theory) Family Resultant
Computer chess Group action Randomization System administrator Execution unit Neuroinformatik Different (Kate Ryan album) Descriptive statistics Physical system Enterprise architecture Theory of relativity Building Software developer Sound effect Bit Instance (computer science) Electronic signature Category of being Data management Process (computing) Telecommunication Order (biology) System programming Summierbarkeit Quicksort Cycle (graph theory) Ranking Figurate number Spacetime Point (geometry) Connectivity (graph theory) Control flow Product (business) Authorization Energy level Boundary value problem Configuration space Data structure Authentication Scaling (geometry) Key (cryptography) Information Demo (music) Physical law Computer network Cartesian coordinate system Limit (category theory) Word Spring (hydrology) Loop (music) Software Integrated development environment Personal digital assistant Data center Video game Musical ensemble Building Run time (program lifecycle phase) State of matter Multiplication sign Decision theory Mereology IP address Formal language Mathematics Bit rate Programmable read-only memory Square number Cuboid Endliche Modelltheorie Area Moment (mathematics) Physicalism Flow separation Connected space Curvature Self-organization Configuration space Software testing Right angle Authorization Data structure Resultant Laptop Implementation Service (economics) Authentication Theory Power (physics) Revision control Force Prototype Root Telecommunication Software testing Dependent and independent variables Inheritance (object-oriented programming) Interactive television Routing Abstraction
Logical constant Building Digital electronics Multiplication sign Set (mathematics) Mereology Vibration Neuroinformatik Formal language Mechanism design Roundness (object) Hypermedia Data conversion Information security Logic gate Physical system Control system Mainframe computer Enterprise architecture Software developer Physicalism Category of being Message passing Digital photography Process (computing) Order (biology) Right angle Quicksort Sinc function Trail Service (economics) Open source Virtual machine Graph coloring Revision control Force Frequency Digital signal processing Causality Root Metropolitan area network MIDI Graph (mathematics) Scaling (geometry) Inheritance (object-oriented programming) Cellular automaton Projective plane Interactive television Analytic set Plastikkarte Cartesian coordinate system Software Personal digital assistant Data center Point cloud Video game Abstraction
Building Computer file Software developer Code Execution unit Workstation <Musikinstrument> 1 (number) Cloud computing Translation (relic) Mereology Element (mathematics) Revision control Single-precision floating-point format Operator (mathematics) Software testing Codierung <Programmierung> Extension (kinesiology) Computing platform Enterprise architecture Shift operator Information Software developer Interactive television Client (computing) Cartesian coordinate system Limit (category theory) Template (C++) Curvature Process (computing) Integrated development environment Factory (trading post) Sieve of Eratosthenes Right angle Pattern language Window Writing
Trail Shift operator Multiplication sign Software developer Real number Electronic program guide Code Rule of inference Process (computing) Loop (music) Average Core dump Website Software testing Software testing Window
Slide rule Group action Server (computing) Metric system State of matter Multiplication sign Electronic program guide Solid geometry Rule of inference Power (physics) Spreadsheet Root Bit rate Profil (magazine) Software testing Information Proxy server Information security Traffic reporting Physical system Proof theory Scripting language Scale (map) Execution unit Standard deviation Moment (mathematics) State of matter Sound effect Digital signal Perturbation theory Transformation (genetics) Software maintenance Data mining Explosion Process (computing) Integrated development environment Logic Customer relationship management Phase transition Universal product code Right angle Musical ensemble Game theory Information security Metric system Writing Local ring Probability density function
Metre Scripting language Code Multiplication sign Image resolution Limit (category theory) Formal language Kernel (computing) Operating system Software testing Maize Process (computing) MiniDisc Website Information security Rule of inference Shift operator Scaling (geometry) Image resolution Parameter (computer programming) Login Database Control flow Group action Formal language Personal digital assistant Interface (computing) Bridging (networking) Acoustic shadow Software testing HTTP cookie Information security Resultant
Authentication PC Card View (database) GUI widget Control flow Rule of inference User profile Data management Data management Word Benchmark Software Profil (magazine) Personal digital assistant Operating system Computing platform Formal verification Integrated development environment Information security Information security Middleware Computing platform
PC Card Benchmark Vector space Patch (Unix) Profil (magazine) Personal digital assistant Projective plane Client (computing) Open set Lattice (order)
Type theory Programmer (hardware) Goodness of fit Software Inheritance (object-oriented programming)
Building Group action Multiplication sign Set (mathematics) Water vapor Mereology Computer programming Formal language Programmer (hardware) Physical law Endliche Modelltheorie Position operator Electric generator Software developer Moment (mathematics) Data warehouse Connected space Degree (graph theory) Process (computing) Ring (mathematics) Order (biology) Website Right angle Figurate number Reading (process) Point (geometry) Server (computing) Existence Mobile app Open source Adaptive behavior Ultraviolet photoelectron spectroscopy Rule of inference Hypothesis Number Goodness of fit Hacker (term) Operator (mathematics) Computer hardware Energy level Software testing Game theory Computing platform Time zone Shift operator Validity (statistics) Inheritance (object-oriented programming) Database Line (geometry) Limit (category theory) Exploit (computer security) Equivalence relation Software Integrated development environment Visualization (computer graphics) Function (mathematics) Password Video game Formal verification Game theory Buffer overflow
Dependent and independent variables Key (cryptography) Software developer Cellular automaton Virtual machine Cartesian coordinate system Product (business) Number Expected value Operator (mathematics) Reduction of order Pattern language Abstraction
Laptop Slide rule Keyboard shortcut Building Server (computing) Service (economics) Run time (program lifecycle phase) Code Multiplication sign Set (mathematics) Water vapor Theory Computer programming Local Group Expected value Architecture Amicable numbers Component-based software engineering Operator (mathematics) Diagram Computer architecture Execution unit Service (economics) Multiplication Information Run time (program lifecycle phase) Keyboard shortcut Moment (mathematics) Menu (computing) Group action Cartesian coordinate system Software Remote procedure call
Slide rule Greatest element Service (economics) Structural load Multiplication sign Control flow Open set Host Identity Protocol Product (business) Subset Measurement Goodness of fit Term (mathematics) Single-precision floating-point format Musical ensemble Data structure Newton's law of universal gravitation Service (economics) Inheritance (object-oriented programming) Cross-platform Building Interface (computing) Projective plane Group action Term (mathematics) Cartesian coordinate system Measurement Product (business) Mathematics Inclusion map Data management Software Integrated development environment Revision control Computing platform Convex hull Right angle Simulation Window Electric current Protein folding
Mathematical analysis Data storage device Smith chart Data model Blog Personal digital assistant Logic Implementation Website Category of being HTTP cookie Scalable Coherent Interface Service (economics) Mapping Server (computing) Web page Uniform convergence Menu (computing) Streaming media Core dump Term (mathematics) Scalability Statistics Error message Normed vector space Key (cryptography)
if we literally create a company that allowed my daughter had to write a unicorn as on the point that am I was a special thank you to the sole graft stars if you've liked all the shove company is ever made those are the guys that pulled all that offers and for the sole graph also as was there don't happen in return it has an hats and it'll be weird and miles on a think ah lovely DJ Derek it's crazy it's amazing that someone of his talent and skill comes out here the production company Alice amazing stuff OK nothing cues but so let's let's do 1 more thing by everybody I'm back so the idea to because as a I'm already here but deep as after weight right skewed hedgehog from the seeds back visit land I find I think it's hilarious and that's all that matters because as is evidenced by my daughter on unicorn it's all about me and the OK yesterday I we talked about uh the enterprise that wins being the 1 that can shift with technology and then they can do that without fundamentally changing how it works right and as I report yesterday you had the best possible phrase for this which is that it's like every couple years we have this constitutional crisis in the enterprise in a some new technology comes along and we have to decide like is everything different now you know where we no longer what we used to be and figuring out how to get the better prices future is the 1 that figures out how to take the new technology in and not have a constitutional crisis and you know we need to build a capability to ship software uh to manage infrastructure to stay compliant independent of the technology that drives us under that because the 1 thing we know for sure is that that technology is going to change over time and so how do we designed for this and yesterday we talked about Alan Kay and as the father of opera train tation in his focus on messages and today I want talk about this guy the this is Mark Burgess and he wrote CF engine and he's a professor of uh if he has a degree in physics and he invented is branch deontic logic which we're going talk about in just a minute so aren't you excited and that he invented computer immunology operator convergence you if you like anything that I have done in the last 10 years you have mark to think that it's because of what Mark taught me and it's what is taught us as an industry and and if you don't like those things I question why you're here at 9 o'clock in the morning and because it's weird right and your @ shef Gonthier Austin so if you don't like it you should leave like if you get up and just go Austin because it's also in Austin and but you're still here so I assume that you take it and also I what I'm about to say that is not the professor salt if I'm wrong so while I'm definitely cribbing from his ideas and it's not it's not him it's me and also have you noticed how photogenic he is is not a good looking guy Derek we think I think is gorgeous yeah histories I mean Isely's handsome and quite handsome yet and it's not just this photo so i've been sort of putting photos of Mark Burgess up on a screen for a while now and and every time I go look for a new Margareta's photo and I don't know about you but there's definitely photos of me like picking my nose and like eating food and just like the in slobby you know like it's on my posture is not good and I literally cannot find 1 and ends I would teased to mothers on Twitter and then the next day he sent me a selfie as he was leaving like his house in the morning you is like a think and like look super good and yeah there's a there's a lot going on this photograph and but like 1 of the things that best about this photograph is that sweater right and in my head that sweater smells great the yeah yeah dinners I'm about like it smells like sandalwood you know like this site this like my magical theoretical grandpa off you know it's like OK is the weird for that too much OK so so I love you March see now weren OK and this in both OK with shake that off and enough so marking up this great idea is called Promise Theory and and it's about how people and things cooperate uh toward achieving their goals and central to promise there is this idea of an agent and so agents are people or things that embodies some behavior right so this could be a service and it could be a transistor in your laptop it could be a person right and all kinds of of things can be these agents and the we care less about what kind of thing the agent is so we don't really care that if it's a person or if it's a uh a transistor or service what we care about is what promises they can keep we care about the behavior of that agent at in various conditions right and if we have a bunch of these agents that we understand the behavior of then we can start to understand and predict the outcomes end it's kind of amazing when we watch this work and people actually work this way all the time so I'll give you an example and not that long ago my mom was diagnosed with breast cancer and and she's now cured of breast cancer so for Rafer no longer having breast cancer and but 1 of the things that was very clear was that we didn't have to do a whole lot of command and control to eliminate that breast cancer or we had to do was come into a room and say I have breast cancer and everyone knew that are intended outcome was the removal of cancer right that was it you wanted doctor you like a concert there like let's get the concert out of your body like with remove that thing at the same thing happened with her family we were like 0 pipe I'm monoplane I will come to you and I will take care of you and what we need we should buy a recliner and we should do all these things huge amounts of things set in motion not because we ordered each other around right we can go to the surgeon and be like OK cut here you know we just told the surgeon have breast cancer and a certain was like holy crap where is it let's do the thing in the whole hospital flies and the motion right as because as human beings we don't we don't work we work this way we work according to intense right we know that the role of the doctor is to take care of you and roll the surgeon is to actually operate on you and to do those things in my role as her son was to help take care for what she was in recovery right and and together we got to this outcome that we desired which was being cancer free and and all we had to do was communicate that intense so key to the idea of promise theory is the idea that these agents work because these behaviors are assembled toward some common intents if we understand what we're trying to achieve with the objective is then we can use the reliable behaviors of these agents to get to that outcome right and a result of this is systems that we can really trust right i in that cancer example and we could trust those doctors we could trust the cousin who flew in from Virginia to take care of my mom when when I can be there and and promised theory works as well for modeling those human behavior is a works for economic behaviors and it works incredibly well for technical systems and so on a show you how we might use promise theory to talk about a different way of designing how the enterprise works and how the software stack that we run works that might lead to an enterprise they can actually shifts its implementation the could actually balance itself in the face of all of this change the to do that we need to start with an example so I think we should do application deployment and different application deployment cycle yeah OK it's every once a while I get insecure on stage in as to fish for a cheap laugh so you gotta a give that to me sages worked her the chuckle look at and this is essentially the
process that we went through for a habitat so shockingly here we have so joins promise theory to design something the 1st thing you have to do is listen to the language people use to describe what they do so when we talked about application deployment or just application management in general and you have to listen to all the words people so yesterday we sigh capital 1 the power of people speaking the same language rights did people a common language like again inspect like you get with which for infrastructure a habitat for applications and the reason we start with listening to people's languages that language is the key to our intent right hidden in the sentences we use and when when we communicate to each other is our desire about what we wanna see be corrected be different in our environment so what are some of the words we use when we talk about applications the so I picked for here we use words like build and test and deploy and configure right and there's a bunch more but I think these are a good 1st step and if we have too many I think it's too hard to sort of break things down so just go with these 4 so now that we have a little bit of of language Amanda stemmer prom were trying to solve is 1 more component and every system and that is human beings and so we need some human actors this is Willem Dafoe serving a wonderful I love wonderful was given a prolonged fellow and so on are the well and could be here with us today Chef cough and will on CBR actor for the day and a little aside as little the habitat history for you so we're in Germany and were doing were the 1st sort of customer prototypes of habitats and we had just builds uh what we we're calling it the time the depot which is where the the habitat packages go and I think Fletcher nickel I was the 1 who said hey you know what it's like a will and deep 0 the you get will and Apollo and so you might see some of the original habitat Launch team wearing the shirts that have Willem Dafoe space on it that's what that's about also when you install a package uh with habitat in the CLI you'll see this little URL go by this says it's getting your packages from Willem . habitat that sh that's the will and the pro thanks so my favorite part about the story is now that I told the to you like your work a giant enterprises right answer going to go back new use habitats in the also and some like really get a demo to some SPP was really important and has no sense of humor right and they're gonna look at that thing they're gonna be like what's what's what's Willems and you're gonna be like it's the will and the of news can move on don't tell the story to say it's flat like like it's obvious you know like everybody knows what this is and we're never going to explain it ever again so only the people in this room know that joke and it's going to be also a so let's but will in the background here for a 2nd and then let's talk about are actual agent so we've dry box and its application to that State agents that we wanna talk about and we've put the language that we determined we wanted to use inside the box right so we said it's going to build itself to test it's going to deploy it's going to configure right and inside of those little squares are the areas of intent right those are the things that we need to document the behavior of our application for right and and what's interesting about this box is that just from this space this could be a lot of different things because really any agent that implements those behaviors would fit the model right and so 1 example here would be it could be just a single instance of an application right it could be 1 service that's running because of the 50 services the running right and if they were all work together we could think about that way so the model scales of really elegantly but also skills down really elegantly right and it also forces you to think again about intense and ornamentation we have a box here that says Cuban Eddie's right or box citizenship right we're boxes that say configure were deploy rank and the doesn't say Jenkins for build registers built so another thing to notice is have different this looks than the silos in your organization right and there's a great quote that I think sums this up says organisations which design systems are constrained to produce designs which are copies of the communication structures of these organisations that was Melvin Conway skull Conway's Law so another summary of Conway's Law is organizations are doomed to design systems that mimic the org chart rate and it's a you probably have at least 4 groups more probably who own that agents right who own application is behavior you have the key probably QA 18 you probably have an application development team you probably have a separate team for doing production deployments right in a lot of organizations and so 1 of the things the promise theory helps us to do when were designing software were designing how the enterprise works is really eliminate that temptation to design around your organizational structure OK but spring will back in the picture so we have our basic actor here are basic agents what questions can we ask of our agent right so we start thinking about what is that behavior so let's say will need to build you should be able to ask the application they I need a new building you something is changed and the application should be able to response OK here's an artifact of me like his a copy of me the gives you what you desire right and it should be he should be able to ask it whether it's working or not ready to be able to ask that testing behavior they it's everything cold and it should be able say that it's good I like it right and we should be able to ask it to run itself we should say hey this version of you I would like to see in the world and should be able to be like what they like at the problem and we should be able to configure it right will and should be able to say can you use this runtime configuration in production and the application should be able to respond back yes or no right it's not very complicated but look at what happens to and when we pull up another agent so here is the Daphne up from yesterday right so we have Daphnia member the stock for Daphne was engine acts the application itself and pose rest right so In this case there's a really interesting interaction the you can think about between these 2 things which is daphne needs to talk to pose rest and so it would it be great if we could just ask the POS press service where it should write it said right should be able to say OK as I need to know where my data goes and oppose press service should be able to respond and say hey here's the right place for your rights to go is the IP address of my right we're right and but because we have all the behavior or inside the agent we're doing the design we start to see other interesting side effects so for example if we know that we have to fetch some data from that from the other application what if at build time we could validate that that exported data that pose press the Daphne needs in order to find press that pose press would actually produce it right could we validate that promise earlier in the life cycle so this offer developer at if someone changed pose present no longer exported the information that Daphne needed to talk to it would get a break at build time instead of a runtime and production right and what about you but if I hadn't thought about the problem this way and designed it this way that never would have occurred to me right and because I think about those things as separate siloed steps in my process right I think about billed as a separate thing from deployment as a separate thing from testing is a separate thing from configuration and it's not it's all part of the same behavior of that same application unshockingly thus the design of habitat like is exactly how habitat works at the higher level in this is the process we went through to design it and we provide that exact behavior to any application in a really easy way it's wine the demo yesterday took so little description I had to do a lot of things that it dead OK the let's do
another 1 if I click but how about data centers it like data centers the super Hepp right this equipment that that their relatives and I love I want to stuck in a data center for a week in Las Vegas and it's while of tequila the get there's also a guy with a machine gun out from the data-centric exhorter casino stuff in there that's weird systems administration would OK so and what other language do use when we talk about the dissenters right so again there's a ton of things we could pick by picked for so networking computes authorization and authentication right just as sort of random layers right and so what is interesting about this as a as a as an abstraction is thinking about this way so the 1st thing is this could totally be a physical datacenter right and you have to come to data center there's like i with the m 16 I come in I Sam Adam Jacob he would some IID he's like yet your atom Jacob right he understands that loop and it can also be virtual though right it could be Amazon BI Infrastructure-as-a-Service writers call that thing and I'm like a I'm Adam J. governance like yeah you sure are right and it could be on your laptop right it could be doctor and it could be VM's it could be anything right because again once we understand what the intended behavior of the agent is then it can scale up and down right it can change the implementation of what's inside because the boundary the behavior the intent is what matters right and OK so what happens when we bring well back into the picture well on I wish I wish should have done of our signature was had his voice be like reading them out you know but I'm not Kelsey Hightower but you could see Kelsey later be call that so I will and at once to authenticate himself to right so he would come in it's a monomers on the the person behind a glass of beer like holy crap you're Willem Dafoe right and and it would totally Letterman probably about checking as IT and because his him and again this could be said anything and authorization he could say they I might try use this resource can I come into this stage and can I use this particular amount of compute may do whatever it is that I want to do and what I computing could say hey I need 3 abstract units of computer please right and what about networking right he could say I need these things connected uh inside of this data center can you do that for me right and and we could just look at Willems questions and it's this guideline to our intent but what happens when we bring our application agents back up into this picture what can a communication would it have with the data center and so here's our Daphne application and so if we think about authentication what would it mean for an application to be able to authenticate itself to this center could say I am Daphne it we come up with a way for that is that to say yes you are I know that you're Daphne like to I certify that Daphne exists I see that you are at right and what about authorization could we ask the data center for permission to run in that place and say hey I'm a is daphne allowed to run inside the data center that could be a laptop could be docker it could be that it could be a physical place it could be anything Frank and what about that computes you know what if the application itself could ask the data center for what it needs to run what if it said I need 64 Data RAM in order to function the you have 64 giga RAM available Medicina could say yes or no and I could talk about where it should be located and networking now this is another super interesting thing because we have this agent abstraction and we have those behaviors that we know can expose information to each other and what could we ask of the data center and how would that communication maybe be different and so was the datacenter understood the services that were deployed inside of it as agents with intended behavior and could we then ask the data center that would Daphne needs is a network connection specifically to post breast right and then would understand all the things it needs to follow through on that promise and deliver that behavior to you by connecting those 2 services together right and how would that be different than the networking attractions we have to deal with now right and how how much can we swap in and out of those behaviors and I think I think that's an incredible idea and so much a bill that starter because it's super 1 in my life what happens when we put 2 data centers together right and we can have a west coast the center the talks to an east coast status our brain and says hey I'm the east coast is under for this company in the West as is and is like yeah you super are right or vise versa and they could have authorization to connect to each other right we could say hey I am I allowed to talk uh 1 data center to the other as pals they could be like sure and what about computes same thing data center can ask another data center to take a service that lives inside of it and running in the other data center and not because of the technical limitation of details under the hood but because the behavior of running a service was the thing that was well understood by our abstraction right and what about networking and we could make a decision about what networks need to be routed between 2 data centers based on the services that are running in those 2 data centers and this idea of services are authorized to communicate right the attraction scales up and it scales down right and EPI boundary is very different I was having uh as a dinner last nite with Scott will to move you saw yesterday from interview us and we were talking about the power of the the eyes and 1 of the things that that really struck for me was that while API is incredibly powerful are mistake is an industry has been the were drawing the boundaries wrong rain and work were instead building these tiny your API eyes were slicing them up according to Conway's Law according to how we think the market wants them as opposed to the way the human beings want to interact and wanna relates to those services and as a result our systems are harder to manage and hard understand and we have this constant ongoing constitutional crisis and ultimately this design model this past works because that's how people work we work together because we collaborate around our intent we say what we want and then we work together to achieve our goals This is the roots of people of the roots I love the roots when my favorite thing about the roots is that the roots if you assume alive you know that at some point they're going to jam like they're going to do something that's different but then you solve the last time you saw the roots of the last time you heard them play and and that happens a because they practice right so they're an incredibly tight band at some point for super on time and it's still practicing it together and and figure that stuff out but also because they trust each other and what's interesting is if you look at the lineup of the roots but all the people who've been in the band there been a ton of people who have been in the roots of my favorite former reads member is a guy named to Gooding Jr and right I was there was a tube getting Junior Chess but there's not yeah into believing junior played the tuba in a hip-hop at he would walk out and he would have a big frickin tuba and he died but no mn and and he was pretty central to the roots for a minute like it would happen like you be going along 2 routes on the has no tuba you know and there would be to beginning junior be like a founder stopper to but you know and and you knew in that moment that the roots said change the implementation of the bands right they were like now the band has to buy and there's still recognizably the roots you know nobody had asked them that we looked at them were like us at the roots anymore that African too but I came out of Paul right and just like my mom with cancer treatment right like it works because we knew the intent the intent was to play an amazing rich show the intent was to remove the cancer from my mother and together we can work to do these amazing things and are technical systems have to work this way right they have to work the way that this richer works and until they do were sort of doomed to just have a constitutional
crisis over and over and so ultimately this is how the future of the enterprise is going to be built because we can scale up and we can scale down and we can change are intense at will without changing our intent right we can keep the idea that we need to deploy this application that we need our data centers to communicate the rear networks to function that we all these steps we need to stay security to be compliant and without having to redesign all of our systems of trust right and we can change those agents as well as long as they make similar promises and the reason this is important is because like I said yesterday the 1 thing that we know for sure is that everything is always changing and there's this constant new tide of technology and pretty soon not datacenter attraction won't be about physical data centers and compute as I as are all of these things it'll be about the sneakers right because the sneakers are going to have chips and on the graph CPU's them in the 1st version of Nike's smart sneakers saner right here they will have a little cell phone in the heel and it's going to be a super big bummer or the do Bluetooth to yourself on is actually the 1st version of the Smart she will be right and the gonna build an also machine learning AI the tracks you all year round so you're run along and you're like all of Osserman go for a run the sovereignty of it's like Adam your gate sucks like stop your partner needs you know in your heart so cool my super virtual Mikey running a I told me what to do right yeah and it's cool involved in the cloud and you're like man I love the shoes and you gonna go for an awesome trail run right you go up in the mountains and you have no cell service and all of a sudden you're super AI agent thing just goes away you know it's like sorry bro not Mani more nearly like notes Persian Russian technologies pretty cool you owners can be gimmick you know the and yeah it that's what you're gonna do you're gonna be like my shoe gimmick was also the 1st time I did and then I was just now it's a thing because it can't be in your life all the time and that is not done the 19 those that they have lightning in a bottle of they can coach you're running and and so they're gonna go how can I move all of that compute and processing and AI and analytics in the shoe because the latency is killing us right and if I can make it so this you can just talk to you and everything is fine everything to be cool than I have a problem which is you moved all that application intelligence into the shoe which means you basically taken that datacenter attraction atrophy were earlier and you've made it into a shill Saudi to do now because hey it's cool were on AWS is only 1 dataset affection what's the big problem both on every shoe a data center inside the data center is a little application has to do stuff and how do you update all the shoes and how does the shoe know that only 90 is allowed to update chul's yeah as you can get right it's awful and it's happening it's gonna happen and were the people there supposed to make it happen it's either gonna be awful and a gimmick or it's gonna be the coolest thing in the world of all transform everything we do and it's up to us to decide to do it and is just about how we design things is just about actually thinking through with that problem will be and giving people abstractions that actually scale all the way down the your shoes and all the way up to the biggest buildings that house all these computers all over the world In such issues I had a conversation literally 2 days ago the guy who runs a mid-size oil company which I thought was also know there was such a thing and I was like a how big of a mid size oil company and he goes as like 5 6 billion dollars as like it was also of circuits 430 trillion dollar industry whatever my favorite part about that there was you wasn't sure if it was 5 or 6 billion dollars you know like if I press the media like now you know giver take a billion right out what the problem that sounds awesome and right now I stupid yeah so for the headed and but if you think about this oil well and right now they have control systems and they have all these sort of things that run these wells but In order to really understand what's going on there some complicated interactions where they take data from this well and they send it up into like a big Hadoop cluster right and they do much of processing in that comes out the other side and the they're looking for things like vibration in the ground right or and or how how the pump is moving and so if there's a certain amount of vibration I look he told the story 2 days ago I don't know the details so we're going to go with it but essentially and has he explained it to me and if they could detect that vibration early enough and react fast enough they could slow the pump down and OBO save the pond and in the worst case they may lose the pumping cause a little many ecological disaster were oil spills out and and that's no good introduces the that they can't have a latency of sending the data all the way back to that Hadoop cluster going through MapReduce than popping up the other side and 10 minutes later noticing as alarm instead they need to be able to do it right there and these are on systems they're disconnected they're all over from the middle of nowhere there in the middle of the ocean right and how we how we can figure out how to run that thing as a secure and reliable data center because you know for sure you don't want any random person updating a pump jack right like only the people who should do that should be doing it and so on if we really want to understand if we understand the intent of our systems that's the thing that's and turns into a truly effective modern enterprise when we talk about digital transformation we will be transformed when the way we relate to our technology mimics the way we relate to each other as people and and that's what's going to make you a true digital attacker this is why human beings who were were were genetically hard-wired to collaborate we want to work together we've developed this mechanism of language in intent and we use that to our advantage and that's why civilization exists and when our technical systems work that way that is the enterprise of the future that's the thing that comes next and that's the thing that will truly transform who we are and who are enterprises are and that is the future of shaft and it is the future of the enterprise we've been building up to it these past 10 years of my life since this was our biggest conference photo and this was the very 1st that some that we ever held the 1st conference have ever had those are all of the attendees there's not like a secret other sets like those were asked 10 years ago and we know this is what we're building up to but it is or building up to N is an industry this is what we find building Ford since those 1st mainframes came online since Alan Kay had that revelation about the messages being the important part of object-orientation we've just been trying to figure out how we can make this thing more human and more real at the root of it it works because it focuses on community right a community of practice a community of effort between even tension that happens across industries and across experiences and we learn from each other what we need to understand in order to build the systems in a great way and I can't wait to learn from all of you and build it together with you and I wanna live in the future of an enterprise and quarter that is this idea of open source it's really who we are and because if we wanna collaborate around 10 if we really want to be able to trust those agents that are going to build the future we'd be able to see the behavior Wheaton understand what's happening under the hood amid understand how it scales up and how it scales down and so right now I'd love to transition stage to some of my favorite people and the people who leave this open source communities and have them share a lot a little about what's been happening was shaft by what's happening with and about what's been happening with habitat and and I think you all so much for being with me here and I can't wait to build the future of enterprise you the and that right so 1st up I'd like to look at this stage Mr. Tomei uh
the thing and that I can't the colors John is an open-source legends and he's been what you but dead being committer and developer for a super long time were frequency you you've run and manage the town of open source projects and and he has been running the chef open-source project have released
the last couple of years ago and in doing an incredible incredible job and they just sit over here and just hang out what you do your thing and you need that so when you hand off at school the fact yeah Wilson finds and get a problem a severe judging that it yesterday he because this means that right no problem yeah no I don't use coke elements on its talk infrastructure information landscape really continues to evolve made over the last year we've we've and building better tools we've been learning more about how you don't have tools and the basic units of what we do is a cookbook so I could but starts on your workstations and develop workstations with the shaft developing can yeah Over the past year we've been doing monthly releases of the shaft decay and next month we're really excited to announce that will be releasing check the 2 some of the highlights loop with if you give you thank you thank you how many of you touch at the k every single day rights 50 to Europe talking about him medical yeah let's cut up up up up up up up up up up up to emotion ever gonna get to do this again gamblers have to tell you goes on to wall this and with sorry Tom as some of the highlights and shift the K to look at let's call out the 1st 1 is artifact but with huge fines References J. from and not contraves with putting out factories a cookbook style and policy files and but shall and inspired so if you've got an artifact translation you can just upload your cookbooks to that and use that as part of your workplace and on that know if you're interested in learning more about policy files Michael hedge practice talking this afternoon about policies they should go check that out of Hell yeah where shipping shuffle 3 . 1 1 we've done a huge amount of work and some that a friends curricula have been working incredibly hard To make shuffle 3 . 1 so far so fast but more reliable and much easier to use in large environments we see around us 60 to 70 % performance increase in most operations wow the that's awesome a 60 % come and uh no general hollering and will be talking about shuffle later this afternoon as well so you should go check out so it's can be right yeah which opinion helpers and you can place in the chef decay to not better to the the the processes we want you to use when building cookbooks I'm a shipping food critic 11 which has much better support from modern ways of building cookbooks and also help you prepare for the upgrade 13 by calling out will most applications that we had in the last year the will also be shipping new versions of chefs back and test kitchen encode style again help you build those cookbooks on the subject of Chap
that thing will be releasing chef-client 13 . 1 this morning right to the so we do and the shift 113 represents a shared understanding of how best to build cookbooks yeah we've been adding resources for them and most popular platforms so search your own Windows book upon fuel Enterprise limits of Caesar it's much easier to write code but with support for those that comes out of the books we can making it safer by learning from all of you in our interactions on the Community flat move success flat and through issues and talking to people community some everywhere else so we've been we've been improving the common patterns we can make it much easier to write those patterns and the ones we hear about dangerous that people tell us they use and it invites them we've been removing those so we think this is the safest version of chef-client that released at and we think custom resources and chef-client that the of the best way to extension the hollow from
me and I think this is this is huge is the 1 of the core of the women's shift of the came from you came from a community member loop thank the of a six week window when we building the shaft 113 relates an average of 1 appeal of a day can track community but that's amazing and the so thank you and at the same time yeah at community was was pretty in a massive effort to update rules actual books and that looks to update for the the capabilities of the exposes have climbed that thing and to make sure that that all of active books that everyone uses but are the best that I can be and 10 Smith will be talking later about cookbook testing using some of the lessons that we've learned during that process to to improve testing your cookbooks yeah but they
were also releasing gorgeous new kitchen site loop you Thetis if we have it is a haphazard you hire you X developers would like real designers with art the talent yeah I 1st 1 was sigh and that was the 1st chef website to Siam Sam as my favor colorable embossed by FIFA and teacher again and so I check out the site we've got some great new guides in there as well supermarket is the
cornerstone of our community is where you go to to find cookbooks and to share your cookbooks we make 20 releases a supermarket in last year some of the highlights I'd like to to talk about in supermarkets the the 1st 1 is the ability to check compliance profiles the supermarket that my friend Chris stuff will talk about this in a moment to the Avalon and I think this again is a huge way to make you work for better the quality metrics and you can see an example of some of the those on the slide but there are a great way of finding better cookbooks and ensuring that your cookbook matches that community standards and really is the best thing that can be some unless these matches a book built from Cookstown built on future effect so you can replicate them in your local development environment the let's talk quickly about a community of COPA maintenance Adam mentioned the roots and how they how they changed band members but still the roots they still have the common goal legendary so we did what we in fostering and working within the community of groups who are maintaining some of and most critical cookbooks we're talking about companies like post Fondation a proxy and no jets and they're really advancing the state of the art as well we're learning as much from a community members to maintain these cookbooks as they are from us and say to those groups of 2 chefs and right guide and love your and they both love your cooperation in your contributions at the suggests will be talking in 3 today about how they how the processes work for them and how they can I hope you get involved as a as that were so well that we adopted from the get go for habitat so the idea that you have this huge community of maintainers to register of rolling in and out is is has been so much more effective than we think it's really the future of power to maintain 24 books together yeah I I and I'd like to invite you to get involved and infrastructure automation is a vibrant and growing community and is better when all of you are involved in and nation into the community slack yesterday so I'd love to see you that but and tomorrow we have had diarrhea so you come to the hot writing cookbooks 2 minutes in the US and I look forward to working with you thank you also thank you so much so that thank you thank you Tomei everybody out right I'd like to bring out the stage Christoph Hartmann Chris off but it but
the the the thing because of the creator of inspection and 1 of the great 1 of the creators of inspectors the only 1 and but I I love you I love on as well I'm a lot of people the 1 very things about about Dominic increased off is that they have put in so much effort to understand their customers and to really build a product and that I think is is is changing the way people think about security compliance and I'm so proud to work with you every day so as more more time progressed off at that you need this phase of so I'm happy to be here today the grows shaft this time to reflect so when we talk about compliance automation to that it sounds like it's obvious the know how this works because we're doing it our everyday but it was not obvious all the time in fact like inspect is now live in more than 2 years old so that a remember the their endowment I was sitting in just like developing that stuff and the BBC started doing it and nobody believes that this is the main thing right nobody believed to an so why we learned the hard way so when before we started this we work logic Telecom and that all the mobile and we learned like we should everything in an automated way so we omit X servers the automated CRM systems solids that was all automated and we try to move really great but then security came and said 0 no no no no like you need to follow those rules and then we said OK and we can do that from we perceive them as rockers OK we can get this at this time but now we know that they have a reason for that but at this point in so we thought OK at the out thing thing doesn't make any sense because we do it every year so we wanna be secure all the time right so these are all we're so smart we develop death that so we are made all the hardening in shaft and which sounds obvious to solve the problem right but we hadn't done it before so he was obvious to you because there you were but to the rest of us we didn't do it I think it's an amazing idea right of course we should hard now where were we started effect reports only discourse but then we figure they don't they don't believe us so we're were thinking always so cool we have everything securing out but security is also sorry I need your axles sheepfold all probably a right and I hate that Excel spreadsheet so rumor automation rendering the city mine with a Perl script that we build a pdf and handed to the outer as I passed Sarbanes-Oxley the 1st time that I live there a pro script the week before the audit actually we fail the out the 1st time it was a week before the 2nd on it when uh we would have difficulties has like I got you watch this prescription game begins to more storms after you know what I have found that there so realize something is missing in our saying so we came up with is that is that is really the dear to prune the pedia requirements into an automated rates will be the infrastructure testing compliance testing and security requirements in hell so just for you like short reminder thing this is how it looks in a PDF love that better former that may be but this is how we do an
inspector so we can just described the requirements and this is human readable and executable of course
like we can extend this and add text 1 meter but now we have a compliance language and we have everything attached in code and we can even run so that is also
because now we can bring all those departments together so no in compliance and secure departments can then say OK let's run weekly the result of the PDF document and who use my result so that is cool because again scale I can do this all the time again shift everything laughter so that that has been a really good achievement so let's talk about their achievements
we have done above the last year so with 180 contributors and this is true and we have about 120 releases so it's more than once a week whom that is little and the averaged resolution time is really really 19 days I think we need to improve our starts so in case you believe me that this is a good thing to help us to get past solvent starts so the begin see make with the cookie so you know I have a 2 to 4 inspect so I believe in that well you should really so we should allow resources now inspect gold and so that makes it pretty awesome to just like start you don't have to reinvent the wheel like that's we recover more operating systems than ever and this is not the whole there is we have scenarios if reserve so a lot more but bad something that I would like to highlight is really the data testing so we can cover databases now as well the
camera network security of a partner entailment security so that's available to and and this is really
easy to use of course I give you have so many requirements written a document really wanna reuse something but you may not agree with all those rules and you don't wanna maintain almost always since special cheese again so you can do that the profile management and inspect check it out of you have also recently we've improved our got the support we had her support from the rare regaining inspect but now we have the complete resource to cover that so we talked a lot about
what has been achieved but where is inspect going and inspect so so far is really focusing on an operating system and we believe going forward inspector would cover the whole infrastructure so if you think about containers everything about habitat and think about communities more and more a security requirements moved into the middleware so that means like all the security requirements moving to the middleware as well so that needs to be covered so we're so happy to announce that we have in spectral platform soon so we turn inspect from operating specific to platform this so that means an operating system is becoming a special case of incubation food they out there we we are so happy to have like companies working was already in this case he collaborated with the to all and you the team that have done a lot of words to verify about and this is really a cool thing but thanks again for the 2 L to the whole thing off on that for this whole looks like you have the resources available you can check use my user removed affect the authentication isn't allowed enabled not so same pleasure Umeyama support from so that is really cool on top
of that we have a supermarket Tom talked about it that is built in to inspect we can just say inspect supermarket profiles you see it can run it immediately so that's pretty awesome because like this is how we share profiles the and you can just run from command line and something that I would really the highlight as
well as the best that project and nowadays of not only covering this after perhaps it's almost covering the inspect baselines so we have minutes baselines and especially I would like to highlight the TLS baseline in case you wanna move for PCI row of TOS was 1 . 2 make check it out it's as hold make entertainment companies to move toward that correctly so thank you again for being here please join us in making this vector being
thinking so much decided wow is back this of apartment move OK please look at this stage my dear friends Jamie Windsor the without
all that kind home or so and so if you have a low it over and supported this Jimmy was a genuine there is the leader of habitat and then he's been instrumental in creating a prize he also is legendary for Greenberg shelves in for Birch of thank credible network programmer as super good at pinball never never played him a competitive pinball you will lose will probably take the money and then it's just your type you mean you're in the clicker so that I can we dare say they very much Adam and then you
everyone for being here and welcome to another amazing shift up this is my 6th shelf of on I love coming here every year absolutely amazing and this year are really quite proud to be as they should talk about habitat where you're in what for those of you don't know me I as I mentioned and there were a programmer by trade of also worked in the game industry my entire life this is the 1st job I had pretty much since college almost right did not make a game of and I'm having a brilliant time right so so the nation about me is that 1 of the most passion about is learning to learn it's been the thing that really is driven me to figure out what what is that pushes you for what it is that helps you become a better engineer or a better program and I actually started writing my my career with an art degree of would a school for 3 modeling and graphic art those the only way that you may gain and that's that's literally while the school for that of so today want to use story about how I became an engineering the 1st thing the 1st program I pretty much wrote a so I want to this company turbine uh we made the orderings online and the dragons online and outside in the Operations Department of working the nite shift and and I just took that job because I want to get in the game and care what was I just want to being days of what are the things that I brought to my interview there was that I was a high level player in the games and I also crashed the servers in duplicated items in its the economies of the by the way of the nite number 1 rule the criminals not to mention it on stage in a lasting began publicly those economies are all gone now I know that all have to off now the Anatolia read and so like statue limitations of like I think I however of in that actions going to crash the servers duplicate the items and sold on eBay before the existence of In inoculate you Microsoft is actually here so maybe they get a natural fallback on and prosecute you click compute the last half we'll do the on just don't know and this in Iraqi aligned in everquest just that the packets to figure out like the 1 in the zones were there in front of his see 12 up 11 values the lock the doors in the dungeon of by telling the server that the door was locked position hypothesis validation of the way that it was a very high level player in like will work craft in a bunch of the game so the point is is that so I was buried in 2 of the high will play games and I was into these communities and what you would call me after but I was not a good programmer we've romanticize the idea of actors in America because we have the schools least where like this visualization of what hacking is but actually what it really means is that you're just kind of a hack job program but you could be an amazing programmer but the thing that you're doing the act that you're doing isn't the or terribly difficult sometimes like just downloading a program like that of a bought that takes people offline in hacker where you have a program that makes you look like you are 1 anyway but the 1st program that I ever get paid for it was a tool to find exploiters in the water the rings online on because I was so used to explain their economies I knew exactly what to look for I also said the operations department so I had the password to literally every single database and they didn't know I was making connections to them to build up a data warehouse to figure out in like building network to figure out how people were cheating wondering money and treating that's right so that was the 1st program that I had made it's on my desk right it's running it's rails 1 2 6 at those in the very 1st thing that I get paid to make and and deliver to to to our customer that customer was the customer service department and I made the set and gave it to them what was going to give it to them and I came across the problem that sharing my creation was really hard it was harder than making it and I knew what to look for in the game that part was difficult but I figured out rails in you know I was I was a decent programmer at the time like I was able to at least figure out how to cause a buffer overflow in actual school servers and and I was also able to learn about the work I like you I for world war craft and things like that but what I could do was deployed creation to an environment and I was in the operations department and I went to 1 of the more senior people and ups and you know they they kick test but they were very unfamiliar with Ruby at the time of the women when it was more talk about rails 1 2 6 I made this that and the company would lead to I'm told me that I need to rewrite it in a language it wasn't a toy this funny talking to this audience because what we are really program is probably but you know 10 years ago it was not nearly as commonplace this is before the rise of what we now know is Dev lots
of if we fast forward a couple years it's a lot more common for developers to to know how to deploy their own apps and you know I I started to understand what it was do know so a couple years go by and uh and I finally agreement to our mind at the next to the there's going to and he finally I find the right person and he decided to bring the because those agreed engineer but because I knew enough about operations and I was an engineer and specifically the things I was able to create were helpful for them at the time but at this moment did not having been cleaned yet and it was the amended that companies so that optimal the hardware monitoring while there's managed everything else it's like in this environment and it was my job along with building what at the time we were calling the rescue of they the equivalent of like battle that for another company answered social platform for again warm of certain games those lines half my job the other half was that I had to solve the point to the next generation deployment for all the servers and like I said the dev team do all that and so it was at that time that I found ship on Adams really sweet sigh website called me you know that sigh in gray what happened this beautiful Adam Nelson genius to decided and I have it was like shift 0 7 0 like that so do I use shelf and I have been using it for years and I've build open-source tools around in and try to vandalize of outcomes every conference I can and it's been a big part of my life and I'm super appreciative of it but the thing that I had difficulty doing was teaching at other people alive tried to teach probably over 100 engineers shut up and it works but it's to varying degrees of success like the time this required is often insurmountable for adaptive who has another job to do and that's the problem is like getting dose to both have the fat and deploy the act right so using Jeffrey like 60 years and then the last uh the point that I had was but you get to this
production quick where you're just about to deploy and which if it's useful it's easy and way you'll pretty much just get 90 per cent of the way that might and and I'm pretty sure it's because we were just thinking about the problem as infrastructure instead of as applications that's where habitat comes in I really strongly feel that habitat gets us 100 % away there for automating applications is because we were just thinking about it the wrong way we're building the abstraction as operations people we were building abstraction as developers the thing is that micro only works in StarCraft and you can take a top-down approach when you're dealing with such a large amount of machines or anything but we might add that there's a number of Euler's audience have you're tried to build an orchestrator here for the work with an orchestra before I also tried to build an orchestrator and it's just the overall pattern of that's what I mean by a top-down micro approach to its orchestration versus choreography In orchestrator is something that tries to give the delivered messages top-down and then wait for responses whereas the choreography the choreography is asking them to play something on stage and you said like to hear the song and they will just figured out for you user goals expectations in it just happens this because this that habitat is
more like while application biology cell biology your applications it's reactive this is 1 of the 3 key principles of habitat and why I believe it works super well OK Jamie yes I love you so much you twice as fast absolutely I was you all day the total 1 lunch Sunday if we keep guys consist of tools they can be guess of food it's like zombies apocalypse this reduction get done so every cell in your body is isolated atomic and immutable and to say that we have and packaging unwilling and
behind the see diagram of the Habitat architecture and the supervisors are the gossiping information to each other then isolated atomic immutable artifacts and the receive them from a deeper a moment ago and talked about theory or promises those services the running set of expectations between each other and they fulfill those expectations the slide behind you see is what we call a runtime service providing this is how you set up those expectations services export thing that they can be in something else consumes them and they bind them this allows us to create self-sustaining multi tier efforts all while go In 2002
we had a rebuild the world and the CBD since reminding is of all really wasn't insulin this problem meant that basically we had a rebuild every application or every program that was in Linux and there is a double freely issue in which allegedly local or remote code execution everybody in this room today has a cellphone their pocket or a laptop and a lot of time and use that we have this this this is completely enormous compared what we had in 2002 so this problem only continues to grow the so long with habitat with isolated the water we create a build server that build server rebuilds the software and not only that build dependence software it also held ship that's operator to always supervisors we watch the build
service probably video under by see how artifacts would get would be rebuilt this summarizing pick them up gossip around in a rolling fashionable take turns updating with an updated according the entire thing knowing that we rebuild the dependent builds we perform dependent builds which is we rebuild software that depended upon your software once we rebuild it so every bill Open SSL eventually engine X will be rebuilt visually your application we would would be rebuilt and that will be gossip right you also perform promotions throughout this so if the applications rebuild it automatically deploys and acceptance you can and promoted into a new another environment and then eventually into production when you believe it's ready the goal you of the feeling that we're supposed we're trying to provide is that you come in the morning you get your coffee and you realize 0 acceptance updated why was expected something the evil really was fixed it looks excellent Nelspruit that production and you didn't do any work he just came in so there was a problem press the button and our productions up-to-date and in win because we we built from the bottom up from the package manager and supervisor we now have the ability to deliver this 3 times as fast 2 slides left sorry some of 3 home Jamie it's super good stuff Scott ends along with their who like locked in front of it what I was looking at what happened here who they've just just so you know they've been red for a while I was like as like 8 minutes in the ran has like you gotta go has to release a 0 however of like got this not that things are so the the project must have the have that working on the idea that the things that you have to work any the structure visible were 2 which is the the right a single interface for everything has to be any application that you can do greenfield brownfield are cross-platform has the Windows Linux and we have the measure the time to learn lunch break you must be able to figure out all the sticks to lunch breaks when the entire application
blue and this is the role that the public if we could get annoyed the thing with the few the the for current term the this work on the Newton things work in the future the things that work our project was also up the you can go check that out the
whole map you 0 and Hinduism means
slack on and if you about tutorials as well but the much as big some essentially their half