Building The Perfect Personalised Menu Using Python
This is a modal window.
Das Video konnte nicht geladen werden, da entweder ein Server- oder Netzwerkfehler auftrat oder das Format nicht unterstützt wird.
Formale Metadaten
| Titel |
| |
| Untertitel |
| |
| Serientitel | ||
| Anzahl der Teile | 130 | |
| Autor | ||
| Lizenz | CC-Namensnennung - keine kommerzielle Nutzung - Weitergabe unter gleichen Bedingungen 3.0 Unported: Sie dürfen das Werk bzw. den Inhalt zu jedem legalen und nicht-kommerziellen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen und das Werk bzw. diesen Inhalt auch in veränderter Form nur unter den Bedingungen dieser Lizenz weitergeben | |
| Identifikatoren | 10.5446/50000 (DOI) | |
| Herausgeber | ||
| Erscheinungsjahr | ||
| Sprache |
Inhaltliche Metadaten
| Fachgebiet | ||
| Genre | ||
| Abstract |
|
EuroPython 20203 / 130
2
4
7
8
13
16
21
23
25
26
27
30
33
36
39
46
50
53
54
56
60
61
62
65
68
73
82
85
86
95
100
101
102
106
108
109
113
118
119
120
125
00:00
Perfekter GraphGebäude <Mathematik>MenütechnikNeuroinformatikEndliche ModelltheorieSoftware Development KitBesprechung/Interview
00:30
Perfekter GraphMenütechnikGebäude <Mathematik>BitXMLComputeranimation
00:55
Web SiteSoftware Development KitPlastikkarteEinsQuaderComputeranimation
01:38
Elektronischer DatenaustauschAutomatische HandlungsplanungMenütechnikComputeranimation
01:57
MenütechnikPerfekter GraphGebäude <Mathematik>MenütechnikPerfekter GraphBitComputeranimation
02:14
MenütechnikInformationsmanagementGraphAffine VarietätProzess <Informatik>AlgorithmusCross over <Kritisches Phänomen>DistributionenraumMittelwertAuswahlaxiomArray <Informatik>CASE <Informatik>Objekt <Kategorie>GraphGlobale OptimierungMaschinenschreibenQuaderEvoluteDienst <Informatik>PunktSpannweite <Stochastik>MultiplikationsoperatorAlgorithmusFunktionalWeg <Topologie>ProgrammbibliothekNebenbedingungMenütechnikOpen SourceComputerunterstützte ÜbersetzungBitSchlussregelBasis <Mathematik>Paralleler AlgorithmusVarietät <Mathematik>Nichtlinearer OperatorGrenzschichtablösungProdukt <Mathematik>DifferenteParametersystemKontextbezogenes SystemCross over <Kritisches Phänomen>SchnittmengeSoftwareentwicklerProzess <Informatik>Trennschärfe <Statistik>Generator <Informatik>SchaltnetzZahlenbereichEinsVererbungshierarchieNatürliche Sprache
11:29
ZahlenbereichMittelwertAlgorithmusEindeutigkeitAffine VarietätInhalt <Mathematik>Kollaborative FilterungGraphApp <Programm>SchnittmengeGraphInhalt <Mathematik>BitDatenbankAussage <Mathematik>MenütechnikVarietät <Mathematik>AuswahlaxiomRankingMittelwertAutomatische IndexierungResultanteCluster <Rechnernetz>Automatische HandlungsplanungSoftwareentwicklerKanalkapazitätÄhnlichkeitsgeometrieAttributierte GrammatikSpannweite <Stochastik>EindeutigkeitZahlenbereichDifferenteMereologieTypentheorieObjekt <Kategorie>EntscheidungstheorieComputerarchitekturAnwendungsspezifischer ProzessorProdukt <Mathematik>Arithmetisches MittelGebäude <Mathematik>MultiplikationsoperatorGeradeSichtenkonzeptPunktSchlussregelLastTermMathematikAffine VarietätVerschlingungGlobale OptimierungNeuroinformatikp-BlockProgrammbibliothekMAPAlgorithmusMultiplikationHilfesystemQuaderBruchrechnungSummengleichungUmsetzung <Informatik>Gewicht <Ausgleichsrechnung>FacebookLokales MinimumNichtlinearer OperatorAnalytische MengeGemeinsamer SpeicherEinsWhiteboardKlasse <Mathematik>Mehrkriterielle OptimierungAggregatzustandBetragsflächePerfekter GraphComputeranimation
20:43
SchnittmengeRückkopplungXMLJSONUMLBesprechung/Interview
Transkript: Englisch(automatisch erzeugt)
00:06
All right, so please join me in welcoming Arian Iyad, who is a senior data scientist from Gusto. It's a recipe kit company in UK and she has been working on recommendation and forecasting models. She has done her PhD in computational chemistry from Imperial College of London and will be talking about building
00:25
personalized menus using Python today. Over to you Arian. So yeah, first of all, thank you so much for having me. It's great to be here in this weird circumstances. I'm Arian, I'm a senior data scientist at Gusto, which I'll talk a little bit more about now.
00:43
And I'm going to be telling you about how we've gone about building menus and personalizing them. So hopefully the title will make sense by the end of the talk. So if you haven't heard about Gusto, we are a kind of UK leading recipe kit delivery company. So basically you come to our website and you have over 50
01:05
recipes to pick from and given the nice setup today, I thought I'd just quickly show you. So you come on the website, you have many recipes to pick from. What you do is pick whichever ones you want.
01:20
You pick a date and on that date we send you a box full of pre-portioned ingredients. So if you only need one garlic clove, that is all we'll send you. Or half a teaspoon of dried chili flakes. To your door with like step by step recipe cards, which means that basically you get to do all the fun, you know, cooking and eating and deciding what you're going to buy. But you know there's the more boring aspects like the supermarket and the planning.
01:48
You don't need to do. And quite importantly, it also means that you don't have food waste because we send you the pre-portioned ingredients. So today we're going to split the talk a little bit. So we're going to first be talking about building the perfect menu.
02:05
And about midway through the talk, we will add the personalized aspect to it. So bear with if that's what you're looking for. Yeah, I think let's let's get going. So I wanted to start with giving you a bit of an overview about what we mean with like menu creation.
02:22
So as you saw before, there's like 50 recipes on the menu that change weekly. So what we mean by menu creation is actually deciding what's on the menu. So we have a big recipe library of thousands of recipes that our recipe developers have built. And what we do with menu creation is say, okay, well, these set of recipes is going to be live on
02:45
this day, then the following week there's going to be this next set of recipes, and so on and so forth. So, as you can imagine, the menu is always like, you know, the heart and soul of our product. It's what makes people decide. Yes, I'm going to sign up to the service or for people who actually buy week to week, say, I am I actually going
03:04
to get a box this week or am I going to skip it. So it's, it's really important for us that we get it right. So also, just to give you a bit of context, just wanted to go through, through the menu size. So back in 2016, we had 12 recipes and we've been kind of constantly increasing them.
03:24
To now when we've got like 50 plus and the aim is not to stop there. So as a company, our kind of The unique thing about us that makes us stand out is choice. So we believe that as a service, we want to offer meaningful choice we want We want customers to come on our website and feel like they have a range of
03:44
different recipes they can pick from even if they have, you know, dietary requirements that might normally You know, make that not happen. So whether you're plant based, whether you're gluten free. We want to make sure that everyone gets meaningful choice, which means that we've been scaling the number of recipes on our menu.
04:03
Now, as you can imagine, picking 12 recipes. By hand is, you know, okay, quite, quite doable. And this is what our food team has been doing. So the food team has been manually deciding which recipes are going to go In which on which menu on which dates. So
04:22
When we actually plan for menus. There's several things that we need to take into account. So first of all, as I said, It's variety and choice. We want to make sure that we offer a wide range of really inspiring recipes. We want people to come to our website and be excited by the amount of things that they can pick.
04:42
So that's like our first, you know, key thing. However, secondly, you know, we are a business and Not all recipes were born equal. Some are definitely more expensive than others. So cost is definitely one of the considerations that we need to have so All the menus need to be planned to make sure that they're hitting the budget that is set from our finance team.
05:06
And finally, we are actually a physical product. So we do need to, you know, account for several operational constraints and they range from, for example, You know, you need to put tofu on the menu every couple of weeks, because that's the agreement with our supplier.
05:22
Or it might be that, you know, you can't put more than two or three recipes with broccoli or cauliflower on the menu because of a customer or just the more you actually can't fit them in the box and So there's several of these things that we actually need to take into account. So as you can imagine, if someone's trying to do this with 50 recipes, keeping all of this in mind, making sure
05:43
that all the operational rules are met what ended up happening. I don't know if this gift will show properly. But it's a little bit of a whack-a-mole, like, you know, this cat is having some fun. But, you know, the food team was getting to the point where it wasn't fun anymore because, you know, they were in the process of picking the menu and
06:03
You know, there'd be this recipe that actually, you know, violated one of the constraints. So they'd shop it for something else. And then actually that in turn, you know, maybe was really similar to another recipe and that had to be moved and it was just very hard to keep track of all of that. At the same time, so we came together as
06:24
As a business. And we said, right, do we think that it's actually time that data science can maybe You know, try to help with things here so Hopefully I've described kind of the manual process and you know how kind of time consuming it was becoming and how complicated to, you know, get right it was
06:44
So I'll tell you how we've moved to where we are now, which is data driven with some manual touches. And then kind of, you know, the absolute future is definitely like a fully data driven process which we're not there yet, but I'm sure we'll get there at some point.
07:03
So, Yeah, just wanted to start talking to you about the, the actual data driven menu and how we went about it. So we decided to actually use genetic algorithms for this. So
07:29
It's actually really nice and intuitive to understand how this optimization works. So basically what we have is we have individuals, which in our case are menus, which are arrays basically of different recipes that create a menu.
07:46
We then have a population, which is a set of all those menus. So we tend to use about 50 So they're all different individuals. And what you do is you randomly initiate this population and then start changing them tweaking them randomly like what happened to, you know, genes, so
08:07
It can undergo mutation where like one of the one or several of the recipes in an individual will be randomly mutated to another recipe. And you can have crossover, which is the combination of two different individuals to
08:23
make new ones. So you take apart from each parent and then you create children. And what you do is for all these individuals, you have a certain set of objectives that you're trying to optimize for and you keep
08:40
You keep the best ones that satisfy that and then undergo that whole process again. So during different generations. What you do is basically mutate and crossover until like the best genes. So like the best set of recipes, the best combinations Actually end up appearing in the end. So I've also kind of summarized this in in
09:02
In the chart. So what we do is initialize the population. And now this one I want to make like a really important point, which is that actually we can already introduce all this operational constraints that we were discussing before Like the broccoli, like the tofu, we can already implement that here and make sure that any individual that we are taking into account.
09:24
Already has all those parameters. So it means that, you know, something that the food team had to spend quite a lot of time checking and thinking about something that we already You know, can very easily get rid of. So an individual is just simply not valid if it doesn't follow all these operational rules, which is already, as I say, like a big advantage.
09:45
So what we do is initialize the population. Then, as I was saying, we mutate those individuals, we do cross over on them, we evaluate those individuals, we select the best, and we start again. And this means that eventually the population becomes much better at those objectives that you're trying to get to. And after a few
10:05
hundred generations is what we tend to use. We actually can make a final selection. So we have a set of really strong You know, populations that then the food team can can go and pick which one they they prefer.
10:20
So I'm going to talk a little bit more about which objectives we used and why. But first I wanted to quickly say kind of what we've used to implement this. So we've used A library called Deep, which is distributed evolutionary algorithms in Python. It's an open source library that has kind of like supports like a range of these It's super fast to like set up and start prototyping. So it's all based on
10:44
a toolbox, you can define functions according to each important, you know, mutate, crossover, evaluate. And then it kind of takes care of the rest. So it's, yeah, I really recommend it. And also something that we haven't taken advantage of, but
11:01
that I'm sure we will at some point is the fact that you can actually use parallelization, which I'm sure will come in handy at some point. Yeah, so this is the basis of the way we've done it. Just wanted to kind of touch on the on the objectives. So basically when we first set out to do this, we decided that two
11:24
main things were going to be cost per meal. So as I said before, we need to make sure that we're that we're on budget. And then also we want to, as I said, increase the average variety which we basically measure through a range of of recipe attributes and how similar they all are within a menu. So we are working happily away on all this and then COVID hit.
11:49
And, you know, as you can imagine, Gusto is a way for you to to actually get food to your house without having to leave. So demand kind of, you know, spiked.
12:01
And actually we started being constrained by our capacity because we physically could not deliver any more boxes. So in order to help operations, we kind of again had a chance that, well, this is already a multi objective optimization and it's relatively easy to add extra objectives. So how about what we actually do is also introduce
12:24
a minimization of the number of unique ingredients on a menu. The less unique ingredients that are on a, on any given menu, the faster the boxes can get out the door. So the more we could do And obviously it was interesting because if you think about it, these are two quite competing
12:41
objectives. So, you know, it's harder to get more variety by having a smaller amount of ingredients. But it was really easy to, you know, tweak the weights until we thought we'd got a balance that we felt comfortable with. So in terms of building the menu. These are the results we've had. So we've successfully reduced the average cost per menu, which is amazing.
13:04
Really crucially, we've also given the food team time to spend actually focusing the time on important things, you know, rather than like following loads of complicated rules that, you know, ultimately a computer can do can do better, which is really important for us.
13:20
And finally, something kind of a little bit unexpected, but also good is the fact that it allowed us to be really agile through a really challenging time. So the fact that we could add that That extra optimization. The fact that actually there were loads of proposition timeline changes because of all the uncertainty and We had to redo menus quickly and, you know, if we could only had the manual way that would
13:42
have been very hard to pull off so well in all, it was great to have this in place. On the not so positive side, we do still require manual changes. We know we're not like a perfect end state. This is kind of mainly due to need of a better definition of many variety, but, you know, we're working on it. And so this is from a good
14:06
So this is from like a menu building. Now we're going to go to personalization. So, you know, obviously again 50 recipes is quite Quite a lot. So we want to use recommendations. So way of helping users kind of navigate that that large amount of choice. So what
14:24
we do is we have an algorithm that orders all the recipes for each customer and we have a personalized collection where where you land on. So the way we go about recommendations. It's quite simple. We actually use two types of recommendations. So, first of all, we have a content based part
14:46
of our algorithm, which is based on the similarity between different recipes due to their attributes so We uploaded all of our recipe and ingredient attributes to Neo4j, which you can see here.
15:00
Neo4j is a graph database. So it means that everything all the data stored in in relationships. So, you know, this pasta. Well, both of them have cuisine, Italy, this pasta has protein for this pasta has protein lamb. So this allows us to really kind of understand how similar any two given recipes are based on the attributes that they have
15:22
That they share. And also, if we couple this to what customers have ordered in the past, we have a way of understanding which recipes are most similar to your past orders. So this is really valuable because we can kind of predict what you're going to buy. But equally, you know, sometimes you want a bit more excitement and you don't want to cook or be cooked before
15:44
So we also introduced collaborative filtering and this is more based on on user similarity. So people like you also liked And what we did for this was actually get all of our users and their ordering behavior and create five distinct clusters.
16:00
So you can kind of see what they are like pescatarian, vegetarian. And so each of these clusters, we can find out what recipes they over index on. So what did they buy off most that differentiates them from the rest. So each customer is given You know, a classification. So we understand which cluster they belong to and what they over index on
16:28
So what we then do is kind of put these two together. So we have the content based approach have a collaborative based approach. And we combine them using border count, which is a method to basically put together
16:40
two different rankings in a fair manner, you know that represents the two different ones. And what we create is a hybrid ordering. Now on top of this, we add a bit of curation in the sense that, you know, maybe we are trying to, you know, proposition would like us to To push a bit more for certain recipes, because that's what we're talking about on Facebook or whatever.
17:04
And that's how we end up with like a final personalized order and that hopefully, you know, helps customers pick their recipes more easily. So in terms of personalization again like we've kind of successfully seen an increase in conversion when we apply personalization, which is great news.
17:21
And we do see customers consistently order from the highest fraction of the menu. However, we did do this a couple of years ago. And I think we need to kind of take it now take it to the next level. So we currently don't have dynamic recommendations which we know is super important. And we currently don't have a way for customers to actually give us feedback on how right or how wrong we're getting that personalization.
17:47
And just to finish off, you know, I wanted to talk a little bit about what's coming. So we're going to be tackling recipe development. So as I said, we've got our recipe library. Which our recipe developers keep adding new recipes to. So we're going to also try to take a data-driven approach
18:04
to understand where those gaps are in the library and hopefully filling these gaps should be to better menus as well. But most importantly, I think, is the fact that, you know, these are the two building blocks that we've got at the minute, but 50 recipes isn't the end destination.
18:21
When we have lots of recipes and actually you can't scroll all the way through them, we're going to need to build much stronger links between these two because recommendations is going to have to follow the principles of menu creation to ensure that the recipes we're showing you make sense as a whole, make sense as a menu.
18:40
So this is what we're trying to scope out, which is very exciting. And now to actually finish, I always like to kind of, you know, share, I think, learnings that we found along the way and I take these three from this big project. First, first of all, good discovery really sets you up for success. You know, this was a big project with the food team, with
19:07
analytics, with UX designers and really taking that time to, you know, all understand what different points of view we've had, what different learnings and what we are actually trying to solve. I think really helped us down the line. So even if you're like, you know, really excited to get
19:24
going with something, sometimes taking a little bit more time to discuss actually pays off down the line, I think. Secondly, is plan for early value release. You know, I think sometimes you really want things to be perfect, but actually, you know, we don't need all the bells and whistles to
19:43
to really start delivering value. So, for example, with the menus, we know we're not at the end, we know they're not as perfect. That doesn't mean that the food team, you know, doesn't find value in them, even if they still need to do some swaps, the fact that that is there to help them is really good. So how can you plan your work to actually make sure that you can deliver early?
20:05
And finally, I think this one kind of goes without saying, but I think it's always good to explicitly think about is ensure you're thinking about tomorrow, you know, make products and architecture decisions that you know, you're not going to regret later that are scalable because you don't really know what's coming. So try to make it as agnostic to the situation as possible.
20:26
You know, with the menu creation, we know it works for 50, but we know it also works for 250 or for 300. We know we can add different objectives. So I think hopefully that will pay off in the future. And yeah, I think those are my lessons and my story. So just wanted to thank you so much for listening. I hope
20:46
you find that useful. It was very weird not to get any kind of feedback and not know if you're talking to yourself. But yeah, thank you so much. Thanks a lot for delivering such a great talk. It was really nice to hear you.
21:00
Thank you for having me.