Digital Disruption

00;00;01;07 - 00;00;15;22

Laurence Moroney

I love the term vibe coding. It sounds so cool. It sounds so relaxing to me. It's like sitting with a cup of coffee and, you know, getting something done and solving some problems and having fun with it. Does that belong in the enterprise? Probably not.

00;00;15;24 - 00;00;35;22

Geoff Nielson

This is a show about the future of tech and the future of work. I'm Jeff Nielsen, and today I want to dive into the future of software development in the age of AI. The obituary for software development is front page news, with every other CEO boasting that 100% of their code will be written by AI and morale for coders is at an all time low.

00;00;35;25 - 00;00;56;22

Geoff Nielson

I think that is so stupid and that AI has made developers more important than ever. And my guest today to discuss that is Laurence Moroney. Laurence is an award winning AI researcher and bestselling author who is head of AI advocacy of Google for over a decade. He's currently director of AI at harm as one of the leading experts in machine learning.

00;00;56;29 - 00;01;16;23

Geoff Nielson

I consider him an unbiased voice in this space. So I want to find out what the future really looks like. Is I still a bubble? Is vibe coding the future? It is a comp sci degree destined to be completely worthless. It should be an amazing conversation. Let's jump in.

00;01;16;25 - 00;01;35;01

Geoff Nielson

Lawrence, thanks so much for joining us today. Really excited to talk to you about all things AI future of tech software development. Maybe to just set the table a little bit. I mean, you've been a fairly vocal critic, I guess, around AI hype for a number of years now around concerns that were that were in a bubble.

00;01;35;01 - 00;01;54;06

Geoff Nielson

And frankly, I have been as well. And I guess for me, it's been a little bit disheartening in some ways, not seeing that come to fruition despite, you know, some of the, I guess, underlying concerns and so I wanted to, you know, ask you now that we're here and, you know, the summer of 2026, where are we in this cycle?

00;01;54;07 - 00;02;08;07

Geoff Nielson

Has your position on this changed? Have you, you know, kind of recanted based on what you've seen about where we're at or how do you see the next handful of months playing out with this technology? And I guess the financial futures, related to it.

00;02;08;09 - 00;02;25;29

Laurence Moroney

Oh, well, there's a lot there. So let me just start, like with just like with the whole idea of hype. I'm still very much an advocate for asking people to be careful to understand what the hype cycle looks like, and not to get caught up in the euphoria and hype cycle. Right. So every hype cycle has that shape, right?

00;02;25;29 - 00;02;50;17

Laurence Moroney

That it follows you know, that it begins with a technology trigger. It rises to a peak of inflated expectations before falling down into a trough of disillusionment, before you can start rising up to to to true productivity. Right now, AI has been kind of unique in that, you know, like I said, it begins with the technology trigger. But in the air space, there have been so many technology triggers that almost end up restarting the hype cycle again.

00;02;50;19 - 00;03;10;14

Laurence Moroney

Right when I first started getting involved in AI many, many years ago, just the whole idea of a neural network was a technology trigger in the world went crazy. And then cheap neural networks and cheap data and open source, frameworks like TensorFlow or PyTorch, and then later foundation models like GPT or Gemini and all of these start these new cycles again.

00;03;10;17 - 00;03;32;01

Laurence Moroney

So I think, you know, for where I generally want to strongly advocate for people is like every time it begins with a technology trigger and you've got this massive peak of inflated expectations that if you invest too much into those inflated expectations, instead of tunneling through to understand, I mean, it's horribly named the Trough of disillusionment. But, you know, to to to understand what that really means.

00;03;32;01 - 00;03;53;26

Laurence Moroney

And that's you become disillusioned with all of the extra hype, you become disillusioned with the nonsense, and you start understanding what the technology really is and what it can do and how it works. And you're making your decisions based on your own understanding, rather than all the noise that's floating around, then things will always be good. That's the point of the hype cycle chart.

00;03;53;28 - 00;04;10;10

Laurence Moroney

Where the pain happens is when you don't do that. So that's all of the leadership that I've brought to places where I've been, and all of the advocacy that I do is really all around. That is like, you know, I joke sometimes what I'm a professional disillusion or but I think, you know, that's really what you want to be like.

00;04;10;10 - 00;04;31;13

Laurence Moroney

You know, once you get beyond that peak of hype and that peak of mis set expectations with any technology, not just with AI, that's when you can start becoming truly productive. And that's where you can start guiding the positive future that you want. So for the people who do that, like you, ask about future and future prospects and those kind of things, it's like, that's what I encourage them to do as well.

00;04;31;16 - 00;04;44;17

Laurence Moroney

And the key to getting there is really understanding the technology, what it is, how it works, what its merits are, what its costs are. And, you know, and then start making smart decisions for your business or for your life around that.

00;04;44;19 - 00;05;14;10

Geoff Nielson

So, Lawrence, I'm really glad that you, you know, in some ways unbundled the fact that AI is this whole bundle of technologies and we use this sort of nebulous term to describe an awful lot of different things that can have an awful lot of different outcomes and serve an awful lot of different purposes. One of the things that I guess I struggle with is the difference between what people tend to be using the technology for now, in practice, versus the promise of what it could one day do.

00;05;14;17 - 00;05;36;18

Geoff Nielson

And I was actually just recently looking at, a survey data set we had conducted with a number of firms who had said that, yes, they're actually ahead of the curve in their AI usage. And when I dug into, well, what does that actually mean? It's almost all kind of, you know, standard automation of the most boring business things you can imagine, right?

00;05;36;18 - 00;06;04;16

Geoff Nielson

Like it's saying while we're using AI for meeting notes and we're using AI for, you know, automated document creation and a little bit for development. And so I'm curious, you know, it feels like there's this promise that something better than that, something more exciting is driving this hype. What are what are you actually seeing in practice? Is there a much more exciting wave right around the corner, or is this it?

00;06;04;16 - 00;06;09;04

Geoff Nielson

And it's fundamentally a productivity and efficiency tool.

00;06;09;07 - 00;06;33;22

Laurence Moroney

It's a great question. I mean, I think there can be, fundamental improvements around the corner. It's just up to us to decide how we want to embrace them. Now, ultimately, what I found, you know, for years working in AI, where the people have been the most productive, whether it is really in two main things. The first one is if you're taking an existing thing that you need to do and making it much more efficient and making it much more productive.

00;06;33;24 - 00;06;54;09

Laurence Moroney

Now that could be mundane. Things like meeting notes like you've mentioned, but it could also be global scale, things like, you know, massive business processes to be able to cut inefficiencies out of them. Every business is different. Every process is different. But like the family in the category of things that you would do is the same, right? It's adding productivity, it's reducing inefficiency, it's reducing waste.

00;06;54;12 - 00;07;18;11

Laurence Moroney

You know, by doing things intelligently. And whether that's with biological intelligence from people or artificial intelligence from machines, I mean, or a combination of the two, which is my preference, you know, that that's the way forward. The second of these classes, to me, is the more interesting parts, and that's doing things that were previously considered infeasible or impossible without the use of artificially intelligent technology.

00;07;18;13 - 00;07;47;12

Laurence Moroney

Like, I mean, a very simple, trivial one is most of us wear some kind of a watch, right, for fitness nowadays. Now that watch can detect our activities, right? My watch. If I'm running and I forget to tell it that I'm running. It detects that I'm running. There was a small, artificially intelligent application running on that watch that's detecting a change in my behavior and increasing my overall user experience with the watch, and making me much more likely to want to wear this 24 over seven and buy a new one when it comes out and those kind of things.

00;07;47;14 - 00;08;05;01

Laurence Moroney

Now, that was the kind of application that was infeasible before AI, right? If you were trying to build something that detects somebody's activity to to see if they're walking, running, biking, golfing or whatever, in order to create a better user experience on a product like a watch. I mean, it would cause there would be millions of lines of code.

00;08;05;01 - 00;08;35;24

Laurence Moroney

It would be too big to fit on such a device. But with AI and machine learning being able to train a model based on the data on the watch to be able to detect those activities suddenly became feasible. Now, that's a relatively trivial example, but think about any business and the big things that they would love to solve, but they are financially infeasible, computationally infeasible, or whatever to be able to start pivoting towards thinking about how do we make those infeasible feasible with automation, with AI, with maybe AI jointed workflows and stuff like that?

00;08;35;29 - 00;08;53;21

Laurence Moroney

And that's not second category. And I think that's where the massive growth will come from. And and I do see people thinking in those terms already and doing things in those terms already, and they're probably not the ones necessarily talking about it that much because they want to continue to build on the advantages that they get from building in that way.

00;08;53;23 - 00;09;21;08

Geoff Nielson

It's a it's a really interesting example. And I really like it in some ways. And one of the things I like about it is in that example, AI is not really the star of the show, if that makes sense. Like it's kind of an enabler of a completely separate product or a completely different vision that's now unlocked by AI versus, you know, I'm selling you I, I'm, I'm selling you a fitness tool that happens to use AI.

00;09;21;11 - 00;09;26;24

Geoff Nielson

Is that indicative of the types of, I guess, value that we're going to see unlocked here?

00;09;26;26 - 00;09;48;06

Laurence Moroney

I mean, I think it's indicative of the type of right thinking in order to be able to unlock value. Right. You know, there's a phrase that's been knocked around for years that AI is the new electricity. Okay. But then think about, you know, that a little bit more deeply. Electricity is not something you get excited about, right? You know, electricity is just something that you expect and it drives things.

00;09;48;08 - 00;10;08;24

Laurence Moroney

I'm in a room that's lit up because of electricity. I'm speaking on my laptop. Some battery is still electricity. I'm speaking to you because of electricity, you know, and it fades into the background and it empowers things that were previously infeasible. I'm currently on the 18th floor of a building in Seattle, right? Without electricity, it would be a lot of steps to walk up to get here.

00;10;08;25 - 00;10;33;16

Laurence Moroney

It would be very difficult to light heat, cool all of those kind of things, but the electricity itself just faded into the background and makes all of this type of thing possible. And to me, when if you're thinking in terms of AI and particularly going beyond the immediate future, that it's the types of applications that are made possible when I fades into the background and we don't get excited about AI, but we get excited about the application that it empowers.

00;10;33;23 - 00;10;56;15

Laurence Moroney

Like my trivial example of fitness on a watch, that's when you start getting into the real productivity. And when I start talking about those two classes of things, the thing that was previously considered infeasible but someday will be considered default is the kind of thing that would be powered by AI, and that's the area of massive growth and optimism that I have is thinking about what those applications are.

00;10;56;17 - 00;11;30;14

Geoff Nielson

If you don't work in enterprise technology, you can skip ahead or take a quick brain correction. But if you do, infotech is your secret weapon. Infotech helps IT teams get projects done faster, better, and at a lower cost. Whether you're rolling out new tech, improving processes or just looking for cost savings. Infotech provides unlimited access to practical tools and expert guidance you need to execute at a fraction of the cost of traditional consulting, no matter the project from AI strategy to cybersecurity to vendor negotiation, Infotech has you covered.

00;11;30;17 - 00;12;14;02

Geoff Nielson

Check it out at the link below, and don't forget to like and subscribe! I, I really like that. And I'm just, you know, sort of processing that. And I'm, I'm thinking about that in relation to the way AI is talked about these days still. And yeah, for better or for worse, one of the big differences between the advent of electricity and call it even the first 50 or 100 years of electricity and the present day around AI is this sort of media sphere and the channels we have and this sort of, I don't know, I guess, engagement driven behavior where everybody feels incented to see who can, who can compete by saying that AI is

00;12;14;02 - 00;12;29;16

Geoff Nielson

going to be the greatest or it's going to be the worst, right? Like it seems like any sort of rational middle ground gets gets drowned out, like, God forbid you say that an AI driven future will be 10% better than a future. You know, without AI. Like, it's like the most boring thing you could possibly say.

00;12;29;22 - 00;12;31;08

Laurence Moroney

So 6.4%.

00;12;31;10 - 00;12;56;22

Geoff Nielson

Yeah. There you go, there you go. Yeah, even a boring number. So I guess with that in mind, are there any stories you're hearing a lot of or any narratives that you consider red herrings that that are taking up an awful lot of oxygen in the room around AI that you think are, you know, close to utter nonsense and is there, you know, a reality there that's maybe not being discussed because it's too mundane.

00;12;56;22 - 00;13;00;16

Geoff Nielson

That's a better model for how we should be thinking about this.

00;13;00;18 - 00;13;20;22

Laurence Moroney

I mean, I think some of the red herrings that drive me crazy are the ones where absolute statements are made, right. We don't need humans anymore because we have an agent that does this or, you know, we don't need coders anymore because we have a model that can write code, you know? And it's like, I always like to say understanding is a triple edged sword, right?

00;13;20;22 - 00;13;42;06

Laurence Moroney

There's, you know, there's one extreme that's the other extreme, and that's the truth in the middle. But all three of these were cut. You, so like the red herrings on one side, you know, are cutting very deep and making people very upset, like, things like coders are not needed or particular jobs are going to go away. And you'll notice that over time, the people who are telling those stories are backtracking, right?

00;13;42;06 - 00;14;04;29

Laurence Moroney

They're realizing that's not the case. The downside, though, is like people who make a business decision based on those opinions and then make decisions that will impact real lives based on those opinions on this side are very, very poor business decisions and very, very poor leadership. So it's like those type of red herrings where it's sensationalist, it's absolutists, and those kind of things are always the ones that end up getting dialed back.

00;14;04;29 - 00;14;25;15

Laurence Moroney

But how much damage is done before they get dialed back is what you know. Is this some of the things that I'm very passionate about advocating don't do that. You know, it's like make be smart in making your decisions, and you certainly don't want to jump on the bandwagon because I think you use the word engagement based that when people say something inflammatory like that, they get a lot of engagement, right?

00;14;25;15 - 00;14;42;25

Laurence Moroney

They get a lot of reward for doing it. But it's a very short term reward where they're sacrificing the future to save the present. And, you know, and I just like that. Would that's always the advice that I give to people in business settings and in one on one is like, look at those people who've got the most engagement and then ignore them, right?

00;14;42;25 - 00;14;58;13

Laurence Moroney

You know, and then no offense, if you have a lot of engagement, listeners, but, you know, you know, but it is one of the things that those inflammatory stories are out there. And it's funny because I work a lot in the science fiction field. I've done some consulting on movies and TV shows and stuff like that.

00;14;58;13 - 00;15;18;13

Laurence Moroney

And so I get to work with a know a lot of sci fi writers. And the sci fi writer mindset in some ways is the same because, like, you know, when they're writing a story, it's almost like, hey, every story needs an antagonist. And right now the modern antagonist is the specter of AI, right? And it's very easy for us to write stories about the specter of AI.

00;15;18;13 - 00;15;43;14

Laurence Moroney

And like, you just turn on any movie right now, and it's like there's Terminator as there's AI being the bad guy or whatever, you know, and it's, and it's the cut from the same cloth. But there's so much opportunity to kind of not do that. The other side of the spectrum, of course, of the AI optimists, where it's this happy hippie future where AI is going to give us abundance and, you know, every problem is going to be solved.

00;15;43;14 - 00;16;10;08

Laurence Moroney

And, you know, it's like it's very pleasant and it's very nice, easy. Very nice reading and very reasonable sounding. But unfortunately, that's just far from the truth as well. I think the key thing that's beholden on us is to try and figure out where society actually is, and where the technology actually is between these two extremes. Understanding that that will also cut you, but to be able to navigate that and navigate that effectively, I think is the job of every leader out there.

00;16;10;08 - 00;16;15;27

Laurence Moroney

Not just business leader, not just political leader, but also technical leaders like you and me.

00;16;15;29 - 00;16;43;01

Geoff Nielson

So with that, let's try to walk that middle line for a minute. And, you know, maybe in relation to the example you used earlier of coders aren't needed anymore. And there's an adjacent, there's an adjacent saying I'm hearing lately, too, which is mostly CEOs. It never seems to be like CTOs saying that, 100% of code will be written by AI in their company and so so I'm curious, you know, what's your reaction to that?

00;16;43;01 - 00;16;54;16

Geoff Nielson

It is coding, you know, a field that, you know, folks shouldn't go into any more, and it's just going to be considered completely antiquated. What what is the future of software development in an AI age?

00;16;54;19 - 00;17;16;09

Laurence Moroney

Great question. I want to start, though, with that 100% statement that whenever anybody says 100% of something, blah blah, blah, blah, I automatically don't believe them, right? Because it shows that careful measurement hasn't been done right. You know, there no way you replace 100% of something with something overnight, that kind of thing. There's that. It's that sounds like a sensationalist statement off the bat.

00;17;16;11 - 00;17;32;12

Laurence Moroney

Now, you could say maybe the majority of our code is going to be AI generated, or more than three quarters of our code is going to be AI generated. And then I'm going to listen to you and I'm going to listen to your reasoning. But my encouragement would be as soon as somebody puts an absolute number like that, you know, my my BS detector goes off.

00;17;32;15 - 00;17;52;24

Laurence Moroney

That'll be the first part. The second part, though, is like just talking about coding itself. I think the optimist in me, which is usually the dominant trait, generally says that. I mean, I've been coding for many years, like 40 plus years. And what I've seen is that every advance in coding has moved me up the value chain.

00;17;52;26 - 00;18;12;16

Laurence Moroney

Right. You know, the very first coding I was doing was very primitive, able to do very primitive things on very primitive machines. As time went on and code got more and more sophisticated, you know, like, for example, the emergence of the internet and being able to write code and things like Java blessed. So, you know, that kind of stuff that allowed me to then move up the value chain.

00;18;12;16 - 00;18;30;10

Laurence Moroney

And instead of previously, I was writing a piece of code that would run on one machine for one user. I can now run a piece of code that runs on one machine for a billion users, and the value that I bring continually is moving up the value chain. As a result, there's no reason why anybody should think of AI differently.

00;18;30;13 - 00;18;56;17

Laurence Moroney

The idea of being able to generate code instead of writing code can be very seductive and thinking, hey, I don't need to put in the brainpower to write a proper solution anymore. Because AI engine X can generate that for me. But the reality is, once you sit down and you start doing it, is that while it can do a lot of the drudgery work for you, it can never create that full solution to your actual problem and to your needs.

00;18;56;20 - 00;19;28;04

Laurence Moroney

It's great for flashy demos. It's great you can see somebody vibe vibe, coded a breakout game in five minutes and oh my gosh, amazing. Fantastic. Really fun. But once you start getting down into real solutions, there's domain expertise that's needed for a particular thing. There's domain expertise within your company. If you're building it for your company and the solutions that they have, and there's all of this extra stuff that cannot be generated by a general coding machine, but it can take the drudgery out of your work.

00;19;28;04 - 00;19;43;28

Laurence Moroney

So maybe you can do something in one day that used to take you ten days. Or if I go back to what I was talking about, the feasibility side of it, you can start building things that were probably too expensive to build in the past. But you, as the human, are continuing to move up the value chain as a result.

00;19;44;00 - 00;20;02;19

Laurence Moroney

So it's the encouragement that I always give to developers that if you're developer identity is entirely about your ability to code you you might need to refactor a little bit there, right? You know, remember those t shirts I turned code into? I sorry, I turned coffee into code. You know, those kind of things. I like that developer identity.

00;20;02;19 - 00;20;29;09

Laurence Moroney

I used to wear one of those shirts. The realization is as code becomes possible to auto generate, if all you can do is code, then that's where you might need to think about your like your choices a little bit. But if you are able to take the ability to solve a real problem and turn that into code and now expand that ability by being able to generate much of that code, you're suddenly more valuable, not less valuable.

00;20;29;12 - 00;20;54;00

Laurence Moroney

So, you know, I would continue to encourage developers to invest in your skills, to invest in your development skills, and to continue to do that, because all of that stuff of, you know, people saying, I don't need coders anymore because it's 100% generated, you know, I'm sorry, red flags are waving like crazy when I hear that. And then the other part that I would say is when it comes to software development, that is a new thing that I'm seeing emerging.

00;20;54;00 - 00;21;12;02

Laurence Moroney

And there is no real term for I call it ephemeral code, where once upon a time, as software developers, our job was to build a product, right? And then that product would ship might ship on a server so that billions of people could use it and it might chip on a desktop. So one person at a time could use it.

00;21;12;05 - 00;21;33;00

Laurence Moroney

But there was an artifact that we actually shipped we had to maintain. It was an app and an app store, those kind of things with the cost of code generate with sorry, with the ability of code generation driving the cost down. There's the whole idea now of being able to, hey, I can spin up code to solve a particular problem and then I can throw the code away.

00;21;33;00 - 00;21;50;09

Laurence Moroney

I don't need it anymore. And as a result, a lot more bespoke solutions can start happening. Whereas in the past I had to think in terms of when I write code, what do I have to do to maintain it, what do I have to do to pass it on to somebody else? Now, there are many, many solutions out there where it's a case of, you know what, I don't need to build a product for this.

00;21;50;09 - 00;22;18;05

Laurence Moroney

I don't need to buy a product for this. I can spin up a piece of code to solve this particular problem for me, and then I'll take on the technical debt of maintaining that code anymore. And the mindset behind doing that, I think, is only going to grow as more and more and more prevalent, particularly in enterprises. And as a result, the coders and the engineers who can do that and who can solve a problem quickly, or who can train the non engineering staff to be able to do that and take some of the burden off them again, is a very valuable skill.

00;22;18;05 - 00;22;21;13

Laurence Moroney

Moving them up the value chain.

00;22;21;15 - 00;22;42;14

Geoff Nielson

I find that the ephemeral code model really interesting. And part of the reason I find it interesting is it seems like it's sort of the polar opposite of so many of the principles of coding that have been, you know, what we've been taught for so long, right? We almost treat code is eternal, like this is something that's going to outlive you.

00;22;42;14 - 00;23;03;26

Geoff Nielson

So make sure that you comment it well that everything's documented, that it's that it's clear, versus the idea that could have it could ever be disposable. So if it can be disposable, I guess, what are the implications of, you know, the coding ecosystem, but both technically and organizationally surrounding it?

00;23;03;29 - 00;23;35;15

Laurence Moroney

That's the question right now. How do you project that forward? I think one of the biggest implications, if I'm right, you know, and if memorable code becomes more and more important, like for example, in enterprises, then the those big fat general purpose applications that are designed to do almost everything, I worry about, like, you know, the continuing to build and maintain and support those, whereas, you know, if you know, you there's that 20 pound hammer for the 1 pound nail, right?

00;23;35;15 - 00;23;56;07

Laurence Moroney

You know, whereas like, you know, many business problems, if you can solve them with a 1 pound hammer, that disposable 1 pound hammer equivalent of a disposable razor, for example, that kind of thing, why not? And, you know, so there's long term implications there, I think, in how we build general purpose applications, which are still going to be necessary.

00;23;56;10 - 00;24;22;08

Laurence Moroney

But I think those general purpose applications, if I were to guess, would probably slim down a bit because they are they tend to have to be over generalized. Right? You look at email applications, they can do everything, you know, that kind of stuff. What if they become focus just on email. And for some of those problems that one person solves one time a month, do we do we need a big, expensive application for them to be able to do that thing?

00;24;22;10 - 00;24;47;24

Laurence Moroney

You know, one person in the enterprise to do that one time a month. Or do we need something that is so customizable that a software engineer has to spend a month customizing it so that person can, you know, once one person, one time a month, use it. And so that kind of the, I think the age of those gigantic pieces of software that are general purpose, you know, that might be changing very drastically as a result of example software.

00;24;47;26 - 00;25;14;02

Laurence Moroney

I think, I mean, I just use one particular example was, a couple of years ago, before I joined. Aam I was working on, forming a startup to help people make movies using AI. And I was creating a piece of software for that. So this would be a desktop application, you know, that had a thing in it that I call the meat grinder that would take the, you know, your script or your story or whatever, and it would break it up into all the tiny little artifacts that you need.

00;25;14;09 - 00;25;38;08

Laurence Moroney

You can't just push a button and turn a script into a movie with AI. You know, there's so many stats and processes and shots and artifacts and all these kind of things. And to take all of that complexity out of the user. And I got pretty far along in building this thing. And then I realized when I made my first movie that all of the things that I would have to do to this, you know, to make it general purpose enough for just my movie, never mind somebody else.

00;25;38;08 - 00;25;55;21

Laurence Moroney

The cost of building all of that was like, it was just cheaper for me to do bespoke software for the movie and to start. And that's where the, the idea of ephemeral software came to me. And then I abandoned the idea of building this desktop application, you know, and I think, you know, though, that I can see that will happen a lot.

00;25;55;24 - 00;26;14;13

Laurence Moroney

If I again, if I go back to the enterprise, where the enterprise will have people who need to solve a particular problem, transform this data from this to their supply, these analytics to add value. Wouldn't it be better over time for many of these problems to be solved by somebody who could just spin up a bespoke project to do that?

00;26;14;15 - 00;26;34;20

Laurence Moroney

Going back to the old, you know, the two things that I mentioned earlier, right, like, you know, making existing things more productive or doing things that were previously infeasible, the idea of bespoke projects was previously infeasible. But now suddenly has become feasible and and it may be the right decision in many cases.

00;26;34;22 - 00;26;58;00

Geoff Nielson

The example is really interesting and I can I can certainly see a number of use cases for that. The piece where I'm still trying to sort it out in my mind, I guess Laurence, is if we're talking about large scale enterprise information systems and suddenly there's data in the mix, if we're talking about ephemeral code, does that create, I guess, a traceability problem for us?

00;26;58;00 - 00;27;14;19

Geoff Nielson

If we have to go back later and say, what did we actually do here and validate whether we actually use the right data or, you know, have some sort of common language for the data and can confirm that we're making decisions based on the right information.

00;27;14;22 - 00;27;41;27

Laurence Moroney

Oh, absolutely. I mean, I'm not saying it's a it's a drop in replacement for every scenario. And this sounds like a scenario where you don't want to do that right? So I mean, let me give an example and pulling it out of the air right now. So forgive me if it's wrong, but I mean, I used to work in, financial services enterprise many years ago in Times Square in New York City, and a lot of my job as a software developer would be configuring existing pieces of software so that analysts could run experiments.

00;27;42;00 - 00;28;00;05

Laurence Moroney

So, for example, they would come up with a new analytic that would take in various pieces of data to establish a value for a company. So then we could tell company A, if you know who company A wants to buy, company B, you know, we could tell a company A, well, here's our analytics of company B and here's why we think it's worth it or not worth it.

00;28;00;07 - 00;28;29;28

Laurence Moroney

And there was a crazy amount of configuration of heavy enterprise software that I would have to do to be able to come up with those analytics, to come up with those answers where an analyst would define the analytics and I would encode them into a, into a pipeline. And the idea of ephemeral software, it could be just simply a case of, you know, I sit down with this analyst for five minutes and I code up a thing, you know, that takes a data piece is A, B, and C feeds them through a pipeline that I've just spun up, applies this test analytic to.

00;28;29;28 - 00;28;59;04

Laurence Moroney

It gives an answer. And then he realizes now his analytic that he designed is all wrong. Let's go and start that again. That type of thing. You know, that type of prototyping is a clear case for it. But I would say that that will pull through, that there will be many solutions in the future, I believe. And maybe if people are doing it right now, where it's the case of why would we need to configure big, heavy pieces of software to, you know, put a square peg into a round hole to try and sort out a thing when we can just spin up something quickly to do that solve the problem that we have in

00;28;59;04 - 00;29;02;09

Laurence Moroney

mind, and then move on.

00;29;02;11 - 00;29;21;06

Geoff Nielson

That example is really interesting to me, and I want to play with it for just a second because it it teases out something. That's another one of these, discussion points, which is vibe coding, which you mentioned earlier, because when you used how this could look in 2026, Lawrence, what you didn't say is there's no you or no developer at all.

00;29;21;06 - 00;29;44;21

Geoff Nielson

You didn't just say the analyst will do it all themselves and they'll pull it all out with no intermediary. And so I'm curious with that example and in general, your perspective on vibe coding or like an actual true coder less future where you've got just call it business generalists or, you know, operational users who are doing everything, you know, using their own devices.

00;29;44;24 - 00;30;06;13

Laurence Moroney

Yeah. So first of all, I love the term vibe coding. It sounds so cool. It sounds so relaxing to me. It's like sitting with a cup of coffee and, you know, getting something done and solving some problems and having fun with it. But does that belong in the enterprise? Probably not. Right. You know, there's maybe an element of code generation, which is part of vibe coding.

00;30;06;16 - 00;30;27;01

Laurence Moroney

Yes, it does, but I think the core of your question here is like, you know, if I giving back my example of me working with an analyst to figure out a particular problem, what am I even necessary in a future where code can be generated, or can the analysts do it themselves? In some cases, I would say the ability to create the code to solve a problem could be moved to the non coder.

00;30;27;01 - 00;30;48;24

Laurence Moroney

Absolutely. Does that mean coders will go away? I still say no. I still believe that moves the coders up the value chain. And one important part of moving them up the value chain that I'm personally passionate about is when we look at AI models doing things for us, remember that AI models are trained to be generalists and not specialists.

00;30;48;27 - 00;31;06;01

Laurence Moroney

If I'm within an enterprise and I need to do a thing within the enterprise for the AI model to be as effective as possible, it has to be a specialist for my enterprise. There are secrets in my enterprise that I'm not going to share with the third party. There are techniques in my enterprise that have grown up over time.

00;31;06;06 - 00;31;34;14

Laurence Moroney

There are standards of communication or coding or documentation in my enterprise that a uniquely ours, and at some point the model is going to have to be trained on those. And that brings me to like the thing that I'm most excited about in the field of AI is the smaller models becoming more and more intelligent, and those smaller models then, because in many cases the weights are made open, that I can take those weights and I can retrain them or fine tune them on my own data and on my own techniques.

00;31;34;21 - 00;31;55;04

Laurence Moroney

Again, that's a job for a developer, right? No, for the analyst. And that's a job for the developer that has suddenly moved them massively up the value chain compared to just general coding. And and then once they've done that, that's a model that needs to be continually maintained. That's a model that needs to continually be retrained as new information is coming in.

00;31;55;06 - 00;32;10;12

Laurence Moroney

And that's a model that then becomes inherently value. So that may be some of the tasks that were previously needed by a coder can be done by a non coder domain expert. But your job as a coder has again increased your value to the business.

00;32;10;15 - 00;32;31;26

Geoff Nielson

Let's talk about those smaller models for a minute. So if we're if we're trying to make this really practical and we're talking about coders in an enterprise organization, what could that look like? And if you're, you know, I guess a business leader, like a, a technology leader within your business, how should you start investigating this? And, you know, what would that look like and what would it yield?

00;32;31;26 - 00;32;49;00

Laurence Moroney

You sure? Sure. So total shameless self plug. I'm writing a book on this at the moment with O'Reilly. So, fine tuning, small models. So forgive me. Totally shameless of me. So I would like to. So some of the things that I talk about in that are exactly the answer to your question, right? There's no magic pixie dust.

00;32;49;06 - 00;33;12;15

Laurence Moroney

Excuse me. It's no magic pixie dust that you can sprinkle in a problem and it will be solved. It involves hard analytical work. So for example, if you want to fine tune a model, to do a particular task, and the task that I go, in the book is really for a doctor's office to be able to have a model that can help do front desk work and help answer some basic questions.

00;33;12;18 - 00;33;32;25

Laurence Moroney

And the reason why you would fine tune the model to do it is that if you look at an AI model today and you ask a particular questions, it's very robotic in how it answers. It's very machine like and how it answers. So part of the fine tuning will be let's fine tune it, a with knowledge that it may not have already and be to speak in our voice.

00;33;32;27 - 00;33;55;03

Laurence Moroney

Right. We want to appear friendly. If a parent has a sick child, we want to reassure them. You know, we don't want to give them a checklist, you know, things like that. So the pipeline that you have to do that, first of all, is gathering the data, right? Gathering sufficient data to be able to retrain the model. And then perhaps most importantly, is formatting the data in a way that you can then efficiently fine tune a model.

00;33;55;05 - 00;34;14;22

Laurence Moroney

You know, the images out there that we just shovel it in like coal into a burner, but it doesn't really work like that. There's a lot of work that has to be done, and a lot of power model specific work that has to be done based on how an individual model will expect it. So that requires a lot of brainpower, requires a lot of engineering expertise to be able to do that.

00;34;14;25 - 00;34;31;03

Laurence Moroney

And then the job of fine tuning once you've done that is relatively easy, right? It's a case of now that you've told shown the model. Lots of example. Sorry. Now that you've defined lots of examples of how the model would like to see it and how it understands it, now you simply go and you show the model to do that.

00;34;31;05 - 00;34;54;04

Laurence Moroney

There's a technique called Laura low rank reduction or low rank adaptation. That's actually used to do that. And that's relatively easy and relatively cheap to do. You're talking thousands of dollars of GPU time, not billions of dollars of GPU time to be able to do such a thing. And now you have a model that you can deploy, and then you do all of the engineering principles that you know are ageless.

00;34;54;11 - 00;35;10;29

Laurence Moroney

You're putting it out there, you're gathering data, you're gathering metrics, you're seeing how well it works, you're seeing what doesn't work, and then you start the whole ops life cycle of continual improvement. And now you have a model deployed in the enterprise that's specific to that enterprise. Now the example I gave was Q and A for a doctor's office.

00;35;10;29 - 00;35;33;06

Laurence Moroney

But there's no reason why that couldn't be your code and your analytics within your enterprise, or whatever it is that you want to fine tune the thing to be an expert on. And I think, you know, that's ultimately where we're going to start driving a lot of value in the AI industry. The other benefit, of course, of these small models is that you can run it on your laptop so you have privacy.

00;35;33;08 - 00;35;46;25

Laurence Moroney

You've, you don't have the latency issues. You don't have you don't need expensive data centers, like, in order to be able to run this on and all of those kind of things become feasible and become possible.

00;35;46;28 - 00;36;10;10

Geoff Nielson

There's that. Then that makes a lot of sense to me. And there's a few implications in there that I want to tease out. Sure. One of them is an incumbent. It comes back to just things you were talking about earlier, but I like it because it really feels like it's solving a real problem, or it's designed to solve a real problem rather than just starting with, hey, we need to get more AI in our business.

00;36;10;13 - 00;36;32;20

Geoff Nielson

Yeah. And it feels yeah, it feels a lot more like, how do we actually use this as a tool that's going to help us versus taking a technology first approach. And and it cuts through a lot of the hype. We talked about, which makes it feel very practical to me and a very different model from what we're seeing.

00;36;32;23 - 00;36;38;12

Geoff Nielson

You know, I guess the, the clods and the ChatGPT showed from the mountaintops.

00;36;38;14 - 00;37;08;20

Laurence Moroney

Yeah. I mean, absolutely. I mean, there's still always going to be use for the gigantic models, right? But the idea of them being the sole way to use AI is, I think, the big mind shift that we need to start thinking about. I do see a bifurcation happening right as those bigger models become better and more intelligent, and to trained on with new techniques and new data and all of those kind of things, there will be problems that only they can solve.

00;37;08;23 - 00;37;26;07

Laurence Moroney

But the mindset of the only way to solve problems is with them is the thing that I think would need to change, and that's that bifurcation that I'm talking about, that the smaller models are no longer just toys, right? A lot of the innovation that's gone into model architecture to make models more efficient is actually being driven by the small ones.

00;37;26;09 - 00;37;50;18

Laurence Moroney

You look at things like NeurIPS papers. Last year, I believe it was, Quinn, there were more papers designed on the Quinn model than they were on any other model. So that's small model mentality is beginning to come in. But not just a small, untrained generic model. The real value becomes when you have this small fine tuned model on your specific task.

00;37;50;20 - 00;38;17;05

Geoff Nielson

The other implication of that, Laurence, that I wanted to talk briefly about is in that world, it strikes me as doing that effectively in some ways, means there's going to be more engineering in your company rather than less, which is, again, kind of diametrically opposed to some of the conventional, you know, leadership wisdom that's happening around AI. And I'm curious because, you know, I am somewhat involved in the coder community.

00;38;17;07 - 00;38;46;15

Geoff Nielson

And, you know, I follow their forums. And the overall sentiment about the future of software development feels like it's shifted into quite negative territory in the last year or two, as though, you know, the sentiment is that senior leadership is trying to reduce the amount of engineering happening in their organization and in some case, they're following that up by, you know, divesting themselves of, you know, large numbers of coders.

00;38;46;15 - 00;39;00;03

Geoff Nielson

And so, I mean, if that happens, it makes it substantially more difficult to do some of the things you're describing. How do you see that playing out for the organizations that are doing that, that are trying to decrease their engineering footprint versus increase it?

00;39;00;10 - 00;39;20;00

Laurence Moroney

You know, I mean, the first thing I would remind them is like, you know, we have seen stories of the engine of organizations that have done that. We've also seen many stories of organizations who've regret doing that or at least they did it too quickly. And and I think that's the first big reminder. The second big reminder is, I mean, there's an old adage that you cannot shrink your way to growth.

00;39;20;03 - 00;39;43;02

Laurence Moroney

Right? And I can understand that, like, if you're a business leader today and you're looking at the expense of your engineering and you're looking at the benefits that that engineering is giving to you, and you're doing a cost benefit analysis, and then you're reading those stories of this kid who can go to cloud and build a product overnight, you know, that kind of stuff, that there's certainly a lot of pressure on you to start making cuts and changes.

00;39;43;04 - 00;39;59;18

Laurence Moroney

But I think that my advice there is to resist that pressure and to really understand a the truth about that story about, you know, the kid use cloud divide code of thing and be, you know, how you can take the existing engineering resource that you have and grow the amount of value that they bring to your company?

00;39;59;20 - 00;40;26;01

Laurence Moroney

I and the idea of being able to a at least generate code to be able to expand the domain of any particular developer is really interesting and seductive and and powerful, one that can work. But, you know, right at the beginning when we were talking, I was saying, there's two things, right? There's making existing things more productive, but then it's discovering things that were previously infeasible.

00;40;26;04 - 00;40;47;28

Laurence Moroney

And I think the role of a business and technical leader there would be like, well, what are the things that are infeasible today that will grow our business, you know, ten x or 100 x? And like, can we start using the resources that we have today? The engineering folks that we have today who know our business, who know our stuff and start deploying them differently and start giving them the ability to expand their domain.

00;40;48;00 - 00;41;11;06

Laurence Moroney

One of my favorite sayings is, the pursuit of happiness is the exercise of vital powers along lines of excellence, affording them scope. Right. You know, and I think here the pursuit of profit and the pursuit of productivity is the same thing. It's taking those vital powers that you have, giving them new lines of excellence and giving them scope and being able to massively grow your business.

00;41;11;09 - 00;41;30;27

Laurence Moroney

You can play the defensive game and be in retreat by doing those kind of cuts, but what's going to happen is somebody who's not doing that, somebody who's innovating, somebody who's thinking out of the box, somebody who's doing the infeasible things will be that company that disrupts you, right, and will be that company that takes over your business eventually, and you don't want to be in that position.

00;41;30;27 - 00;41;55;16

Laurence Moroney

So I'm very much I've been a software developer my entire career. I've been writing code since I was ten years old. You know, I, I'm not saying it because I have part of that identity, you know? But I'm really saying it because it's just common sense that when you see through the curtains of hype, that there's so much opportunity there by investing in your skilled people rather than by cutting your skilled people.

00;41;55;19 - 00;41;56;28

Laurence Moroney

Yeah.

00;41;57;01 - 00;42;23;20

Geoff Nielson

So assuming we keep our skilled people and assuming we've got the, I guess, wisdom or forethought to actually focus on what are the new opportunities, what can we unlock with technology that never existed before? What do you see as the role of coders, of CTOs, of CIOs, of of technology leaders? And is it changing or is it the same as it's ever been?

00;42;23;22 - 00;42;29;12

Laurence Moroney

Oh, it's changing. I mean, I don't think it's ever been the same as it's always been because it's constantly in flux. Right.

00;42;29;13 - 00;42;30;21

Geoff Nielson

Well. Well said.

00;42;30;23 - 00;43;08;05

Laurence Moroney

You're right. You know, even if you take it out of the picture, it's something that's been constantly in flux. And we have to realize that, you know, the curve of change is accelerating, but it's still it's always going to be changing. It's interesting that the first named entity that you use, there was coders. And I think if your personal identity is as a coder, that's the person that I would appeal to most to say you're the one, unfortunately, who probably has to do the most self-reflection and the most adaptation in this world, because if all you can do is code, it's you have to realize that, you know, models can code just as well

00;43;08;05 - 00;43;29;24

Laurence Moroney

as you can, but faster, you know, or maybe they can code better than you can, but faster. So you have to start like thinking of your identity above being a coder, right? You know, and like I've been using that phrase moving up the value chain. Right. So what is it as you. As what? Somebody who's passionate about, who loves doing it and who's very good at writing code.

00;43;29;26 - 00;43;55;01

Laurence Moroney

How is it that you move yourself up that value chain? Obviously it differs for every business, but I would say the brunt of change and the brunt of needing to make personal changes to adapt to that change is most heavily on you, but the opportunity is also the greatest for you, right? So like, you know, and I think that'll be something that I encourage every coder listening to this and then every CTO, I can't remember you said coder CTOs, I can't remember.

00;43;55;01 - 00;43;57;01

Geoff Nielson

The others, I said CIOs as well and technology.

00;43;57;03 - 00;44;10;02

Laurence Moroney

So yeah, you know, I think for you, what I would encourage you is to realize that these people in your organization who are engineers, who are coders, who are forward deployed, a code of what it is, I think the new term for.

00;44;10;02 - 00;44;10;16

Geoff Nielson

Engineers.

00;44;10;18 - 00;44;35;04

Laurence Moroney

With the point forward deployed engineers. Thank you. You know, to to realize that the opportunity that you have to be able to apply their brainpower to solve problems that will be massively impactful positively for your business. It's your job to develop that. It's your job to help in this new world, to continue to develop that and to encourage that, as opposed to seeing people as a line item on a sheet that's easy to cut.

00;44;35;06 - 00;44;43;26

Laurence Moroney

Right? So you know, the best CTOs are the best CIOs, I think, know that already, but I would just encourage them to keep thinking in that way.

00;44;43;28 - 00;45;09;01

Geoff Nielson

I want to get really crisp on. What you've described a few times. Is the value chain and moving up the value chain. So if you're if you're coding and you see yourself as someone whose identity your career is, writing code, what is up the value chain? If that's a question you're struggling to answer, what are the adjacent activities that are going to be the most valuable skills, I guess, to to develop?

00;45;09;01 - 00;45;27;19

Laurence Moroney

Right. I think first of all is I mean, if you were coding in an enterprise today, it's knowing and understanding what business problem you're solving. By creating that code is the first step. I would hope most coders are doing that already, not just reading a spec and turning it into code and delivering it. Right? But I mean, junior coders tend to do that.

00;45;27;26 - 00;45;51;06

Laurence Moroney

As they get more senior, they begin to understand the problem because sometimes you get a spec from somebody, you realize the spec is wrong, you're going to push back, then you're beginning to apply business value, right? But then the real place where you begin to thoroughly move yourself up the value chain is spotting those gaps, right. You know, a business analyst or whatever is the one defining the product, giving you a spec that you're going to implement into code.

00;45;51;08 - 00;46;12;22

Laurence Moroney

Because they know things about the business that you do not. But you have to realize that you know things about the application of technology that they do not. And if you start bringing that to like business problems and you know, being able to solve business problems that they haven't anticipated or they assumed could not be solved, and to start bringing that immediate business value right away is step two, right?

00;46;12;22 - 00;46;29;26

Laurence Moroney

You know, and then the trajectory goes upwards from there, because then it becomes less about reacting, more about anticipating. And then when you're not going beyond anticipating, you become part of the process of designing. And then when you become part of the process of designing, you become part of the process of expanding your AI and that kind of stuff.

00;46;29;26 - 00;46;50;18

Laurence Moroney

And now you've gone from somebody who turns coffee into code, to somebody who understands the business projects, things that the business needs, works with the business experts to be able to bring your technological expertise to solve those particular problems. You know, those are like generally the steps of moving up the value chain. Like, you know, people a lot of people do it throughout their career, right?

00;46;50;18 - 00;47;09;22

Laurence Moroney

You know, as a coder, anyway, they move up into architecture or ops or they move up into the management side of it. But I think it's something that's unfortunately going to be beholden on all coders, because if you only ever stay at those lower levels of the value chain, you're more easily replaced by an AI model.

00;47;09;24 - 00;47;35;02

Geoff Nielson

So I guess kind of bringing that full circle, if if you were to give advice to younger folks who are just getting into a career in computer science and development, what would you tell them to steer clear and, you know, go get a philosophy degree or, you know, you know, informat bioinformatics degree or something, or do you see, it is still a discipline with a bright future career wise.

00;47;35;05 - 00;47;59;21

Laurence Moroney

I see it still as a discipline with a bright future career wise. I do see, though, that we probably have to temper expectations that we did have an age of excess abundance for coders, where companies bent over backwards to hire engineers that that age is now gone. So if you're getting into it, expecting to walk out of college into a job that gives you free laundry and massages every day, that's probably not going to happen anymore.

00;47;59;24 - 00;48;25;12

Laurence Moroney

But it's still going to be a very valuable and enriching and rewarding career. The one thing I would encourage is like, you know, if you are like, for example, going into studying to maybe do a split major to study software engineering with something else. My undergraduate degree was computer science and physics, you know, and I think that's one of the things that helped me through my career, to actually have an understanding of something outside of just the software engineering side of it.

00;48;25;15 - 00;48;40;24

Laurence Moroney

I did a lot of my physics work, you know, that I was ahead of a lot of my competition in my labs, because I could actually write code to solve some of the problems rather than doing it on a paper, you know, stuff like that. And it really helped me a lot. And so I would say, like, if you are getting into the field of study, don't be afraid.

00;48;40;24 - 00;48;59;11

Laurence Moroney

I think it's as good as it's ever been for you to have a productive career. You may not have all the fringe benefits that used to be there, but they were fringe benefits, right? They weren't the real core part of the career. But if you really, really want to be valuable and like develop those skills to move up the value chain that I've been talking about, then maybe a split major with something else.

00;48;59;11 - 00;49;08;28

Laurence Moroney

I mean, I think that's always been a good idea, but to be able to do that now, I think it's equally good and it may equip you better.

00;49;09;00 - 00;49;34;05

Geoff Nielson

From a, I guess, a human perspective in the world of, of certainly software development. You know, there's been the adage for as long as I can remember about the, you know, the myth of the ten x software developer. And I'm curious with some of these tools now, Lawrence is are we going to end up in an age where AI is a great equalizer, or is it going to make the rich richer and suddenly we have the best?

00;49;34;05 - 00;49;37;04

Geoff Nielson

Two? Are now 100 x or a thousand x better?

00;49;37;06 - 00;49;59;05

Laurence Moroney

Oh boy, that's a great question. I think that the fearful part of that one is like when you use a phrase like the rich get richer, right? Because I think if wherever you are on the the line of advancement, I do believe that the further you are up that line, the more advanced and more things that you know, the benefits of using these things are greater.

00;49;59;07 - 00;50;23;24

Laurence Moroney

However, you don't stay at one point on the line throwing your entire career, right? You know the ability to move up the line, you know, to become better has also accelerated, you know, the ability to be a junior engineer and become a senior engineer. You can probably do that much quicker than ever before. Right? So it's like it's not a static place that you're at that gets multiplied less if you're further back and multiplied more if you're further out.

00;50;24;00 - 00;50;44;25

Laurence Moroney

But it's your ability to move up that value that has accelerated as well. Right. So there's a there's a double acceleration if you want to call it that. Right. It's x squared rather than x or a squared rather than an x. If I go back to the Newtonian mechanics for a moment. So I think, you know, there's if the most important thing I honestly believe is attitude, right?

00;50;44;26 - 00;51;03;04

Laurence Moroney

You know, think about it in terms of an airplane. Altitude is how high above the ground you are attitude is whether you're climbing or diving. Right. So I think, you know, in a similar term with the idea now of AI tools being able to make you far more effective where you are today is your altitude. Your attitude is going to change whether you're going to climb or not.

00;51;03;06 - 00;51;20;03

Laurence Moroney

And these tools being out there are the things that will make you far more effective at climbing more quickly. And don't be fearful of like, oh, this person who's two years ahead of me is going to be ten years ahead of me next week. You know, don't think in those terms at all. Just think in terms of your own attitude.

00;51;20;06 - 00;51;47;14

Geoff Nielson

I really like that. And it's much more optimistic than I think. The alternative. Yeah. I want to, I want to shift gears for a minute and talk about, some specific technology, I guess, because I've been talking a lot about AI broadly, what it can do, what some of these tools can do. We haven't talked specifically about a genetic AI, which is, you know, one of the hyped up technologies du jour.

00;51;47;17 - 00;52;09;12

Geoff Nielson

And nothing we've described to me necessarily requires a genetic AI, a genetic AI being, you know, actually having functions and processes run entirely, you know, without kind of human intervention in my books. I'm curious, Lawrence, what's your outlook for a genetic AI versus some of the other technologies in use cases under the umbrella?

00;52;09;13 - 00;52;28;29

Laurence Moroney

So, I mean, I would do a minor correction there. Like, you know, I do believe human outlook is still necessary for effective aging tech. I, you know, I don't think an automated pipeline without any kind of oversight is as effective as people might think it is. I think we always need human oversight, if for nothing else, that word that we all love hallucinations.

00;52;29;01 - 00;52;58;02

Laurence Moroney

Right. And I think the important thing is like, let me boil it down to what a genetic I actually is, so that we can understand it. And I like to think of it as a four step process. Right. The first step is, you know, the we want to understand the intent of the user, you know, any kind of input that you do in any kind of application today is you're forcing the user to express their intent in a way that the computer can understand your typing, your username and password.

00;52;58;02 - 00;53;22;20

Laurence Moroney

And right, you know, you're using TurboTax and you know, typing in like, you know, these numbers that come from your like from your various documents around tax. So you are being forced to tell the computer your intent. Exactly. Because the computer doesn't have the ability to abstractly understand your intent. One of the things that I gives you is the ability to abstractly understand the user's intent, right?

00;53;22;20 - 00;53;40;17

Laurence Moroney

So say take for example, I'm building an agent to help me, find a place to eat tonight. Right. I'm traveling somewhere. I want to find a place to eat tonight. And I say, I would love to eat okonomiyaki. Right. Use a human. You probably go okonomiyaki. That's Japanese food. I can tell you a Japanese restaurant, but I didn't say anything about Japanese food.

00;53;40;17 - 00;54;02;08

Laurence Moroney

You have the knowledge of that computer program. Does it until I came along. And now we can start to understand intent. So that's the first really valuable part of any genetic system is whatever input I give. I as a human, I'm not forced to give it what, you know, something that it understands. It understands me. It's that. So then the second part then is to make a plan.

00;54;02;11 - 00;54;23;03

Laurence Moroney

Understanding the tools that are available to the, to the agent. So, for example, if I'm building an agent for the scenario that I just mentioned, the tools that it might have are a Google map search, Google search, maybe understand my location, you know, from my IP address and stuff like that, and it makes a plan. So then the AI will be go, the intent was okonomiyaki.

00;54;23;03 - 00;54;45;08

Laurence Moroney

That's going to be a Japanese restaurant. I have these tools. I can search for Japanese restaurants. I can find the website, you know, I can browse that website. I can see if they serve that thing, and then I can find the okonomiyaki for him. So that's making the plan. Then the third part is executing the plan. Right. You know, and that's where it writes the code to do all those APIs that I mentioned, Google Map search and the web search and all that kind of thing.

00;54;45;11 - 00;55;00;21

Laurence Moroney

And then the fourth part of when it gets those results is it reflects. Right. So it goes, I found all these things. Did I meet the user's intent, yes or no? You know, I found him sushi, but I didn't find him okonomiyaki. I got to go back to step two and do the whole thing again. So that ultimately is how an agent works.

00;55;00;21 - 00;55;24;19

Laurence Moroney

And that's what an agent is all about, is really powerful and really useful because it can take something abstract, like my intend to eat okonomiyaki and turn it into maybe make a reservation at a restaurant. For me. And this is why a gigantic software development is becomes so exciting and so powerful. It's all of that abstraction that a programmer doesn't have to think about while giving an improved user experience.

00;55;24;21 - 00;55;44;19

Laurence Moroney

Now, are they going to eat the world? No they're not. If I go back to my two categories that I mentioned taking existing processes and making them more efficient or coming up with entirely new scenarios, you can see how agents can be built to fit either of these, particularly the second one, because of all of that abstraction that can be baked into it.

00;55;44;21 - 00;56;02;21

Laurence Moroney

So those are the agents that we're seeing today, and those are the agents that are getting particularly exciting, where it's like entirely new applications that weren't feasible are beginning to land because of this, a gigantic loop that I just mentioned, where I'm beginning to then see the next step for this. And again, thinking in terms of engineers and developers.

00;56;02;24 - 00;56;27;27

Laurence Moroney

Now, what if instead of just having this loop, that you have a number of models that are fine tuned expert models in a particular thing, right. Hey, here's a fine tuned expert model in international cuisine who is a fine tuned expert model and whatever, you know, talking on the telephone to somebody, and being able to orchestrate these things together as tools instead of just the APIs, like a Google search and all that kind of thing.

00;56;28;00 - 00;56;56;24

Laurence Moroney

That's where now intelligence will be building on top of intelligence and networking other intelligences together to build really powerful or super agents, to be able to solve a problem. So yes, I'm really excited about it. But if I try to boil it down and use the electricity paradigm that we spoke about earlier on and let it fade into the background, ultimately it's a new design pattern for building applications based on understanding of what these things can actually do and solving a real problem.

00;56;56;26 - 00;57;06;22

Laurence Moroney

And the biggest real problem I think that they initially solve is understanding a user's intent, which is a very difficult problem to solve when you create a user interface.

00;57;06;24 - 00;57;36;01

Geoff Nielson

So so with that in mind, you know, coming back to, I guess, some of the lens we were using earlier around, you know, larger models and smaller models, there's, there's a number of different ways that, you know, an organization could potentially implement something like this, whether they, you know, build it themselves or they source it from, you know, one of the large AI players that they try and source it from an existing, enterprise technology vendor, or they find a smaller fit for purpose, one that they sort of modify.

00;57;36;04 - 00;57;42;28

Geoff Nielson

Do you have a sense of where this is going to be most successful? And I guess if there's a wrong way to do it.

00;57;43;00 - 00;58;00;14

Laurence Moroney

I mean, there's probably going to be a bit of all of the above. Right? I think, you know, the wrong way of doing it is the first thing I would say is like, we've always done it this way. So we're going to continue doing it this way by adopting it. You know, I think that's probably the first step in the path to a wrong decision.

00;58;00;16 - 00;58;20;23

Laurence Moroney

I think, you know, being an open minded about, how you would solve a particular problem without thinking in terms of how you've done it previously, is probably the first step towards making the right decision. I do think, though, the when we talk about growth, the, the easiest growth to do is to go from zero to something, right?

00;58;20;25 - 00;58;42;07

Laurence Moroney

You know, it's hard to go from 99% to 100%, but it's easy to go from 0% to 1%. So then I would start looking at, well, what are the things and what are the things that just don't exist yet, but could exist in that, time frame and in that model, excuse the pun. And I think that a lot of that is the creation of fine tuned models for specific tasks.

00;58;42;09 - 00;58;58;24

Laurence Moroney

I mean, at some point, I think you were going to have a catalog that we can look up and go, here's a model that's fine tuned for talking on the phone to make a restaurant reservation, right. Here's a model that's fine tuned to understand the ins and outs of Japanese cuisine. You know, I mean, I might be getting a little too granular there, but I think you see where I'm going.

00;58;58;26 - 00;59;22;25

Laurence Moroney

And then being able to take those and orchestrate those together as part of an agent tech or any other workflow. I mean, I think that's a that's a domain that just simply doesn't exist today. I mean, it's close to existing and things like hugging face. But, you know, to be able to take off the shelf ones with a licensing model with, you know, the ability to with, you know, the indemnity and all of that kind of stuff to be able to include it into your applications.

00;59;23;01 - 00;59;34;17

Laurence Moroney

That is in its infancy at the moment. But I see that's something that's going to grow. And I think that's going to be a rapid area of growth. And, I'd be really excited to see who's doing anything in that space.

00;59;34;20 - 00;59;54;28

Geoff Nielson

Well, I'm curious to just, you know, kind of speculating, but whether you think we're going to continue to see a fragmented landscape there or, you know, something I could easily see is, you know, one of the Googles of the world saying, we want to own this space for, you know, every conceivable, you know, kind of consumer pattern that we can think of.

00;59;54;28 - 01;00;07;01

Geoff Nielson

And they start to, you know, build out or purchase all of these, you know, potential smaller or more focused models. And it becomes a point of competition among, you know, the big tech consumer players.

01;00;07;04 - 01;00;30;16

Laurence Moroney

I mean, that's an interesting view. And maybe, I find like if you look through history, particularly in tech, there's always been a duality, right? You know, I'm a mac, I'm a PC, you know, Java or DotNet, you know, TensorFlow or PyTorch. You know, that kind of thing. And I see, like, you know, that bifurcation happening is like at least when it comes to models, it's going to be the large versus small.

01;00;30;18 - 01;00;52;26

Laurence Moroney

Right. And then, you know, the the nice thing about the small is that it could be a massive, widely open ecosystem where there will be some players who want to, you know, control, you know, a large subset of those models and build their own. But there's no reason why the can't be independent or smaller players doing it. I think of something like an app store, right.

01;00;52;26 - 01;01;14;08

Laurence Moroney

You know, today you can go to the App Store, and if you're looking for a note taking application, there's going to be some giant companies who've created note taking applications, and there's going to be some plucky young upstart ones that, you know, have made these massively disruptive note taking applications. And, you know, there's no reason why the model scenario can't be the same.

01;01;14;13 - 01;01;38;28

Laurence Moroney

And, I the nice thing about openness and open wait models that can be fine tuned by anybody is that you can't have one person dominating the entire game, right. Or one company dominating the entire game, because you can have those plucky little upstarts, you know, who are fine tuning their thing, and you know that the the old adage of, you know, it's much harder to turn the Titanic than it is to turn a speedboat.

01;01;39;00 - 01;01;46;15

Laurence Moroney

And, you know, the advantages that the smaller companies would have would come into play there. So the scenario that you mentioned, I'm not really not worried about.

01;01;46;17 - 01;02;11;10

Geoff Nielson

Interesting. I am finding we've spent most of this conversation talking about, you know, models in the application layer and development, you know, you've had a shift fairly recently in your career where you're now working with Aam and you're more sort of at that. You know semiconductor or you know the hardware layer there. What's going on in that space and what excites you about you know the future.

01;02;11;10 - 01;02;12;16

Geoff Nielson

There.

01;02;12;19 - 01;02;37;17

Laurence Moroney

I think what excites me about the future with aam in particular is you know the whole leadership thing that I've been talking about is something that they're exemplifying right. That they're looking at cutting through a lot of the hype around things to see the real business value. Like let me give one example. We spoke a little bit about agents earlier and then aam recently released something called the AGI CPU.

01;02;37;19 - 01;03;05;08

Laurence Moroney

And the idea behind the AGI CPU was a realization that if you're building an agent ecosystem, very little of that system is actually the stuff where the model is consuming or generating tokens. Right. You know I spoke about like the part where to understand your intent that's consuming and generating tokens. And I spoke about the part in phase two where after it's made a plan that it's going to kind of generate code to execute on that plan that's consuming and generating tokens.

01;03;05;13 - 01;03;36;23

Laurence Moroney

But if you look at a big diagram, a lot of that is traditional compute that needs a CPU. And and that's the whole idea of like the ARM Magi CPU was to create the what can we do to put into data centers for enterprises or whatever, you know, to be able to have these gigantic workflows, but to be much more efficient in how they run, to be able to run as many workloads as possible on low energy, low cost CPU and then offload the stuff to a high energy, high cost GPU only as appropriate.

01;03;36;25 - 01;03;58;03

Laurence Moroney

And it's that kind of vision I find particularly exciting. And it's that kind of thought leadership, I think, that I find really exciting. And then the other one and one that I'm working on is called a semi, and it's, same logic. It's called Scalable Matrix Extensions. And the idea behind semi is that like, well, if you're using a phone, right, you know, your phone is usually disconnected from power.

01;03;58;03 - 01;04;18;06

Laurence Moroney

So you're relying on your battery. And if you want to do artificially intelligent workloads, they are computationally very expensive. And as a result they generally need a something like a GPU or some kind of accelerator chip on which they run. That draws a lot of power, that draws down your battery. It's one of the things that's caused, API is a API.

01;04;18;12 - 01;04;45;04

Laurence Moroney

I on phones to generally lag, right? You know, they can do simple things like photograph, photographic AI and the like. But what if you build directly onto the CPU, which is already there and sips power instead of gulping it? The ability to offload some of this computationally expensive stuff. And that's eSIM stands for Scalable Matrix Extensions. And that's something that's been built into, you know, into CPUs that are on some phones.

01;04;45;04 - 01;05;18;11

Laurence Moroney

And obviously it's, you know, becoming increasingly more common. So it's that level of that forward thinking leadership that got me excited about. Aam in particular and why I joined them. And then like working on those types of projects to see what we can do to make AI more prevalent. And go back to my two scenarios. Right. Things that were previously infeasible, like being able to do AI on a phone, because of the cost of running a GPU on a phone, are now becoming feasible because of that type of thinking.

01;05;18;14 - 01;05;44;09

Geoff Nielson

It's, it's it's so interesting. And it's just as I sort of reflect on this conversation, we've covered so much ground and there's so many, you know, different themes and pieces of advice that have come out. Lawrence, thinking again to an audience of business leaders and technology leaders, is there anything we haven't covered? Or, you know what? What do you consider sort of your top advice right now to actually get value out of this technology and make sure your organization is ready for tomorrow?

01;05;44;09 - 01;05;46;09

Geoff Nielson

What would that be?

01;05;46;12 - 01;06;07;21

Laurence Moroney

Oh, wow. I think we've probably covered most of it, but I mean, if I were to condense it, I would say the best way to get value out of this technology is ultimately to deeply understand what it is and what it is not, and to make your decisions out of that clear understanding. There is so much clarity.

01;06;07;21 - 01;06;25;01

Laurence Moroney

Is that the right word? That's that there's so many opaque thoughts out there, and there's so much hype and noise out there that it's easy to be seduced by it. Those decisions that you make based on firmly understanding that are not going to be easy decisions, but they're going to be the right decisions, at least coming from the right standpoints.

01;06;25;03 - 01;06;53;27

Laurence Moroney

I'm dismayed by how many wrong decisions I've seen made because of hype or because of reacting to a trend. And, you know, and so I'd say that would be the one thing that, you know, invest in understanding the business impact, the technological impact. Listen to a CTO, listen to our engineers, you know, those kind of things and listen to the people who really, really, truly understand what's going on with this technology and who aren't seduced by the hype.

01;06;53;29 - 01;07;05;08

Geoff Nielson

I love that answer. And I think it's very, on theme with what we've been talking about. Lawrence, just before we wrap up here, is there anything we didn't cover in this conversation that you were hoping to talk about?

01;07;05;10 - 01;07;43;00

Laurence Moroney

There's one thing I would like to, bring out. Yeah. And it's it's a particular passion of mine. And, that is really around. I've forgotten the word now, it's sorry to say it's Apache, but it's a sovereign. I, I guess what I'm thinking of that, you know, sovereign AI is, becoming increasingly important. But if I talk about the misunderstood part of it that it's only, I think, partially understood and when we talk about sovereign AI, if we read articles about sovereign AI, it generally falls down into country acts once the data from that country to be in a data center in that country.

01;07;43;02 - 01;08;06;10

Laurence Moroney

The end. But that's just the beginning. And I think there is really, really important opportunities. Again, going back to engineers to do things that are really good when you fully understand the implications beyond that. And if I go back to fine tuning AI as an example, think about education right today, how an AI model is trained.

01;08;06;10 - 01;08;37;25

Laurence Moroney

A large AI model is it's trained on masses of data. You know, from the internet and from other sources. And then, you know, that's pre-training and then it's post trained with the values of the company that's actually training it right there. Safety filters, what they consider to be safe, you know, their values, those kind of things. And it's really condensed into the world of models is models with the safety and sovereign values of San Francisco, models with the safety and sovereign values of China.

01;08;37;28 - 01;09;02;01

Laurence Moroney

Right. I'm not saying either of these are good or that either of these are bad, but they're only two locations. And if you are creating, for example, a solution for an education system in Ireland, right? You know, you have to realize that this thing has been trained with the safety filters and the values of San Francisco, and they're not necessarily your values.

01;09;02;03 - 01;09;24;23

Laurence Moroney

Right. And that's part one. Part two is even if they don't have those safety values applied to them, they are also trained with, statistical relevance in mind. I always like to tell this story. Have you ever been to London? Jeff? I have, if you go to the Houses of Parliament in London, right outside the Houses of Parliament, is a statue of a guy called Oliver Cromwell.

01;09;24;25 - 01;09;53;29

Laurence Moroney

Right. They put a statue of him there because he was the guy that led part of the Civil War against the Crown that brought democracy to the UK. And the Houses of Parliament are part of democracy. Right next door to the UK is the country of Ireland, where I grew up in and the town that I grew up in called Drogheda, has a street called Scarlet Street, and the reason why it's called Scarlet Street is Oliver Cromwell's victims, you know, to so many people were murdered by his army there that their blood flow down the street.

01;09;54;02 - 01;10;25;13

Laurence Moroney

Okay. So now if you train a model on data and you look at statistical data, you're far more statistically likely to have stories about Oliver Cromwell being a father of democracy, because the UK is a much larger country than you are to have stories about Scarlet Street, Andromeda, because it's a small town in a smaller country. And now if you are building an education system for Ireland, right, and you're using AI for building that education system, you are swimming upstream against the values of your country.

01;10;25;16 - 01;10;46;10

Laurence Moroney

And as a result, you know, it begins to negate a lot of the usefulness of AI doing it. The big problem is awareness of that, right? Because it's like, you know, sovereign AI is generally, like I said, data center data in a particular country. But now it's a case of as we start infusing AI more and more, it becomes electricity, fuzing it more and more into the background life.

01;10;46;10 - 01;11;10;09

Laurence Moroney

For example, for things such as education, there are problems like that that need to be solved. My way that I'm going to argue of solving them is using small AI with open weights and fine tuning it on your specific thing. So if I'm creating a syllabus to teach history in Ireland, I, you know, as part of the Irish Education Board, have all of these materials that are on my syllabus that I teach the way that I want to teach it.

01;11;10;12 - 01;11;30;02

Laurence Moroney

The textbooks that I trust, the research that I trust, the values that I want to impinge on, the people in my country, you know, those kind of things. I need to fine tune a model to do that. And I can't rely on something with San Francisco values and the statistics or something with Beijing values and the statistics. Again, no offense to either of those, but it's just not my country.

01;11;30;04 - 01;12;01;16

Laurence Moroney

And and as a result, like, you know, the opportunities there in sovereign AI as I fades into the background are becoming endless. And I think back to my model of things that were previously infeasible, you know, now those are things that are not just feasible but massively valuable. And and I would just encourage, like anybody out there who's listening, who's in this space or if, you know, if you have all of this type of data that the opportunities there for you to build something that's meaningful and impactful are huge.

01;12;01;19 - 01;12;24;18

Geoff Nielson

I find that extremely interesting and compelling. And I'm sure you know, it's one example, but I'm sure there's a million examples around the world of that. But let's let's stick with this one for a minute. So if you're on the board of education in Ireland and you want to actually do this and you're concerned about the San Francisco models and you're concerned about the, you know, the Chinese models, where do you start that?

01;12;24;19 - 01;12;38;25

Geoff Nielson

Like, are you necessarily condemned to starting with a blank canvas here or you know, what foundation do you draw from? If you want to make sure that you're, you know, going to end up with a model that has Irish values.

01;12;38;27 - 01;12;58;22

Laurence Moroney

Right? So the first question becomes, do I use a large model that I have no control over and then start doing exception management with that model. Right. Or do I use a smaller model that I do have control over. And I can fine tune understanding that that small model, you know, is not going to have my values baked into it.

01;12;58;22 - 01;13;18;15

Laurence Moroney

Right? You know, it's still going to have post training done, you know, Google have the GMO models, San Francisco, OpenAI, I have the GPT of San Francisco. China has Quinn and other models like that, Chinese values. So I'm already starting from something that's been post trained to somebody else's values, but at least I can overwrite that.

01;13;18;18 - 01;13;38;13

Laurence Moroney

So the question becomes do I create using somebody else's model and it becomes a process of exception management? Or do I create using an open source model and build on top of that? Or the third choice of course, is do I train my own model from scratch? Training my own model from scratch is probably too expensive to do right now, and and maybe there's not enough data to be able to do that.

01;13;38;13 - 01;14;00;18

Laurence Moroney

So if I'm in that role at the moment, I say I can't do option number three today. And that means option number two I find is the most attractive. And then going back to what I was talking about, fine tuning models, it becomes a then a domain problem of like, I have all of this data already, I have my syllabus that I want to teach already and textbooks and research and, and policy papers and that kind of thing.

01;14;00;22 - 01;14;18;05

Laurence Moroney

Now it's a case of me taking that and formatting it in a way that a model understands, so I can then fine tune a model. And now I will have a model that has become a domain expert in my syllabus that I want to teach. And it's not perfect because the foundation is already, you know, a model that's been trained on somebody else's values.

01;14;18;11 - 01;14;30;09

Laurence Moroney

But then at least you're overwriting that with your own values and your own details and that kind of thing. And that that would be the path that I would probably choose in that case. But it would require a lot of evaluation to be sure.

01;14;30;11 - 01;14;51;07

Geoff Nielson

Sure. And. Well, and I like that because again, it it walks the middle line. Right. It's sort of the Goldilocks model, so to speak, between going with the the large model and the completely DIY model. Yeah. Laurence, I wanted to say such a big thank you for coming on to the program today. We've covered so much ground. It's been really interesting and insightful, and I really appreciate your time.

01;14;51;10 - 01;14;55;18

Laurence Moroney

Thank you. It's been great fun. Interview. Thank you so much, Jeff.

01;14;55;20 - 01;15;19;29

Geoff Nielson

Most viewers don't know this, but Digital Disruption is developed by Infotech Research Group, a leading advisor to technology leaders around the world. If that's not you, you don't need to care. So skip ahead and enjoy our content. But if you are a technology leader, Infotech helps IT teams get projects done faster, better, and at a lower cost. Infotech provides unlimited access to practical tools and expert guidance.

01;15;19;29 - 01;15;34;24

Geoff Nielson

You need to execute at a fraction of the cost of traditional consulting, no matter the project. From AI strategy to cybersecurity to vendor negotiation, Infotech has you covered. Check it out at the link below, and don't forget to like and subscribe!