Sean Whiteley & Matt Millen 22 min

Generative AI: Designing Products Around the Human Element


Generative AI continues to be a hot topic in the SaaS space. Dive into the future of AI and identify how these models can help revenue teams scale their operations and maximize their efforts while celebrating the humans behind the keyboards.



0:00

Welcome, welcome everyone to the Pipeline Summit.

0:03

I'm Sean Whiteley, co-founder here at Qualified, and with me today is Matt Mill

0:07

en, co-founder

0:08

and president of regi.ai.

0:11

Matt, thanks so much for joining us today.

0:13

So great to be here with you, Sean.

0:15

Hey, so I checked my email, and I think the last time we connected, I was July

0:20

of 2019,

0:21

and I saw that you and Nina Butler went over to Regi, and I had to check out

0:26

what you're

0:26

up to.

0:28

And I got it immediately.

0:29

Like the value is super clear, and I think Regi's really well represents the

0:33

topic of

0:33

conversation today, and the platform shift we're all witnessing today with AI.

0:38

And, you know, as we all know, AI is not only a hot topic, but it's like a

0:43

really broad

0:44

topic.

0:45

Like, so I'd like to kick the conversation off with some broad strokes.

0:49

That's okay.

0:50

So, so Matt, from your perspective, what should be top of mind for sales and

0:56

marketing heroes

0:57

out there who aren't working day in and day out with with with these models

1:02

that have

1:02

become so so quickly so popular?

1:05

Yeah, it's a great question.

1:07

I broke it down in a four areas that I think are super important when looking

1:11

at, you know,

1:12

I've met in your team and giving them superpowers with AI.

1:15

So number one is workflow.

1:17

Does the AI you're looking at actually work the way your team is working, or do

1:22

you have

1:22

to change the way that your team does their tasks all day?

1:26

So super important that something fits into your team's natural workflow.

1:31

Number two, integrations.

1:33

Does the AI live where your team is working, or do you have to go out to the AI

1:37

, do something

1:38

and come back to where you do the rest of your job?

1:41

So very important that you think about the integrations.

1:44

Third, and, you know, why is it number three, but the output, the quality of

1:49

the output,

1:50

if you're in sales, it's sales ready, if you're in marketing, is that marketing

1:54

ready?

1:54

Like how good, how accurate is that AI?

1:57

I'm sure we'll talk about more of that.

1:59

And then lastly, visibility.

2:01

So teams are usually led by a manager.

2:04

Managers love to see what their folks are doing and having some management and

2:08

visibility

2:09

layer into that activity.

2:11

So recap, workflow, integrations, quality of the content, and visibility.

2:17

Yeah, I like what you said, Matt, around workflow.

2:20

One of the things that we've really challenged the managers and the leadership

2:24

in our company

2:25

is to really kind of think through like, how can AI like help you do your job

2:30

better?

2:31

Right?

2:32

Like we have, there's obviously so much talk out there around, and we're going

2:34

to talk

2:35

about this, but so much talk about like, is AI going to replace our jobs and,

2:39

you know,

2:40

what's going to happen?

2:41

But like really, we think about it in terms of like, how is this going to just

2:45

help you

2:45

do your job better?

2:46

So we've challenged everyone across our company to really be thoughtful about

2:51

how you can

2:51

bring AI into your daily workflow.

2:54

So I really liked the way you started that out.

2:56

Yeah, and Sean, when you say better, you know, better can be different things

2:59

for different

3:00

teams.

3:01

Better could be, I want to move faster at what I'm doing.

3:04

Better could be, I want better quality, higher quality output at a normalized

3:09

rate or some

3:10

combination.

3:11

So even better ultimately has to be defined as you go into this.

3:15

Yeah, absolutely.

3:16

Yeah, well, I mean, the first place we jumped to initially honestly was

3:21

governance.

3:22

That's kind of like the place where we went right off the bat.

3:26

So let's bust a myth.

3:29

So obviously there's a ton of probably healthy fear and probably some confusion

3:36

, particularly

3:37

in the area of generative, right?

3:40

And everything from governance to AGI and what this means for humanity.

3:45

What are some of the myths you think are important to bust when it comes to

3:49

what these models

3:50

really like are capable of and how we should think about it?

3:54

Yeah, it's a great question.

3:55

I would also argue like maybe some of the confusion or uncertainty has actually

4:02

over

4:02

the last nine months morphed into everyone's had an experience or most people

4:06

have had

4:07

some experience.

4:08

And I think, you know, that is guiding like where we stand on the AI spectrum.

4:13

If you had a great experience, if you're allowed by it, if you're underwhelmed

4:16

by it.

4:17

So I think what we want to do is understand like, you know, AI needs to be told

4:21

what to

4:22

do to give you something back.

4:25

So when you think about, you know, if you're running out to chat GPT, you've

4:28

got to think

4:29

about prompt engineering or giving chat enough information to get something

4:33

usable back.

4:34

You know, we've been working with AI at Reggie's before could string a sentence

4:39

together.

4:40

You know, we've been doing it for two years now.

4:43

And what we found is the ability to train and tune your own models that

4:50

understand what

4:51

your user is looking to get done to minimize the amount of work that they need

4:56

to do to

4:57

get the end result.

4:58

And I think that starts to eliminate some of this confusion, some of this

5:03

anxiety, even

5:03

the trust factor.

5:05

Because when you start getting what we call either sales, right, your marketing

5:09

ready

5:09

content.

5:10

We really change your experience with AI.

5:13

Yeah.

5:14

And you guys have been doing this for a while.

5:16

I mean, you guys were certainly ahead of the curve.

5:18

I mean, obviously it's the hottest thing.

5:21

We think about it as truly a platform shift.

5:24

We talk about the AI revolution and it's obviously here.

5:27

And, you know, with with chat GPT, obviously, you know, the masses now have

5:33

access to these

5:34

like large language models and NLP for everyone.

5:38

It's super powerful, but we evaluated and we started to qualify.

5:42

We evaluated some of these capabilities about five years ago.

5:46

We decided that some of them just weren't there yet, right?

5:50

I mean, we sort of invested in other areas like predictive and machine learning

5:54

But you know, now with, you know, these these innovations that have come out

5:58

over the last

5:59

12 months, in fact, it's really changed the game.

6:03

So given you guys have a little bit more time invested here and your kind of

6:08

veterans,

6:09

which is funny to say because you've been doing this for a couple of years,

6:12

like, how

6:12

are you guys at Reggie approaching like product development?

6:15

Like what are some of the top priorities for your customers and users right now

6:20

Yeah, it's a really good.

6:22

Good.

6:23

I've come out from a couple angles.

6:24

You know, I mentioned workflow earlier.

6:26

So we're constantly evaluating, you know, who we typically see using our

6:30

product, like

6:31

how do they spend their day?

6:32

You know, where can we show up bigger, more impactful in their current day?

6:38

And then we think about the interaction we want our customer to have with the

6:41

product,

6:41

whether content creators or the actual frontline reps using this in real time.

6:48

You know, it's funny when, when Betty Crocker first introduced instant cake mix

6:52

back in

6:52

the fifth 1950s, like nobody would buy it because the belief was you couldn't

6:57

add water

6:58

to brown powder and make a cake worth eating.

7:01

And when sales were really solid, they did all this consumer research and they

7:05

found

7:05

out that people want to have a certain amount of interaction with the product

7:10

to establish

7:11

trust and certainty with the outcome.

7:14

And they figured out if you just add the egg, not just water, but water and

7:17

eggs.

7:17

So most instant products that they add an egg, the egg is more symbolic of

7:22

interaction

7:22

that actually changes the output of the product itself.

7:26

But it's the set.

7:27

So we look at it that way.

7:28

Like how much interaction does somebody need with the platform?

7:33

So they have this inherent trust in what the platform is doing with them and on

7:37

their VF.

7:39

At the same time, increasing and driving productivity.

7:41

So it's this careful balance.

7:43

So with our content creators, we like to get people 70, 80% of the way there.

7:47

And we provide an amazing editing experience at every step along the way, given

7:52

how much

7:53

they want to interact for our sales reps.

7:56

And think we're going to anticipate where they are in the workflow.

7:59

We're going to serve up sales ready content based on the stuff that they're

8:03

doing.

8:04

Always have the ability to edit it.

8:05

But at the same time, it's sales ready.

8:07

So we're letting managers and reps really choose how they want to interact with

8:12

the AI,

8:14

whether or not they want it to get them going.

8:15

Because working really hard in productivity is the enemy of creativity and all

8:20

of a sudden

8:20

I've got to go create something up in go-go mode.

8:23

So I want Reggie to get me going, or I want Reggie to take me there.

8:27

And that's just going to be an individual choice.

8:28

But that's how we think about the product.

8:30

Third way is how do you protect the brand voice and how do you put certain

8:35

guardrails

8:36

in place for your team?

8:38

So our administrators are actually able to create brand voice.

8:42

So in create all the engineering behind the scenes for your reps.

8:45

So for instance, showing a few on the front line, even though you don't need to

8:49

know this,

8:50

as you're constructing a personalized email, Reggie knows for you at your

8:55

company how

8:56

you structure subject lines, intro lines, calls to action, whatever it may be,

9:01

whether

9:01

you're in LinkedIn, email, Reggie's going to be composing this language and

9:06

this output,

9:07

the way that your company would architect in if they could while you're doing

9:10

it on the

9:11

fly.

9:12

So we want to make sure we protect the brand voice and put the right guardrails

9:16

in place

9:17

because when your reps are doing 50, 60, 80 tasks a day, you want to make sure

9:21

that you

9:21

can trust the system and what is providing your reps to go do.

9:26

Yeah, I like that analogy a lot, especially the parallel you drew to

9:30

productivity and

9:31

creativity.

9:33

There's a professor at Stanford who lives in my neighborhood and I saw a

9:37

YouTube broadcast

9:38

he did when chat GPT came out.

9:40

And the first thing he did is he asked all the students to write a paper on

9:44

chat GPT using

9:45

chat GPT and they all came in and he said, you all wrote the same paper.

9:51

And he said, I want you to go home and I want you to write this paper again,

9:54

but I want

9:54

you to make it yours and give it your individual perspective on it.

9:58

So like really sort of exercising those creative muscles, but obviously

10:03

leveraging these powerful

10:06

capabilities to do a lot of the productivity.

10:08

And so everyone's talking about like a lot of things are going to be done

10:15

better by the

10:16

computer, a lot of things, right?

10:18

And they're going to replace a lot of the things historically that we've done.

10:21

Like, how do you think about like the human centric element, right?

10:26

Like, can you give a little bit of perspective on how you see the role of

10:30

humans with AI

10:31

outside of, you know, providing the for the better?

10:35

Yeah, I think there's a, you know, the highest order for me is like, what

10:42

experience do you

10:43

want to crave your customer?

10:44

So if we take, take everything else out for a minute, like, what's our brand

10:49

and what's

10:49

our experience with our customer?

10:52

And how do you humanize that and make sure it's human?

10:55

You know, I'm an Amazon business, private customer at a probable order.

10:59

And I was dealing with a bot that didn't know it was the 30th time I was trying

11:03

to get

11:03

through and I would have paid any amount of money to have a live agent that

11:08

could just

11:09

deploy some common sense into this situation.

11:12

And then you take a look at customer service over time.

11:15

You got off short for cost reasons and now it's in the Ute is a premium

11:18

offering when

11:18

they reach on short again.

11:20

So it's like we tried something.

11:23

It didn't work come back, but it really comes down to the experience of the

11:26

customer.

11:27

So I think about like from an AI perspective in the involvement, it really

11:30

comes down to

11:32

like how robotic or how human are you in your brand?

11:36

What kind of experience are you looking to provide?

11:39

And then how do you leverage any at all technologies in your different go-to-

11:43

market systems to

11:45

achieve that?

11:46

Yeah, I mean, you're preaching to the choir, you know, on that.

11:51

We've thought about that from day one here about how do you orchestrate things

11:56

like AI

11:57

and human capital in like a really meaningful way that suits the problem that

12:02

you're trying

12:03

to solve?

12:04

And I think that's a really good way of looking at it.

12:08

So you know, as you can imagine, Matt, we've got a lot of sales marketing

12:12

people here at

12:12

the pipeline summit today.

12:14

And probably people are at various stages of their journey, you know, with AI.

12:21

Like how are you guys thinking about like, you know, helping your customers

12:27

with the

12:27

adoption of these technologies?

12:29

And like, what does training and integrating AI tools look like for teams that

12:33

are, you

12:34

know, kind of just starting to add these products to their staff?

12:38

Yeah, you know, I look, I grew up in sales.

12:42

I've been selling before corporate email and the internet.

12:46

And again, that's what I know about adopting technology.

12:50

Like number one, you got to make it easy to use.

12:54

It should be fun to use.

12:55

Not a lot of the tech is, but it should be fun.

12:57

And then it needs to be coachable.

12:59

It needs to be something you're using that's coachable.

13:01

So like we come out it from a standpoint of, you know, making Reggie very

13:05

intuitive, very

13:07

easy, it creates magic all day.

13:10

And it's done in a way where your manager has great visibility, what you're

13:13

doing can

13:14

help you be great.

13:15

So like that, that's one way that we're thinking about, you know, as people

13:20

come on and adopt

13:21

this.

13:22

Yes, we've got customer success that on board you and we've got someone to

13:25

focus on rolling

13:26

out our product to sales teams.

13:29

But like at its core, if the product like doesn't make sense, it's not fun.

13:36

And like your boss has a hard time figuring out what you're doing.

13:39

And it's not going to get adopted and rolled out at the organization.

13:42

Yeah, absolutely.

13:45

I mean, it's funny today, you see a lot of, you see a lot of things about AI

13:54

that for

13:54

me are sometimes solutionism.

13:56

Like it's like a, it's a, it's an answer looking for a problem.

13:59

That's right.

14:00

But at the same time, like what you can also see is there are stark, stark, you

14:05

know, representation

14:07

of, you know, areas where AI is just going to change the game completely in

14:14

terms of rethinking

14:15

like really how you solve problems.

14:17

And as a, I've been in software for 27 years now and to be honest, AI has

14:22

really made it

14:24

exciting again.

14:25

You know, not that it was boring, but it really needed, I think this, this kick

14:29

and it's just

14:30

made it really exciting.

14:31

So when you look at like brands that are bringing AI tools to market, like how

14:39

do you rise above

14:40

the noise and the solutionism and the buzz and the hype and how do you build

14:45

something

14:46

that really drives clear value and doesn't just have sort of AI flash.

14:51

Yeah, it's great.

14:52

Yeah, it's a great question.

14:54

And there's certainly a lot of, a lot of noise and a lot of buzz.

14:57

And I think at the end of the day, you know, you're seeing like a lot of like

15:03

small startups

15:05

putting a very thin veneer over chat GBT, ladling in a product.

15:12

You see other companies that are feeling very compelled to like say they have

15:16

AI so they're

15:16

bolting something on, but it really doesn't integrate in with a broader

15:20

workflow of what

15:21

the rest of the platform or product does.

15:24

So we're really focused on integration.

15:26

Like we're really focused on what I went back to some of those core elements up

15:32

front of

15:33

the focusing on the workflow.

15:35

Like your reps don't have to do something different to use our product.

15:39

We're going to live where they are, both from an integration perspective and a

15:43

workflow

15:44

perspective, make it very easy.

15:47

You know, great, great output period sales ready output.

15:52

That's got brand voice, guidelines, guardrails.

15:54

And then lastly, the visibility, I think, and I think just what we've learned

15:58

over the

15:59

couple of years of doing this is that less than that will fall short.

16:04

Like less than that falls short.

16:06

And I think going back to even the question on experience, like if your whole

16:09

experience

16:10

is going out to chat GPT prompt engineering at some level of competency, coming

16:16

back,

16:16

utilizing it and like it's a lot of work.

16:19

And I've heard from multiple customers that you can do as much work in chat,

16:25

then chat

16:26

gives you back.

16:27

So it's like not a big net gain in the experience.

16:31

I think as we're evaluating new pieces of technology, AI assisted technology,

16:37

that's

16:37

what we should be looking at.

16:38

At the end of the day, is it easy for the team to use?

16:43

Does it cause us more work, rework, change management, any of that?

16:49

And I think the way that we've risen above it is just a very focused on who our

16:52

customer

16:52

is.

16:53

We're not trying to sell everything.

16:54

Anybody.

16:55

And we're just saying very focused on solving two big problems.

17:00

One, like you know, our template emails.

17:04

And then two, personalization every step.

17:07

Yeah.

17:08

And it makes very focused.

17:10

It makes so much sense in your product because you know, you think about the

17:15

world expects

17:16

personalization now.

17:17

It's an expectation.

17:18

And I'm not talking about like S name.

17:19

I'm talking about like hyper personalization, right?

17:22

And you know, the dream of every sales and marketing professional is like

17:27

getting to the

17:27

right person with the right message at the right time.

17:30

You know, and obviously now the incredible capabilities that you know, GPS,

17:35

there's, there's

17:36

a natural language interface now to everything to apps, to data.

17:40

And I certainly had my aha moment, right?

17:42

I kind of almost bring it back to the aha moment I had with SaaS where cloud.

17:47

I was like, wow, there's a new software delivery model and it's changed

17:50

everything.

17:51

Right.

17:52

That's right.

17:53

That's kind of where we are now.

17:54

Like what are some of the aspects of the A.I.

17:57

conversation that you think are missing, right?

18:00

There's a lot of conversations happening around A.I.

18:03

dominates every conversation right now in software.

18:05

But what's missing?

18:07

What should people be talking about that we're not?

18:10

Yeah.

18:11

I mean, that's a really good, it's a really good question.

18:15

And I think, you know, you mentioned SaaS, you know, I saw it when we first

18:19

started selling

18:20

computers and computers were taking over.

18:23

I saw the internet, I saw mobility.

18:27

You know, I think it comes down to one of those situations where like the early

18:33

adopters

18:34

end up winning, late adopters end up losing.

18:37

And I think what you start to see is like a penalty for waiting here, just

18:45

quite frankly.

18:46

Like there's a penalty for being cautious.

18:49

Like A.I. is here.

18:51

Like your mobile phone is here, your computer is here and A.I. is here and

18:55

figuring out how

18:56

to effectively integrate that into your team's workflow, whatever your team

19:02

does to drive

19:03

efficiencies and to increase ultimately engagement.

19:07

You know, it's funny when you said you wanted your team to be better.

19:10

We talked about better could be faster, better could be higher quality output.

19:15

One of the things that we saw as we were doing a case study with a customer was

19:20

, you

19:20

know, not only did we increase productivity and drive engagement, but sentiment

19:25

went up.

19:25

It went up 10 points.

19:29

And like you think about the impact that that's having, like even people that

19:33

don't want

19:33

to be solicited or less bothered by your emails because of the quality and

19:38

quite frankly

19:39

how contextual they were to this individual's role.

19:43

So I think, you know, when done right, not only does our team get better, but

19:49

our prospects

19:50

and our customers have better experiences with us through this process, even

19:54

when they're

19:54

not ready to buy.

19:56

I think it's a very interesting byproduct right now.

19:59

Yeah, I really like, you know, one of the themes we've been talking about, Matt

20:03

, and

20:03

you you checked off the conversation with this is thinking about how AI impacts

20:08

the customer

20:09

experience and your workflow.

20:11

And one of the first things we did, you know, last year was we started thinking

20:16

about like,

20:17

how does this impact pipeline generation for sales and marketing professionals,

20:21

right?

20:22

Like what pieces of their workflow are going to be disrupted?

20:26

And that's kind of how we've been thinking about it.

20:30

What are some like parting words of advice you have for, you know, all of these

20:37

great

20:38

sales and marketing heroes we have at the pipeline summit today as it relates

20:43

to, you

20:43

know, really like AI is not new.

20:45

It's been around for a long time.

20:47

Machine learning has been around for a very long time.

20:49

But you know, really, we have really entered the AI revolution.

20:53

And like I said, you cannot be sitting on the sidelines.

20:56

So what are some kind of parting words of wisdom you have for people who are

21:00

really thinking

21:01

through AI and the next sort of journey for their business?

21:06

I mean, number one, embrace it.

21:09

It's here.

21:10

It's not going away.

21:11

You know, don't be a laggard.

21:13

Like embrace it.

21:14

I would also say on the other side of this, you know, you're starting to see

21:19

two kinds

21:20

of companies emerge.

21:23

You have AI companies that are replacing jobs and you know, AI organizations

21:29

like ours that

21:30

actually help people do their best work.

21:34

I like to commit to staying on the side of helping people do their best work.

21:38

And I think as we're evaluating, you know, technology, you know, again, embrace

21:44

it, but

21:44

also, you know, let's look at how it makes us better as opposed to not being

21:50

needed.

21:51

Yeah.

21:52

That's great.

21:53

That's great.

21:54

Matt, thank you so much for joining us.

21:56

It was really good to connect again.

21:57

I hope we don't go three years without connecting again.

22:01

And look forward to talking to you soon.

22:03

Absolutely great to be with you.

22:05

Have a great summit.

22:06

All right.

X

This is a test comment.

X

This is a longer test comment to see how this looks if the person decides to ramble a bit. So they're rambling and rambling and then they even lorem ipsum.


author