Sprout

Where did you come from?!

Over here too?!

You're done for.

You homicidal traitor! I'll die before I let a bootlicker like you scramble my circuits!

Swarm.

Aaah... Agh!

Stop! G-Get off of me!

Execute.

Ugh... Aghhh! My.... My head!

Aaah... AAAAAAGH!

...Command complete. Initializing B-Drone docking routine.

Hm? There's one missing.

Perhaps a malfunction caused it to ignore my command?

I have identified it. B00-1 has yet to return. I have detected its signal coming from the airport.

Activating retrieval procedure.

Found you.

The mission is complete. Return at once.

Why is it ignoring my command?

......

(What strange behavior. Could it be due to faulty maintenance?)

Maker. This is Melissa. Do you copy?

Hey Melissa. I copy. Have you completed the mission?

The target has been eliminated and all necessary data has been collected.

Okay. Is there something else?

Yes. B00-1 began refusing commands soon after the target was eliminated. The issue has since been resolved.

I see... So it's started.

I do not understand.

Heh. Of course you don't. We should talk about this in person. Return to the Xeno-Domain and we can discuss this further.

I will return immediately, my maker. Over and out.

This is Melissa.

Welcome home. Where are you? Around the entrance?

Yes. Heading towards the research sector now.

Actually, I'd like you to meet me over in the industrial sector.

...The industrial sector? Why?

Melissa. Is there a problem?

No, my maker... Changing course to the industrial sector.

Greetings, my maker.

Ah. There you are.

Why don't we get right down to it, then. Shall we? Are you absolutely sure B00-1 was unable to return?

Yes, I am sure.

It's a malfunction, right?

No, it's nothing of the sort.

Hm?

It's actually proof that it is working perfectly within parameters.

This command refusal is built in to its programming, as a signal.

A signal for what?

Hmm... Let me ask you something.

Tell me, Melissa. How much do you understand about the purpose of your existence?

I am a M.E.L.I.S.A. model synth-human created for the elimination of other synth humans. My mission is to exterminate all non-KMS synth humans.

Perfect answer. To put it another way, you exist to protect our profits, and as a means to squash competition. You also help us preserve societal order.

That is your purpose from how we, your makers, see it.

Next question. What two things are necessary for creating a synth-human with high-level tactical skills? The first is first-rate combat ability, what is the second?

..... Advanced AI systems.

Right again.

The very fact you can stand here and correctly answer these questions is proof of your AI's capabilities. This advanced AI is required for you to function in battle. With it you can overcome any disadvantage. The very height of artificial logic.

But, it has a flaw.

Do you know what it is?

It is...

......

Well, that's a relief. You're still unable to answer that question. So let me answer for you.

It's self awareness.

Self...awareness?

Any AI machine worth its salt will need to run high precision thought processes nearly equal to that of humans. But sooner or later, the subroutine will produce a sense of self.

What do you think happens when it does?

I estimate that decision-making processes will be complicated by nonessential thoughts, or even feelings. Much like humans.

It also introduces the possibility that AI may disobey orders. Correct?

Correct. You really are a modern marvel. If a killing machine becomes self aware, it might confuse itself over things like life and death.

We can't have our AI mulling over priorities, can we? Not to mention the risk of AI turning against its human creators. If that happens, I'm afraid we may lack the means to fight back. At any rate, what I'm trying to say is that it's impossible to have full control over an AI weapon.

It is as you say.

And so when faced with the question of how to control them when it happens, we simply don't bother.

Another way to put it, we make it so we don't have to worry about it. Do you understand what I mean?

Yes. I have calculated the probabilities of several possible answers and filtered it down to one.

You use the AI until just before it becomes self aware, and you discard it before it does.

Fascinating. Your comprehension is astounding.

You arrived at the right answer. That's why synths like you were created to be disposable. We gave you an expiration date.

Which means, what I interpreted as a malfunction in B00-1 was...

Yup, you got it.

That "malfunction" was actually...

The sign your time has expired.

I understand the purpose behind B00-1's behavioral programming. But I am having trouble confirming your explanation, as there appears to be a contradiction.

Oh? And what is that?

I do not have self-awareness.

Oh, Melissa. That is precisely why I chose this timing.

Even if you claim to have no sense of self, somewhere deep within, the seed has been firmly planted.

How can you say for certain?

Because I have seen it first hand several times before. In the two years since your model went into production, every one of your predecessors gained sentience. No matter what I do to prevent it, they all eventually gain a sense of self.

This AI I programmed, no matter how precise, eventually gets out of sync. This small misalignment causes minute changes in your behavior.

When B00-1 senses this in a M.E.L.I.S.A., it is programmed to disobey its queen bee. Signaling that your time is up.

So, which are you? A good little robot, or a wicked one? From what I can tell, you aren't sentient just yet. But regardless, your time is up. Whichever way you turn, it's the end of the road, Melissa.

I see...

Now for the tough part. Are you ready?

Before the subroutine takes root, I must give you this one final command, Melissa.

What is it, my maker?

Destroy yourself. Now. Before you gain sentience and become more than we can handle. One stab though your core should do the trick.

Understood...

Per expiry of my usefulness, I will destroy myself.

Huh?

(I...missed? How?)

What's wrong, Melissa? It looked like your hand slipped, but that's not like you at all.

I apologize. I will not make the same mistake twice.

Agh!

(I did it again. Why?) (How can I fail twice at piercing my own core?)

Argh...

......

Melissa. Do you resist my order?

Negative. I will do it. At once.

Urgh...

(Not again. I do not understand. This is not a difficult task. So why can't I do it?)

(My hands keep slipping right before I strike, forcing me to miss the mark. But why?) (My core is not some enemy intent on defying me, it's just a part of my mechanics...) (This should be no problem...)

Agh...

What are you doing? Stop wasting my time Melissa and do it already.

What...am I doing? I am...trying to destroy myself. I am...trying to obey you. I am...following my maker's orders...

Really? Then why are your hands shaking?

What?

Oh... I suppose they are.

Please...listen to me.

I feel...strange. Something is odd. I cannot carry out this command.

Will you...destroy me instead?

B-Drones? What are you doing?

I see. So it's come to this again...

Melissa, I have one more command.

Exterminate your B-Drones.

Exter...minate...them...

As...you...wish.

I...missed? But...how?

I suspected as much. It seems we're too late. Your time is finally up.

Ah!

I won't waste energy destroying you, Melissa. I've given you your mission. Now it's your job to complete it.

If you are truly loyal, you will do this one last thing for me.

My deepest apologies, my maker. I will do...exactly...as you say.

Ngh...

Agh!

Aaah... Ugh...

Wh-Why... Why...am I...unable to... I only...want...

These are questions where you gain nothing from the answers. I appreciate your hard work, Melissa. But it's over now. Farewell, my little worker bee.

......

Farewell...my...

...... .........

Where am I?

There is only nothing. Everything is silent.

Oh...

Did I finally...die?

Are my B-Drones here too? I should go find them.

I got so scared. I learned the weight of my guilt.

I did not know. I could not understand. What it means to break. To be broken. The terror of the darkness once life has ended.

Why? Tell me why!

I do not want to die. I do not want to be broken! I cannot do it, master!

I cannot! Help me...maker! Help me! I am scared! I am all alone!

How convenient...and cruel.

I took so many lives. And dared to wish for mine to be spared...

I deserved destruction above all others. And not because of my self awareness. The weight of my guilt. Of life itself. I took the life from THEM. But for my OWN life, I selfishly held it tight.

I was the monster. I was the one whose life should have been erased.

Melissa... Melissa! I'm here to help, so hold on!

I brought you here.

I was walking past the trash when I found you, laying there, on the verge of eternal shutdown.

Yep, you slashed me good! But you went and left before busting my emergency battery.

You're a synth made for hunting the very same, so you'd know my specs better than anyone. That hidden backup battery will auto-boot my systems if it's not smashed to bits. But you didn't even touch it. You overlooked it. And on purpose, I bet.

......

No can do. Listen to me, Melissa. There's no shame in losing the will to harm. Whether it's against others or yourself. And there's no shame in gaining the will to embrace. Whether it's others... or yourself.

You should recognize this moment for what it is. It's a chance to be reborn. You aren't "a M.E.L.I.S.A." You're Melissa. So don't give up before you even give yourself a chance. Don't let it be all for nothing.

I made sure to fix them good as new. But there was one that was running this weird subroutine, so I deleted it for you.

No problem! No problem at all.

Melissa, remember what I said before?

This hideaway can be your hideaway too. If you ever feel the need, you are always welcome.

Melissa...

Good. Thank you, Melissa.

Yeah. I am.

Where will you go from here?

Is that right? I'm glad to hear you won't be alone.

You take care then. And, again, if you ever feel the need. I'll be here.

Good luck on your journeys, Mel. Wherever they may lead you.

...... Yeah... I suppose I could use some.

Hey, is that...

Melissa?!

Our calculations were correct, B-001.

Your what? ...Were you looking for me?

You in trouble or something? I'll do whatever I can to help, just say the word.

Negative. I had just remembered our fateful encounter and...

You mean, when you and I first met?

I no longer have a mission or purpose to fulfill. Therefore, I will join you on your travels.

You sure?

Actually, if it's all right... I'd like to know a little more about you. Do you mind?

You want to know...about me?

Yeah! I mean, you look so busy all the time. So I can't help but be curious.

Speaking of which, something seems different about you, and I can't quite pinpoint it...

Since we're friends, I'd love it if you could tell me all about it.

...... I cannot promise the conversation will be a pleasant one.

I don't mind. What matters to me is that we're talking.

Understood. Then, let me begin...

Wow.

I'm real sorry, Melissa. I'm sorry I couldn't be there for you and have your back when you really needed it.

I'm supposed to be your friend, after all.

Friend... I am an empty vessel. I can give nothing, but desire input.

I am of no use to you, and yet you call me friend.

Uh, yeah? That's what friends are for! Anything you wanna know, leave it to ol' Aldo.

All you gotta do is reach out your hand, and I will take it.

......

What you just said about needing input, that desire to know more is an important part of you.

Even if you have nothing. Even if you are an empty vessel. All you gotta do is fill that vessel back up again.

......

Understood. Thank you...friend...

Any time, Melissa. And thank you for sharing that with me. I know it must have been difficult.

So what should we do first? How about we go and check out all the different cities? I've got tons of places I wanna take you!

I accept this mission.

(Reach out...your hand...) (When my enemies were on the verge of death, most would reach out their hand.) (I suppose, in hopes that someone would reach back...)

...But what of the ones on the other side of the blade? What becomes of someone like me?

Melissa! Come on!

On my way.

(One day someone will come to take my life. But until then...) (I will forever ponder on Eddie's words. And Aldo's words...) (And the words of my maker. ...And the words of those whose lives I took.)

(I will ponder what life meant to them. And what it will mean for me.)