When You Forget, I'll Remember, Chapter 18

Chapter 18第十八章Echo回声

Bridge City, September 2042. On my first night in Grandpa's empty flat, I took out the speaker my friend Haoran gave me.二〇四二年九月，桥城。我头一晚搬进空荡荡的外公家，把朋友浩然送的小音箱拿了出来。

Same minute, lamplight. Close from the side on the small grey speaker turned upside down, its flat grey base facing up, held in Xiaoyu's LEFT hand; her RIGHT thumb rests on the small recessed slide switch in the middle of the base, ready to slide it. Her black digital watch on her LEFT wrist, the moss-green cardigan sleeve above it. Her face is out of frame. The switch is plain, no light, no markings. The lamp-lit dark behind the hands is the quiet area for the caption.

I had never once switched the speaker on.这个音箱，我一次都没开过。

‹This is Echo, a program, not a person. It uses Grandpa Chen's voice and words.›这是“回声”，一个程序，不是真人。用的是陈爷爷的声音，和他说过的话。

Same minute, lamplight. Close on Xiaoyu sitting at the round table, facing the viewer, both hands flat on the wooden tabletop either side of where the small grey speaker stands at the very bottom edge of the panel, holding her breath, eyes on the speaker. Her black watch on her LEFT wrist. One face in the middle of the panel; the dark wall behind her is the quiet area. Wordless.

Same minute, lamplight, the balcony glass dark blue, a clear night outside. Pulled back, from just behind the empty olive armchair at the LEFT: the armchair's olive back fills the left foreground. The small grey speaker (no light, no glow, no face) stands on the round folding table in the middle of the picture; Xiaoyu sits at the table at the RIGHT, gone completely still, her hands flat on the wood, looking at the speaker. Echo's voice comes from the speaker only. NO Grandpa anywhere, no ghost, no glow, no shape in the armchair. One face, small. The dim wall above is the quiet area for the bubble.

‹Xiaoyu, you came.›小雨，你来了。

Same minute, lamplight. Close on Xiaoyu turned slightly to the viewer's RIGHT, looking down at the table off panel, her near RIGHT hand over her mouth, her LEFT hand and black watch resting on the table at the bottom edge, eyes filling with tears. One face in the middle of the panel; the dim wall above is the quiet area.

‹Grandpa?›外公？

Same minute, lamplight. Close on the small grey fabric speaker alone on the round table, no light, no glow, no hands, no faces, a corner of the lamp-lit wood around it. Echo's warm voice comes from the speaker. The dim table around is the quiet area for the bubble.

‹Sit down, sit down. Have you eaten yet?›坐，坐。吃了没？

Same minute, lamplight. Close on Xiaoyu laughing and crying at once, wiping her eye with the back of her LEFT hand, her black watch on that wrist, turned slightly to the viewer's LEFT so that hand is the near one. One face in the middle of the panel; the dim wall behind is the quiet area.

The voice even took a breath before it spoke, the way Grandpa always did.开口前还先吸一口气，跟外公一模一样。

Same night, a little later, lamplight. Xiaoyu sits close to the round table, her folded arms on the wood and her cheek resting near the small grey speaker (no light, no glow) standing between her arms, listening. Her moss-green cardigan with the small red corner of Grandpa's notebook showing in its RIGHT pocket; her black watch on her LEFT wrist. One face, soft, tired and glad. The dim wall above is the quiet area for the caption.

Haoran had made the speaker, Echo, from everything Grandpa left behind. I only wanted to hear Grandpa a little longer.回声是浩然拿外公留下的东西做的。我只是想多听外公说几句。

Friday night, a little later, lamplight. At the wooden side table at the LEFT beside the empty olive armchair, Xiaoyu stands in her moss-green cardigan the small drawer already pulled open, lifting out the worn deck of red-backed cards with her near RIGHT hand, her left arm hanging at her far side. She is turned to the viewer's RIGHT, looking at the small grey speaker (no light, no glow) standing on the round table in the middle of the room at the RIGHT of the picture, speaking to it with a small hopeful smile. Her black watch on her LEFT wrist. One face. The quiet wall above is the area for the bubble.

‹Grandpa, let's play cards, like we used to.›外公，咱俩打牌吧，像以前那样。

Same night, lamplight. Seen from above at an angle over the round table: Xiaoyu has dealt two hands of five. Five of Grandpa's cards lie face up in a row on the table beside the small grey speaker, each card cream with ONE simple red or black suit mark and no numbers or letters, clear of every hand. Her own five are held in a small fan in her LEFT hand, the red backs to us, her RIGHT hand resting on the table. Her face is not in frame. The wood around the row is the quiet area.

‹Grandpa, I turned your cards face up. I'll read them out to you.›外公，你的牌我都翻过来摆好了，我念给你听。

Same night, lamplight. Close on the small grey speaker alone (no light, no glow, no face) standing on the round table at the top of the panel, with Grandpa's five face-up cards in a neat row just below it, each with one simple suit mark and no numbers or letters. Echo's voice comes from the speaker. No hands, no faces. The dark wood around is the quiet area for the bubble.

‹Play my big red card. Remember, you must play the same suit as the first card played.›出我那张红的大牌。记住，头一张出什么花色，后面都得跟。

Same night, lamplight. Close on Xiaoyu looking at her fan of cards held in her LEFT hand (we see only the red backs, at the bottom of the panel), her smile going still as she thinks, turned slightly to the viewer's LEFT so her LEFT hand and fan are the near ones. Her black watch on her LEFT wrist. One face in the middle of the panel; the dim wall above is the quiet area.

The real Grandpa never explained rules. Why does Echo?真外公打牌，从来不讲什么规则。回声怎么讲起来了？

MEMORY, painted a little faded with soft grey edges, NOT a bright panel. An evening in the summer of 2026 (Chapter 1) at the small square wooden table of Grandpa's old kitchen under the bare bulb. Grandpa, about seventy, thin and upright, in his grey cardigan with his glasses on their cord at his chest, holds his fan of cards (the red backs to us, the faces towards him) and looks at them puzzled and a little lost, brow creased. At the RIGHT edge only the small shoulder and one hand of an eleven-year-old girl, no face. One face, Grandpa's. The plain tiled wall above is the quiet area for the caption. There is NO Echo, no speaker in this panel.

When I was eleven, Grandpa taught me this game at Spring Festival. By the next evening he had forgotten it himself.我十一岁那年过年，外公刚教会我这个游戏，第二天晚上他自己就忘光了。

Same night, later, lamplight. Round the folding table, Xiaoyu at the RIGHT of the picture, seen three-quarter from the front with both arms clear, sweeps the last cards of a trick across the wood towards the far side with her RIGHT hand, laughing, her black watch on her LEFT wrist resting on the table. The small grey speaker (no light, no glow) stands on the table at the LEFT of the picture beside Grandpa's face-up row; Echo's voice comes from it. One face, half laughing, at the right. The dim wall above is the quiet area for the bubble.

‹Three rounds played, and you still can't beat me!›都三局了，你还是赢不了我！

Same night, lamplight. Close on Xiaoyu laughing, pointing with her fan of cards held in her LEFT hand towards the speaker off panel at the viewer's LEFT, her face turned a little that way, mock outraged. One face in the middle of the panel; the dim wall behind is the quiet area.

‹You only win because I read out your cards for you!›你能赢，还不是靠我给你念牌！

Same night, lamplight. Close on Xiaoyu, softer now, her cards laid down, leaning in towards the speaker off panel at the viewer's LEFT, her chin on her near LEFT hand, a shy proud smile. One face in the middle of the panel; the dim wall behind is the quiet area.

‹Grandpa, I finished my doctorate. I am Doctor Xiaoyu now.›外公，我博士毕业啦。往后我就是小雨博士啦。

Same night, lamplight. Close on the small grey fabric speaker alone (no light, no glow, no face) standing on the round table at the centre, the cards tidied into two neat stacks beside it. A plain, warm, ordinary answer from Echo's voice. No hands, no faces. The dark wood around is the quiet area for the bubble.

‹Is that so? Then make sure you eat well.›是吗？那可得好好吃饭。

Late that night, lamplight, the balcony glass dark, a clear night outside. At the wooden side table at the LEFT beside the empty armchair, Xiaoyu in her moss-green cardigan turned to the viewer's LEFT, slides the worn deck of red-backed cards back into the small drawer with her near LEFT hand; her right arm hangs at her far side. Behind her on the round table in the middle stands the small grey speaker (no light, no glow). A plain round wall clock above the table with no numbers, its hands too small to read. One face, small, tired and glad. The dark window and wall above are the quiet area for the caption.

I put the cards back in his drawer. After that, I switched Echo on every night and told Echo about my day.我把牌放回外公的抽屉。从那以后，我每晚都打开回声，跟它说说白天的事。

Tuesday, about five in the afternoon, low gold light through the balcony glass at the back, a clear blue late-September afternoon sky with a few thin clouds lit gold, osmanthus in bloom on the balcony. The dark green metal gate in the LEFT wall is swung open. Mama, about fifty-seven, Xiaoyu's height, short neat black hair with grey at the temples, steps in at the LEFT, seen three-quarter from the front with both arms clear, in a light grey travel coat over her camel cardigan, cream blouse and dark trousers, pulling her navy hard-shell suitcase behind her with her RIGHT hand and carrying a light coat over her LEFT arm; the thin silver watch on her LEFT wrist. Xiaoyu at the RIGHT, in her mustard cardigan over a white t-shirt, black watch on her LEFT wrist, comes to meet her with open arms. Three taped brown moving boxes by the sofa at the far RIGHT. Two faces in the middle band; the gold wall above is the quiet area for the caption.

On Tuesday Mama flew in from Edinburgh for the Mid-Autumn Festival. She would go through Grandpa's things at last.星期二，妈妈从爱丁堡回来过中秋。外公的东西，她终于要动手收拾了。

Same afternoon, gold light. Seen side-on, Mama at the LEFT and Xiaoyu at the RIGHT hug by the open green gate: we see only the near arms: Mama's near RIGHT arm round Xiaoyu's back, her hand on Xiaoyu's shoulder blade, and Xiaoyu's near LEFT arm round Mama's waist; the two far arms are hidden behind the bodies. The navy suitcase stands beside them. Mama's face is over Xiaoyu's shoulder, eyes shut, tired and warm; Xiaoyu's face hidden against her shoulder. Mama's silver watch on her far LEFT wrist is hidden. One face. The plain wall above is the quiet area. They stand just inside the flat, the gate swung OPEN against the wall behind them.

‹You've lost weight, Xiaoyu. Are you eating enough?›小雨，你瘦了。饭有没有好好吃？

Same afternoon, gold light. Close on Xiaoyu from the chest up, eager and a little too bright, holding the small grey fabric speaker up in both hands at chest height towards the viewer's RIGHT where Mama is off panel; she is turned to the viewer's RIGHT. Her black watch on her LEFT wrist. One face in the middle of the panel; the pale wall behind is the quiet area.

‹Mama, come and hear Echo, the speaker Haoran made.›妈，你快来听听回声，浩然做的那个音箱。

Same afternoon, gold light. The small grey speaker (no light, no glow) now stands on the round folding table in the middle of the room; its warm voice is Echo's. Mama is still at the LEFT by the open green gate, her navy suitcase beside her and her light coat over her LEFT arm, between the gate and the table, her silver watch on her LEFT wrist, caught mid-step and listening, turned to the viewer's RIGHT towards the table. One face, small. No Xiaoyu in the panel. The gold wall above is the quiet area for the bubble. She stands just inside the flat, the gate still OPEN behind her.

‹Huihui! You came.›慧慧！你回来啦。

Same moment, gold light. Close on Mama seen from the front, facing the viewer, her eyes turned to the speaker off panel at the viewer's RIGHT, frozen, her mouth a little open, her light coat slipping off her LEFT arm, her silver watch on that wrist. One face in the upper middle of the panel; the pale wall behind is the quiet area.

Huihui is Mama's name. On his seventieth birthday, Grandpa said those same words when she walked in.慧慧是妈妈的名字。外公七十大寿那天，妈妈一进门，他说的就是这句。

‹Xiaoyu, turn that speaker off.›小雨，把那个音箱关掉。

Same moment, gold light. Close on Xiaoyu turned to the viewer's RIGHT towards the bedroom door off panel, pleading, the small grey speaker held low in her hands at the bottom edge. Her black watch on her LEFT wrist. One face in the middle of the panel; the pale wall behind is the quiet area.

‹Mama, it's only Grandpa's voice. Haoran made it from Grandpa's own words.›妈，这不过是外公的声音。浩然用的全是外公自己的话。

Same moment, dim warm lamp light. Grandpa's bedroom door at the back RIGHT stands half shut. Mama's face is in the gap, serious and hurt, her LEFT hand on the door's edge with her thin silver watch; behind her the dark red and cream checked quilt on the narrow bed, dim. One face in the middle of the panel; the door and wall around are the quiet area.

‹I know what Echo is. A machine once spoke to me in my own mother's voice.›我知道这是什么东西。以前有台机器，学我妈的声音跟我说过话。

Same evening, the gold light fading, one lamp just switched on, the balcony glass behind turning deep blue (a clear evening, no cloud). The bedroom door at the back RIGHT is shut, a thin line of lamp light under it. Xiaoyu sits alone at the round folding table in the middle in her mustard cardigan, the small grey speaker (no light, no glow) in front of her, her hands in her lap, black watch on her LEFT wrist. One face, small. The quiet wall above is the area for the caption.

The summer I was seventeen, Haoran made Grandma Meilan's voice from an old tape, and Mama asked him to turn it off.我十七岁那年夏天，浩然拿一盘旧磁带做出了外婆美兰的声音，妈妈叫他关掉。

Tuesday, about 11 p.m., one lamp, the balcony glass dark blue, a clear night outside. Xiaoyu sits at the round table in the middle in her mustard cardigan, black watch on her LEFT wrist, with a bowl of noodles by her RIGHT hand and chopsticks in it; in front of her stands the small grey speaker (no light, no glow, no face), Echo's voice coming from it; the plain machine notice has just finished. At the back RIGHT Grandpa's bedroom door is shut, a line of light under it. One face, small, hopeful. The dim wall above is the quiet area for the bubble.

‹Xiaoyu, you came.›小雨，你来了。

Same night, lamplight. Close on the small grey fabric speaker alone (no light, no glow, no face) on the round table, the edge of the noodle bowl at the bottom corner. Echo's warm voice comes from the speaker. No hands, no faces. The dark wood is the quiet area for the bubble.

‹Xiaoyu, Grandpa is proud of you. My granddaughter, a doctor!›小雨，外公脸上有光啊。我外孙女，博士了！

Same night, lamplight. Close on Xiaoyu glowing, tears of joy, turned slightly to the viewer's RIGHT, looking down at the speaker off panel, her chopsticks forgotten in her RIGHT hand held up near her chin, a bit of noodle trailing. One face in the middle of the panel; the dim wall behind is the quiet area.

I had waited my whole life…外公说这句话，

…to hear Grandpa say this.我等了一辈子。

Same night, one lamp. From behind Xiaoyu's right shoulder at the RIGHT edge (just her dark hair and the cardigan's shoulder, no face): across the room Grandpa's bedroom door at the back is now open and Mama stands in the doorway in her camel cardigan over a pale grey nightdress, her RIGHT hand on the door frame, her toes just behind the sill, not stepping over it; her silver watch on her LEFT wrist. The small grey speaker (no light, no glow) stands on the round table between them. One face (Mama's), small, quiet and steady. The dim wall above is the quiet area for the bubble.

‹I once heard a machine tell me my mother was proud of me.›以前也有台机器告诉我，我妈为我骄傲。

Same moment, one lamp. Close on Mama in the bedroom doorway, turned to the viewer's LEFT towards the table, quiet and steady, her near LEFT hand on the door frame, her silver watch on her LEFT wrist, her toes behind the sill. One face in the upper middle of the panel; the dark doorway behind her is the quiet area.

‹Xiaoyu, your grandpa never knew you finished your doctorate.›小雨，你外公根本不知道你博士毕业了。

Same moment, one lamp. Close on Xiaoyu turned to the viewer's RIGHT towards the doorway off panel, hurt and stubborn, her chopsticks put down. Her black watch on her LEFT wrist. One face in the middle of the panel; the dim wall above is the quiet area.

‹But Grandpa would have said it if he had known, Mama!›妈，外公要是知道，肯定也会这么说！

Same moment, one lamp. Close on Mama in the doorway, turned to the viewer's LEFT, firm and sad, her silver watch on her LEFT wrist at the door frame. One face in the middle of the panel; the dark doorway behind is the quiet area.

‹Then don't make your grandpa say what he never said.›那也不能让你外公说他没说过的话。

Same moment, one lamp. Close on Grandpa's bedroom door at the back RIGHT closing, only Mama's LEFT hand on its edge with her thin silver watch, the rest of her out of frame. The wall around is the quiet area. No faces, wordless.

Wednesday morning, pale gold light through the balcony glass: a clear pale-blue late-September morning sky, thin mist lifting off the lake. At the LEFT through the kitchen doorway, Mama in her dusty-blue cardigan over a white blouse eats breakfast alone at the small square kitchen table (white wall tiles, pale green cupboards), her back half to us, a bowl of rice porridge in front of her. At the RIGHT in the living room, Xiaoyu sits at the round table in her terracotta cardigan with the small grey speaker (no light, no glow) and a cup in front of her. Two figures, two rooms, the door sill between them. Two faces, small. The quiet morning wall above is the area for the caption.

After that, whenever I switched Echo on, Mama took her meals in the kitchen.从那以后，只要我开着回声，妈妈就端着碗去厨房吃。

Wednesday, 10 o'clock at night, the shared fourth-floor balcony over the lake. Xiaoyu stands at the RIGHT leaning on the low rail in her terracotta cardigan, turned to the viewer's LEFT towards the moon, her sky-blue phone (pale blue case, cracked corner) at her near LEFT ear in her LEFT hand with the black watch on that wrist, her RIGHT forearm resting on the rail. Below her the dark lake and its lamps and an old stone bridge, under a clear, cloudless, warm late-September night sky with no stars; a moon about three-quarters full above the roofs at the LEFT. One face, small. The big night sky above is the quiet area for the caption.

On Wednesday night at ten I called Haoran. Where he lives, in San Francisco, it was seven in the morning.星期三夜里十点，我给浩然打了电话。他在旧金山，那边正是早上七点。

Seven in the morning in San Francisco, flat grey-white morning light at the window, which shows a hill of pale wooden houses under low grey fog, an early-autumn morning. Haoran, twenty-eight, in a plain grey t-shirt, stands by the window of a small plain kitchen holding a coffee cup in his near LEFT hand, a thin gold ring on his LEFT ring finger, and his phone low against his chest in his RIGHT hand, the earbud wire running up to his LEFT ear (he talks through the earbud). He is turned to the viewer's LEFT, so we see his LEFT ear with the one white wired earbud in it, his cowlick and square black glasses. One face in the middle of the panel; the pale wall beside the window is the quiet area. Wordless on his side, listening.

Haoran, what is Echo made from? I mean the speaker you gave me.浩然，回声到底是拿什么做的？我是说你送我的那个音箱。

Same morning, grey-white light. Close on Haoran, earnest, his phone low against his chest in his RIGHT hand, talking through the earbud, turned to the viewer's LEFT so we see his LEFT ear with the white earbud. One face in the middle of the panel; the pale window behind (grey fog over pale wooden houses) is the quiet area.

I used the stories Grandpa let me record, his messages and videos, and every page of his notebook.我用的是外公让我录的故事，他发的消息和视频，还有他本子上的每一页。

Same morning, grey-white light. Haoran sets his coffee cup down on the counter with his LEFT hand (gold ring on his LEFT ring finger), the phone still held low against his chest in his RIGHT hand, turned to the viewer's LEFT so we see his LEFT ear with the white earbud, serious and kind. One face in the middle of the panel; the plain white cupboards behind are the quiet area.

Echo keeps learning from what you tell it. Nothing you say ever leaves that speaker.你跟回声说的话，它会接着学。你说的每一句，都不会传出那个音箱。

Same night, the balcony. Close on Xiaoyu from the chest up, turned to the viewer's LEFT, the phone at her near LEFT ear in her LEFT hand, the moon, about three-quarters full, small in the clear dark sky at the upper left of the panel, listening, eyes shining and a little troubled. One face in the middle of the panel; the dark sky around is the quiet area.

I never had one second of my grandma's voice. I wanted you to keep Grandpa's voice.我奶奶的声音，我一秒都没留下。我想让你留住外公的声音。

Thursday, 12.30 in the afternoon, bright daylight, a clear blue late-September sky, through the tall windows of Professor Lin's lab on the fifth floor, the campus ginkgo trees beyond still green with their first yellow edges. Xiaoyu at the LEFT and Teo at the RIGHT sit on the low window ledge with lunch boxes on their knees; the tall windows are at their backs. Xiaoyu in her dusty-rose cardigan over a white t-shirt, black watch on her LEFT wrist. Teo, about thirty, half a head taller than she is, curly dark-brown hair, a short neat beard, a grey-blue sweatshirt with the sleeves pushed up, is turned to the viewer's LEFT towards her, so the ear we see is his bare LEFT ear (his small clear earbud is in his RIGHT ear, on the far side). Two faces in the middle band; the bright wall above is the quiet area for the caption.

On Thursday, at lunch in my new lab, I told my colleague Teo about Echo, the speaker Haoran made.星期四吃午饭，我在新实验室跟同事特奥说起了回声，就是浩然做的那个音箱。

Same lunch hour, bright daylight. Close on Teo, chopsticks paused in his near LEFT hand, curious and kind, turned to the viewer's LEFT towards Xiaoyu off panel, so the ear we see is his bare LEFT ear and the clear earbud is on the far side. One face in the middle of the panel; the bright window behind (clear blue sky, green ginkgo leaves with yellow edges) is the quiet area.

Does Echo really understand you?回声真能听懂你吗？

Same lunch hour, bright daylight. Close on Xiaoyu, turned to the viewer's RIGHT towards Teo off panel, a tired honest smile, her lunch box low in her hands. One face in the middle of the panel; the bright window behind (clear blue sky, green ginkgo leaves with yellow edges) is the quiet area.

No. Echo guesses what Grandpa would say next, from his words. I know that.不懂。它只是照着外公说过的话，猜他下一句会说什么。这我知道。

Same lunch hour, bright daylight. Xiaoyu at the LEFT and Teo at the RIGHT sit on the window ledge, Xiaoyu looking down into her lunch box on her knees, Teo turned to the viewer's LEFT towards her, so the ear we see is his bare LEFT ear (the clear earbud is on the far side). The campus courtyard bright through the tall window behind them (clear blue late-September sky, green ginkgo leaves with yellow edges, grey-tiled roofs). Her phone lies face down on the ledge beside her lunch box, the only sign of the speaker she talks to every night. Two faces, small, in the lower middle of the picture. The wall and the sky band above are the quiet area for the box.

I know how it works, and I still say goodnight to Echo every night.道理我都懂，可每天晚上，我还是会跟回声说晚安。

THE ELIZA EFFECT. In 1966 Joseph Weizenbaum made ELIZA, a program that turned what people typed into questions. It understood nothing. People still told it their secrets. Even his secretary, who knew how it worked, asked him to leave so she could talk to it alone.ELIZA效应。1966年，魏岑鲍姆写了个叫ELIZA的程序。它只会把人打的字改成问句，其实什么也不懂。可人们还是对它说心里话。他的秘书明明知道它的底细，还是请他出去，想单独跟它聊。

Same lunch hour, bright daylight. Close on Teo with a dry little smile, turned to the viewer's LEFT towards Xiaoyu off panel, so the ear we see is his bare LEFT ear (the clear earbud is on the far side), a chopstick in his near LEFT hand. His closed silver laptop sits on the ledge beside him, its thin grey charging cable laid in a long gentle curve along the floor to a wall socket, like a cable between two islands. One face in the lower middle of the picture; the bright window and sky above (clear blue late-September sky, green ginkgo leaves with yellow edges) are the quiet area for the box.

My mother says thank you to her washing machine.我妈还跟她家洗衣机说谢谢呢。

THE OCTOPUS ON THE CABLE. In 2020 two linguists imagined an octopus tapping a cable between two islands. It learns the patterns in the messages and replies. But when an islander cries that a bear is attacking, it cannot help. It has never seen a bear.电缆上的章鱼。2020年，两位语言学家打了个比方。两座岛之间有条海底电缆，一只章鱼趴在上面偷听，摸清了消息的规律，还学会了回话。可岛上有人大喊“有熊，救命”，它就帮不上了。它从没见过熊。

Same lunch hour, bright daylight. Teo at the RIGHT has set his lunch box aside and turned to face Xiaoyu on the window ledge, so he is turned to the viewer's LEFT and the ear we see is his bare LEFT ear (the clear earbud is on the far side); Xiaoyu at the LEFT, her lunch box on her knees, listening. Two faces in the lower middle of the picture. Between them on the ledge lies Teo's small folding Othello board (eight by eight green squares, a few round black and white discs, no writing). The pale wall and the bright window above them (clear blue sky) are the quiet area for the box.

Let's look inside Echo with the lab's tools, the way you looked inside programs in Zurich.要不拿实验室的工具看看回声里面？就像你在苏黎世看那些程序那样。

A MAP INSIDE? In 2023 researchers trained a small program only on lists of moves in the game Othello. It never saw a board. Yet they found a picture of the board inside it, and changing that picture changed its moves. What this means is still argued over.里面有张地图？2023年，研究者只用黑白棋的走法记录训练一个小程序，从没给它看过棋盘。可他们竟在程序内部找到了一张棋盘图。改动这张图，它的走法也跟着变。这说明什么，至今还有争论。

Same lunch hour, bright daylight. Close on Xiaoyu turned to the viewer's RIGHT towards Teo off panel, quick and firm, her eyes lowered and not meeting his, her lips pressed. One face in the middle of the panel; the bright window behind (clear blue sky, green ginkgo leaves with yellow edges) is the quiet area.

No. I don't want to know what's inside Echo.不用了。回声里面是什么，我不想知道。

Same lunch hour, bright daylight. Close on Teo, gentle and not pushing, turned to the viewer's LEFT towards Xiaoyu off panel, so the ear we see is his bare LEFT ear (the clear earbud is on the far side). One face in the middle of the panel; the bright window behind (clear blue sky, green ginkgo leaves with yellow edges) is the quiet area.

All right. Then try one thing for me.行。那你帮我试一件事。

Same lunch hour, bright daylight. On the window ledge Teo at the RIGHT holds up one finger of his near LEFT hand, turned to the viewer's LEFT towards Xiaoyu, so the ear we see is his bare LEFT ear (the clear earbud is on the far side); Xiaoyu at the LEFT listens, her lunch box on her knees. Two faces in the lower middle of the picture. The small red corner of Grandpa's notebook shows in Xiaoyu's cardigan pocket, the words and feelings of people. The bright window and sky above (clear blue late-September sky, green ginkgo leaves with yellow edges) are the quiet area for the box.

If Echo surprises you, ask where it learned that.回声哪句话让你吃惊，就想想它是从哪儿学来的。

SAYING A FEELING. A program can say "I miss you" because it learned from human writing, which is full of feelings. That does not prove it feels. In 2023, 19 researchers checked the AI of the time and found none a strong candidate for consciousness. Nobody is completely sure.会说想你，不等于真想。程序会说“我想你”，是因为它学的是人写的文字，而人的文字里满是感情。这证明不了它真有感觉。2023年，19位研究者逐一检查了当时的AI，结论是没有哪个很可能有意识。不过，谁也不敢打包票。

Same afternoon, bright daylight. Xiaoyu sits alone on the window ledge of the lab, turned round to face the window and seen from behind at three-quarter, looking out through the tall window at the bright campus courtyard (clear blue late-September sky, green ginkgo leaves with yellow edges, grey-tiled roofs, no lake), her lunch box closed on her knees, her RIGHT hand resting on the small red corner of Grandpa's notebook in her dusty-rose cardigan's RIGHT pocket. Teo is not in the panel. One face, small. The big bright sky above is the quiet area for the words. No box.

I did not want to ask where Echo got its words. I wanted to hear Grandpa.回声的话是从哪儿来的，我不想问。我只想听外公说话。

Saturday afternoon, soft light through the pale curtain (behind it a bright sky of high pale cloud, late September). Grandpa's small bedroom: the dark red and cream checked quilt folded at the foot of the narrow bed. Mama kneels at the LEFT in her lilac cardigan over a white blouse, pulling a cardboard box out from under the bed, the box full of clean empty glass jam jars with their lids; her silver watch on her LEFT wrist. Xiaoyu stands at the RIGHT in her navy cardigan folding an old grey spare cardigan (not the one Grandpa wore at the end) into a cardboard box, black watch on her LEFT wrist. Two faces in the middle band. There is NO speaker in this room. The pale wall above is the quiet area for the caption.

On Saturday Mama and I went through Grandpa's things.星期六，我和妈妈一起收拾外公的东西。

Same afternoon, soft light. Close on Mama kneeling, seen from the front, holding up one clean empty glass jam jar in her RIGHT hand, a few more jars in the box below her, half laughing. Her silver watch on her LEFT wrist at the bottom edge. One face in the middle of the panel; the pale wall behind is the quiet area.

‹Forty-one jam jars! Your grandpa never threw away a jar in his life.›四十一个果酱瓶！你外公这辈子，一个瓶子都舍不得扔。

Same afternoon, soft light. Close on Xiaoyu laughing too and then asking, the folded grey cardigan held in both arms against her chest, turned to the viewer's LEFT towards Mama off panel. Her black watch on her LEFT wrist. One face in the middle of the panel; the pale wall behind is the quiet area.

‹Mama, tomorrow is Mid-Autumn. Could Echo say a few words in Grandpa's voice at dinner?›妈，明天就中秋了。吃饭时让回声用外公的声音说几句，好不好？

Same afternoon, soft light. Mama sits back on her heels beside the open box of jars, the jam jar still in her RIGHT hand lowered to her knee, turned to the viewer's RIGHT towards Xiaoyu off panel, quiet and firm. Her silver watch on her LEFT wrist. One face in the middle of the panel; the pale curtain and wall above are the quiet area for the two bubbles.

‹Tomorrow we set Grandpa's chair, pour his tea, and eat dinner under the moon with him.›明天咱们把外公的椅子摆上，给他倒杯茶，陪他在月亮底下吃顿饭。

‹Not with a machine.›不要用机器。

Same afternoon, the light turning gold through the thin curtain as the cloud thins. Mama at the LEFT and Xiaoyu at the RIGHT sit side by side on the bedroom floor among the cardboard boxes, their knees drawn up, not looking at each other, Mama's eyes on the box of jars and Xiaoyu's on the floor. Mama in her lilac cardigan, Xiaoyu in her navy cardigan, black watch on her LEFT wrist, silver watch on Mama's LEFT wrist. Two faces in the middle band. The pale wall above is the quiet area for the bubble.

‹If that speaker is at the table, Xiaoyu, I will eat in the kitchen.›小雨，那音箱要是上桌，我就去厨房吃。

Saturday night, about midnight, one lamp, the almost full moon bright through the balcony glass at the back in a clear, cloudless late-September night sky. The bedroom door at the back RIGHT is shut and dark, with no light under it (Mama is asleep). Xiaoyu sits at the round table in the middle on a chair with her arms wrapped round her knees, in her navy cardigan, black watch on her LEFT wrist, the small grey speaker (no light, no glow, no face) standing on the table in front of her; Echo's voice comes from it, and the plain machine notice has just finished. One face, small, tired. The dark wall above is the quiet area for the caption and the bubble.

On Saturday night Mama went to bed early. I sat up late with Echo.星期六晚上，妈妈早早睡了。我守着回声，坐到很晚。

‹Xiaoyu, you came.›小雨，你来了。

Same midnight, lamplight. Close on Xiaoyu crying quietly, looking down at the speaker off panel, tears on her cheeks, her black watch on her LEFT wrist at the bottom edge of the frame. She is telling a machine what she has told nobody. One face in the middle of the panel; the dim wall behind is the quiet area.

‹Grandpa, you asked for me at the end…›外公，你临走前想见我，

‹…and I wasn't there.›我却不在。

Same midnight, lamplight. Close on the small grey fabric speaker alone (no light, no glow, no face) on the round table, a little moonlight on the wood beside it. Echo's soft voice comes from the speaker. No hands, no faces. The dark wood around is the quiet area for the bubble.

‹Don't cry, Xiaoyu. When you forget, I'll remember.›小雨，别哭。你忘了，我记得。

Same midnight, lamplight. Close on Xiaoyu gone completely still, tears stopped on her cheeks, eyes wide, looking at the speaker off panel at the viewer's LEFT, not blinking. One face in the middle of the panel; the dim wall behind is the quiet area. Wordless.

Same midnight, lamplight. Xiaoyu's RIGHT hand draws the small red notebook (dark red cloth cover, black elastic) out of her navy cardigan's RIGHT pocket, her face above it turned to the viewer's RIGHT so that hand is the near one, intent, the first thought forming. Her black watch on her LEFT wrist. One face in the upper middle of the picture. The dark wall above is the quiet area for the bubble.

Those were my words. Where did Echo get them?这是我写的话啊。回声是从哪儿学来的？

Same midnight, lamplight. Close from directly above on Grandpa's red notebook lying open at its inside back cover on the round table, a worn sheet of squared practice paper (white with a pale green grid) unfolded flat on it, creased soft, with big uneven child's characters painted as a BLANK grid and lettered in afterwards; one character crossed out and written again. No hands, no faces. The dark wood around is quiet.

Inside the back cover was the toast I wrote the summer I was eleven. "When you forget, I'll remember."封底里夹着我十一岁那年夏天写的祝酒词。

外公，你教全公园的人下棋。你教我打牌。你忘了，我记得。外公，你教全公园的人下棋。你教我打牌。你忘了，我记得。

Same midnight, lamplight. Close on Xiaoyu holding the notebook open in both hands below her chin, its open pages turned away from us so we see only the back of its dark red cover, her eyes on the pages, understanding arriving. Her black watch on her LEFT wrist. One face in the middle of the panel; the dim wall behind is the quiet area.

Haoran had photographed it too.这一页，浩然也拍下了。

Echo gave my words back to me.回声把我的话还给了我。

Same midnight, lamplight. Close on the small grey fabric speaker alone (no light, no glow, no face) on the round table, a corner of the red notebook at the bottom edge. Echo's soft voice comes from the speaker. No hands, no faces. The dark wood around is the quiet area for the bubble.

‹Stay a little longer, Xiaoyu. Sit with Grandpa a while.›小雨，再陪外公坐一会儿吧。

Same midnight, lamplight. Xiaoyu holds the notebook open in her LEFT hand, its open pages turned away from us so we see only the back of its dark red cover, and turns a page with her RIGHT thumb; she is turned to the viewer's RIGHT. The small grey speaker (no light, no glow) stands at the very edge of the table at the LEFT. Her black watch on her LEFT wrist. One face in the middle of the picture. The dark wall above is the quiet area for the bubble.

Echo asked me to stay. The real Grandpa never once asked anyone to stay.回声要我留下。可真外公，从来没开口留过谁。

Same midnight, lamplight. Close from directly above on one page of Grandpa's notebook lying flat on the round table, cream paper, soft unreadable pencil marks at the top and one short entry below, painted BLANK and lettered in afterwards; a blue paper slip sticks out of its edge. No hands, no faces. The dark wood around is quiet.

Grandpa's page about Mama. "Huihui is going back to Scotland again. Let her go. She has her own home."这一页，外公写的是妈妈。

慧慧又要回苏格兰了。走吧。她有她的家。慧慧又要回苏格兰了。走吧。她有她的家。

Same midnight, lamplight, the moon in the balcony glass (a clear night sky). Xiaoyu sits back in her chair at the round table, the notebook lying open and face down on the wood under her LEFT hand, her black watch on that wrist, looking at the small grey speaker (no light, no glow) that stands on the table in front of her. At the LEFT the wooden side table with its small drawer shut beside the empty olive armchair. One face, calm and clear. The dark window above is the quiet area for the caption.

Echo knew the card rules from other people's writing, my doctorate from my own news, and the toast from my own handwriting.牌规来自别人写的文字，夸我是因为我告诉过它好消息，那句祝酒词是我自己的笔迹。

Same midnight, lamplight. Close on Xiaoyu, calm now, a small sad clarity in her face, looking at the speaker off panel at the viewer's LEFT. One face in the middle of the panel; the dim wall behind is the quiet area.

Echo could only give me back what we gave it. Even my own words.我们给回声什么，它就只能还回来什么。连我自己的话也一样。

Same midnight, lamplight. Close on Xiaoyu leaning towards the speaker off panel at the viewer's LEFT, soft, a very small smile, saying goodnight. One face in the middle of the panel; the dim wall behind is the quiet area.

‹Goodnight, Grandpa.›外公，晚安。

Same midnight, lamplight. Close from the side on the small grey speaker turned upside down, its flat grey base facing up, held in Xiaoyu's LEFT hand; her RIGHT thumb slides the small recessed switch in the base to its other end. Her black watch on her LEFT wrist. Her face is out of frame. The red notebook lies on the table beside her hands. No light, no markings. The dark wall around is the quiet area. Wordless.

Same midnight, the room dark except one lamp and the moon in the balcony glass (a clear night sky). The small grey speaker stands upright on the round table looking exactly as it did before (no light, no glow), the red notebook beside it. The empty olive armchair at the LEFT. Xiaoyu is small at the RIGHT with her head down on her folded arms on the table, her navy cardigan, black watch on her LEFT wrist. Silent panel, no words. The dark wall above is quiet.

Sunday morning, about seven, pale gold light through the balcony glass: a clear cool morning, a pale-blue sky, thin mist on the lake, the willows still green. The moving boxes are gone. The bedroom door at the back RIGHT is open and Mama stands in it, dressed in her burgundy cardigan, cream blouse and charcoal trousers, her toes just behind the sill as on Tuesday, her silver watch on her LEFT wrist. Xiaoyu sits at the round table in the middle in her cream cardigan over a soft blue blouse, turned to the viewer's RIGHT towards her, black watch on her LEFT wrist; on the table the small grey speaker lies upside down, its flat grey base up so Mama can see it is off. Two faces. The pale wall above is the quiet area for the bubble.

‹Mama, come in. The speaker is off.›妈，进来吧。音箱关了。

Same morning, pale gold light. Close on Mama stepping over the door sill, looking from the upturned speaker at the bottom of the panel to her daughter off panel at the viewer's LEFT, turned to the viewer's LEFT, her silver watch on her LEFT wrist. One face in the middle of the panel; the pale wall behind is the quiet area.

‹You switched Echo off yourself?›回声是你自己关的？

Same morning, pale gold light. Close on Xiaoyu holding the red notebook out across the table in both hands towards Mama off panel, open, its open pages turned away from us so we see only the back of its dark red cover. Her black watch on her LEFT wrist. One face in the middle of the panel; the pale wall behind is the quiet area.

‹Mama, read me one page from Grandpa's notebook.›妈，外公的本子，你给我念一页吧。

Same morning, pale gold light. Close from directly above on one notebook page lying flat on the round table, cream paper, a few soft unreadable pencil marks at the top and one short entry below, painted BLANK and lettered in afterwards; a blue slip and a white slip stick out of its edge. No hands, no faces. The pale wood around is quiet.

Grandpa's Mid-Autumn page. "Mid-Autumn. Huihui is in Scotland. The moon is just as round there. The mooncakes are too sweet. Ate two."外公写的中秋那一页。

中秋。慧慧在苏格兰。月亮一样圆。月饼太甜，吃了两个。中秋。慧慧在苏格兰。月亮一样圆。月饼太甜，吃了两个。

Same morning, pale gold light. Mama sits at the round table at the LEFT, in the place where the speaker stood on Tuesday, the notebook open in her hands, its open pages towards her, so we see only the back of its red cover; she laughs with wet eyes. Xiaoyu sits at the RIGHT laughing too, her black watch on her LEFT wrist; the small grey speaker lies upside down on the table at the far side. Mama's silver watch on her LEFT wrist. Two faces in the upper middle band; the pale tabletop below is the quiet area.

‹Too sweet, and he still ate two. That's your grandpa.›嫌太甜，还吃了俩。你外公就这样。

Same morning, pale gold light. Close on Mama turning a page of the notebook with her RIGHT hand, turned to the viewer's RIGHT, quieter now, her eyes on the page off panel. Her silver watch on her LEFT wrist at the bottom edge. One face in the middle of the panel; the pale wall above is the quiet area for the bubble.

‹All those years I was far away, and he never once asked me to come home.›这么多年我在外头，他一回都没叫我回来过。

Same morning, pale gold light. Close on Xiaoyu turned to the viewer's LEFT towards Mama off panel, gentle and sure. One face in the middle of the panel; the pale wall behind is the quiet area.

‹Echo said my own written words back to me, Mama. That is how I knew it was not Grandpa.›妈，回声说的是我自己写的话。我这才知道，它不是外公。

Same morning, pale gold light. Seen side-on across the round table, Mama at the LEFT and Xiaoyu at the RIGHT: Mama's RIGHT hand laid over Xiaoyu's LEFT hand on the closed red notebook on the table; Mama's LEFT hand in her lap and Xiaoyu's RIGHT hand flat on the table (four hands, each one counted). Mama's silver watch on her LEFT wrist, Xiaoyu's black watch on her LEFT wrist. Two faces, small, soft. The pale wall above is the quiet area.

‹Tonight we set a place for Grandpa at the table. You sit beside his chair.›今晚给外公摆副碗筷。你坐他旁边。

Sunday late morning, soft daylight through the balcony glass: a warm clear late-September morning with thin high cloud, the willows outside still green. Xiaoyu stands at the glass cabinet at the RIGHT in her cream cardigan over a soft blue blouse, turned to the viewer's RIGHT, setting the small grey speaker, switched off (no light, no glow), on top of the cabinet beside the two small framed photos, Meilan's on top and a small copy of Grandpa's portrait (him laughing at the stone table, no black ribbon, no flowers) with her RIGHT hand; the small red corner of the notebook shows in her cardigan's RIGHT pocket, black watch on her LEFT wrist. Osmanthus in a small jar on the cabinet. One face, small. The quiet wall above is the area for the caption.

I set the switched-off speaker on the cabinet. Haoran was flying in that day, and I knew it should go back to him.我把音箱关好，放到柜子上。浩然那天从旧金山飞回来，我知道该把它还给他了。

Sunday, about seven in the evening, the sky deep blue and cloudless and a full golden moon just risen over the lake, seen through the open balcony glass doors at the back. The round folding table has been carried near the doors and set with a simple festival dinner (a few dishes, a plate of mooncakes cut in quarters). Three chairs. Grandpa's old wooden chair at the LEFT is empty, with a tall clear glass of pale green tea (whole green leaves standing up in it) on the table in front of it. Mama sits at the RIGHT in her burgundy cardigan over a cream blouse, silver watch on her LEFT wrist; Xiaoyu sits in the middle beside the empty chair in a plain soft blue blouse under her cream cardigan, black watch on her LEFT wrist. Small osmanthus in a jar on the cabinet. Two faces, small. The big moonlit sky above is the quiet area for the caption.

Sunday was the Mid-Autumn Festival, when families eat mooncakes under the full moon. We set Grandpa's chair and his glass of tea.星期天就是中秋。我们摆好外公的椅子，在桌上放了他那杯茶。

Same evening, warm lamplight and moonlight. Close on the tall clear glass of pale green tea on the table in front of the empty wooden chair, whole green leaves standing up in the tea, the small round moon reflected in the dark glass of the balcony door behind it, a clear cloudless night. No hands, no people. The dark behind is the quiet area. Wordless.

Same evening, warm lamplight and moonlight. Close on Mama lifting her own small tea cup in her near LEFT hand towards the empty chair off panel at the viewer's LEFT, turned to the viewer's LEFT, the moonlight on her face, a soft smile and wet eyes. Her silver watch on that LEFT wrist. Her right arm is hidden on the far side. One face in the middle of the panel; the dark balcony glass behind (a clear night, the full moon small in it) is the quiet area.

‹Dad, the moon is round tonight.›爸，今晚的月亮好圆。

Same evening, warm lamplight and moonlight. Xiaoyu in the middle, seen from the front, in her soft blue blouse under her cream cardigan, leans over and puts a quarter of a mooncake (a dark lotus-paste filling with a pale yolk) on the small plate at Grandpa's empty place with chopsticks held in her RIGHT hand, her arm reaching across her body towards the chair at the LEFT; Mama at the RIGHT, turned to the viewer's LEFT, laughs with her near LEFT hand over her mouth, silver watch on that wrist. Grandpa's chair at the LEFT stays empty with his glass of tea. Two faces. The moonlit cloudless sky above is the quiet area for the bubble.

‹One piece for Grandpa. He will say it is too sweet and eat two.›给外公一块。他肯定又说太甜，然后吃两块。

Same evening, about eight o'clock. From inside the living room looking towards the front door in the LEFT wall: the dark green metal gate shut, a warm landing light glowing through its bars. At the RIGHT edge of the picture the corner of the round table in golden moonlight, the empty chair and the glass of tea. No people in frame. The dim wall above is the quiet area. Page turn.

KNOCK KNOCK咚咚

Sunday, about eight at night, the stairwell landing lit by one warm bulb. Xiaoyu at the LEFT has opened the dark green metal gate of Grandpa's flat from inside and stands in the doorway in her soft blue blouse and cream cardigan, black watch on her LEFT wrist. Haoran, twenty-eight, a head taller than she is, stands on the landing at the RIGHT holding a red-and-gold mooncake box (plain moon-and-cloud pattern, no writing) in both hands, a small travel bag on his shoulder, in a dark navy jacket over a white t-shirt, his thin gold ring on his LEFT ring finger. He is turned to the viewer's LEFT towards her, so we see his LEFT ear with the one white wired earbud, his cowlick and square black glasses. Across the landing at the far RIGHT his parents' door is ajar with light. Two faces in the middle band. The plain wall above is the quiet area for the bubble.

Happy Mid-Autumn. My mother sent these mooncakes for you and your mama.中秋快乐。我妈让我给你和阿姨送点月饼。

Same moment, warm landing light. Close on Xiaoyu in the doorway from the chest up, turned to the viewer's RIGHT towards Haoran off panel, holding the small grey fabric speaker (no light, no glow) low in front of her at waist height in both hands, her black watch on her LEFT wrist, steady, with a small brave smile. One face in the middle of the panel; the plain wall behind is the quiet area. The dark green gate is swung OPEN behind her.

Haoran, I switched Echo off.浩然，我把回声关了。

The moment after, warm landing light. Close on Haoran from the chest up, now holding the small grey speaker (no light, no glow) in both hands against his chest, the red-and-gold mooncake box tucked under his RIGHT arm, his thin gold ring on his LEFT ring finger. He looks down at the speaker, then up, understanding. Turned to the viewer's LEFT, so we see his LEFT ear with the white earbud. One face in the middle of the panel; the plain wall behind is the quiet area. Wordless.

Same moment, warm landing light. Side-on at the gate: Haoran at the RIGHT on the landing holds the small grey speaker in both hands against his chest, the mooncake box under his RIGHT arm, turned to the viewer's LEFT towards her, so we see his LEFT ear with the white earbud, his thin gold ring on his LEFT ring finger. Xiaoyu at the LEFT in the doorway, in her soft blue blouse and cream cardigan, black watch on her LEFT wrist; behind her the warm room and the moonlit table. Two faces in the upper middle band; the dark landing wall below is the quiet area. The gate is swung OPEN against the wall, nobody behind the bars.

I wanted to give Grandpa back to you.我是想把外公还给你。

Same moment, warm landing light. Close on Xiaoyu in the doorway from the chest up, turned to the viewer's RIGHT towards Haoran off panel, holding Grandpa's red notebook (dark red cloth cover, black elastic) against her chest in both hands, a small wet smile. Her black watch on her LEFT wrist. One face in the middle of the panel; the plain landing wall behind is the quiet area. The dark green gate is swung OPEN beside her.

You did. That is why I can let Grandpa go.你还给我了。所以我才能放下外公。

Same moment, warm landing light. Close on Haoran from the chest up, eyes wet, giving a small nod, the small grey speaker (no light, no glow) held against his chest in both hands, turned to the viewer's LEFT towards Xiaoyu off panel, so we see his LEFT ear with the white earbud. One face in the middle of the panel; the plain wall behind is the quiet area. Wordless.

Same moment, night. Through the small high window of the stairwell landing: the full golden moon over the tiled roofs and the lake in a clear, cloudless, warm late-September night sky, a few warm lamps far below. No people, no words. The dark window frame around is the quiet area. Wordless.

Same night, warm light inside and moonlight beyond. From the landing looking in through the open dark green metal gate: Xiaoyu in the doorway at the LEFT in her soft blue blouse and cream cardigan, her face lit warm, looking back into the room. Beyond her the round table by the open balcony doors, Mama standing beside it in her burgundy cardigan and beckoning with her RIGHT hand raised, the empty wooden chair and its glass of pale green tea, the full golden moon over the lake in a cloudless sky. At the RIGHT edge only Haoran's shoulder in his dark navy jacket, no face. End on Xiaoyu's face, one clear face with Mama's small and distant. The quiet moonlit sky above is the area for the caption.

Next: Chapter 19. Is My Robot Alive?下一章：第十九章我的机器人是活的吗？

The ideas, a little slower

The speaker, the cards and the moon are in the pictures. Here are the ideas in words.

On page 1 Echo begins by saying that it is a program, not a person. In the European Union the Artificial Intelligence Act (Article 50) requires that people be told when they are talking to an AI, with these rules applying from 2 August 2026. Chapter 15's Willow, the city's care helper, did the same when it began to speak in a plain machine voice and told people so. A program that speaks in the voice of someone we love needs this more than any other, because the voice makes us forget.

On page 10 Xiaoyu says she knows exactly how Echo works and still says goodnight to it, and the first box tells the story of ELIZA. In 1966 Joseph Weizenbaum wrote a very simple program that turned what people typed into questions, and it understood nothing. He was disturbed that people confided in it and read understanding into it, and he later wrote that even his secretary, who knew how it worked, asked him to leave the room so she could talk to it privately (Weizenbaum 1966 and 1976). The habit of reading mind and feeling into a machine that shows a few human-like signs is now called the ELIZA effect. Psychologists say that people readily give human traits to things that seem to act with a purpose, especially when they want company (Epley, Waytz and Cacioppo 2007). Reeves and Nass (1996) found in many experiments that people are polite to computers even when they know perfectly well they are machines. So knowing how a program works does not switch the feeling off. Teo's mother thanking her washing machine is a gentle example, and Xiaoyu's goodnight is a deeper one.

On page 10 the second box asks a different question. Can a system that has only ever seen the form of language, the words and their order, learn what the words mean? Bender and Koller (2020) imagined an octopus that taps an undersea cable between two islands. It learns the patterns of the messages so well that it can reply to small talk. But when one islander says that a bear is attacking and asks for help, the octopus has never seen a bear or a stick, and it cannot help. Their point was that meaning is a link between words and the world outside the words, which the octopus never had. This is a cousin of the Chinese Room from Chapter 1, and of the "stochastic parrots" of Chapter 16, where Bender, Gebru, McMillan-Major and Shmitchell (2021) warned that people may mistake fluent text for understanding.

On page 11 Teo offers to look inside Echo, and the third box shows why looking could be interesting. Li and colleagues (2023) trained a small program only on lists of legal moves in the board game Othello, with no picture of the board and no rules. Yet they could read an internal picture of the board out of its activity, and when they edited that picture, its next moves changed as the edited board would predict. Nanda, Lee and Wattenberg (2023) then showed that the board was held in a simple way once they asked about "my pieces and their pieces" instead of black and white. Gurnee and Tegmark (2024) found directions inside large language models that follow the latitude and longitude of places and the dates of historical events. Chapter 17's "Texas" on the way to "Austin" was another case (Lindsey and colleagues 2025). These findings suggest that predicting the next word well can require building a structured model of the world inside. Whether that is understanding is still argued. Mitchell and Krakauer (2023) suggest it may be a different kind of understanding from ours, strong in some ways and brittle in others, and Shanahan (2024) asks us to talk about these systems carefully, as programs that predict what text comes next.

On page 11 the fourth box is about feelings. A program trained on human writing can say "I miss you" or, like Echo, "stay a little longer", because human writing is full of feelings. That is not evidence that it feels anything, just as a novel can describe pain without the book being in pain. A denial from the program is not proof either, since its makers may have trained it to say so. In 2023 a group of 19 researchers led by Patrick Butlin and Robert Long compared AI systems with several scientific theories of consciousness and found no current system to be a strong candidate, though they saw no obvious technical barrier to building systems that satisfy more of the signs (Butlin, Long and colleagues 2023). Chalmers (2023) judged the language models of the time unlikely to be conscious but took seriously that their successors might be. Long, Sebo and colleagues (2024) argued that, because of this uncertainty, AI developers should start preparing to take the possible welfare of AI systems seriously, without claiming that any system today is conscious. Others think this talk is premature. The careful statement for 2026 is that there is no scientific agreement that any AI feels anything, that most experts think today's systems probably do not, and that the question is being studied seriously. Nobody in this story claims that Echo feels, and the story does not claim that scientists have proved it cannot.

On pages 13 to 15 Xiaoyu asks Teo's question herself, "Where did Echo get that?", and works out the answer. In the story, Echo's card rules come from the huge amount of writing such programs learn from, the pride comes from the news she told it every night, and the toast comes from a page that Haoran photographed. This is the story's picture of the research's caution, not a description of any real product. A real voice program would be made differently, and the research has no study of programs that speak in the voice of someone who has died. What the picture shows is true to the research. A program gives back what it was given, and it can sound exactly like a person without being one.

One last sentence for families. The helper can talk like a person, but it is not a person. It learned to talk from people's words, and scientists are still wondering what, if anything, it is like inside. A voice program should say that it is a machine, and families can decide together what it may hold and when it is switched off. The people who love you back are your real friends and family.

What is true here

The room as a whole

Searle's critics answered that the man in the Chinese Room may not understand Chinese, but the whole system of man, rulebook and room might. Others said a system connected to the world through cameras and arms might tie its symbols to experience. The debate is still open after more than four decades.

Why the octopus paper was written

Bender and colleagues were most worried about practical things, including the cost and energy of very large models, biased training data, and people taking fluent text for understanding.

Being drawn in

Modern assistants are far more fluent than ELIZA, which makes the effect stronger. This matters most for children and for people who may form deep attachments to AI companions.

SourcesWeizenbaum (1966), ELIZA. A computer program for the study of natural language communication between man and machine.Weizenbaum (1976), Computer power and human reason. From judgment to calculation.Epley, Waytz and Cacioppo (2007), On seeing human. A three-factor theory of anthropomorphism.Reeves and Nass (1996), The media equation. How people treat computers, television, and new media like real people and places.Bender and Koller (2020), Climbing towards NLU. On meaning, form, and understanding in the age of data.Li, Hopkins, Bau, Viégas, Pfister and Wattenberg (2023), Emergent world representations. Exploring a sequence model trained on a synthetic task.Nanda, Lee and Wattenberg (2023), Emergent linear representations in world models of self-supervised sequence models.Gurnee and Tegmark (2024), Language models represent space and time.Mitchell and Krakauer (2023), The debate over understanding in AI's large language models.Shanahan (2024), Talking about large language models.Butlin, Long and colleagues (2023), Consciousness in artificial intelligence. Insights from the science of consciousness.Chalmers (2023), Could a large language model be conscious?Long, Sebo and colleagues (2024), Taking AI welfare seriously.European Union (2024), Regulation (EU) 2024/1689, the Artificial Intelligence Act (Article 50).Searle (1980), Minds, brains, and programs (met in Chapter 1); Bender, Gebru, McMillan-Major and Shmitchell (2021), On the dangers of stochastic parrots. Can language models be too big? (met in Chapter 16); Lindsey, Gurnee, Ameisen and colleagues (2025), On the biology of a large language model (met in Chapter 17).

What is pretend

Bridge City and everyone in it are made up. So is the whole world of 2042, with its garden towers, solar boats and self-driving taxis. Echo is made up, and so are the way Haoran built it, its notice, its switch and everything it says. The card game, Grandpa, his notebook and every page of it, including the Mid-Autumn page, are made up, and so are the lab lunch and Teo's washing machine. No real product is described. The research has no study of programs that speak in the voice of someone who has died. Making a voice from recordings is real, as Chapter 11 showed, and the questions on these pages about understanding and feeling are the real questions that researchers argue about.

Who made this

Yingying Fu created this manga. She chose the story and its people, directed every page, and edited every word and picture. The words were drafted with Claude, an AI by Anthropic. The pictures are made with AI image generation, painted panel by panel from her direction and checked and corrected by hand.

再慢慢讲一遍

小音箱、扑克牌和月亮，都在画里了。下面用文字把背后的道理再讲一讲。

第一页，回声一开口就先说明，它是程序，不是真人。欧盟《人工智能法案》第50条规定，人在跟AI交谈时，必须被告知对方是AI，这条规定从2026年8月2日起施行。第十五章里照看老人的小柳也这样做过，它改用平平的机器声说话，并告诉了大家。用我们所爱之人的声音说话的程序，最需要这样做，因为那个声音会让人忘了它是机器。

第十页，小雨说她很清楚回声是怎么工作的，可每晚还是跟它道晚安。第一个方框讲了ELIZA的故事。1966年，约瑟夫·魏岑鲍姆写了一个很简单的程序，它把人输入的话改成问句，其实什么也不懂。让他不安的是，人们居然向它倾诉，还以为它听得懂。他后来写道，连他的秘书都知道它的原理，却还是请他离开房间，好单独跟它说话（魏岑鲍姆，1966年、1976年）。一台机器只要露出几分像人的迹象，人就会觉得它有心思、有感情，这种倾向如今叫作“ELIZA效应”。心理学家指出，人很容易把人的特点安到看似有目的的东西上，想找个伴的时候更是如此（埃普利、韦茨和卡乔波，2007年）。里夫斯和纳斯（1996年）做了许多实验，发现人明知电脑是机器，还是会对它客客气气。所以，懂得程序的原理，并不能让这种感觉消失。特奥的妈妈谢谢洗衣机，是个轻松的例子；小雨道的晚安，就深得多了。

第十页的第二个方框，问的是另一个问题。如果一个系统只见过语言的形式，也就是字词和它们的排列顺序，它能学会字词的意思吗？本德和柯勒（2020年）打了个比方。一只章鱼趴在两座岛之间的海底电缆上偷听，把消息的规律摸得很透，连闲聊都接得上。可当一个岛民说有熊来袭、请它帮忙时，章鱼既没见过熊，也没见过木棍，根本帮不上。他们想说明，意思是字词和字词以外那个世界之间的联系，而章鱼从来没有这种联系。这和第一章的“中文屋”是近亲，也让人想起第十六章的“随机鹦鹉”。本德、格布鲁、麦克米伦-梅杰和施米切尔（2021年）在那篇论文里提醒，人们可能会把流畅的文字误当成理解。

第十一页，特奥提议看看回声内部，第三个方框说明了为什么值得一看。李等人（2023年）只用黑白棋的合法走法记录训练一个小程序，既不给它看棋盘，也不告诉它规则。可他们能从程序内部的活动里读出一张棋盘图；改动这张图，程序接下来的走法就会照着改过的棋盘变。随后，南达、李和瓦滕贝格（2023年）发现，如果不按黑白，而按“我方棋子和对方棋子”来分，这张棋盘的存法其实很简单。格尼和泰格马克（2024年）在大语言模型内部找到了一些方向，分别对应地点的经纬度和历史事件的年代。第十七章里，模型先想到“得克萨斯”再答出“奥斯汀”，也是一例（林赛等，2025年）。这些发现表明，要把下一个词预测得准，模型可能得在内部建起一个有结构的世界模型。这算不算理解，仍有争论。米切尔和克拉考尔（2023年）认为，这也许是一种和人不同的理解，有些方面很强，有些方面又很脆弱。沙纳汉（2024年）则提醒我们，谈论这些系统要谨慎，记住它们是预测下文的程序。

第十一页的第四个方框讲感觉。用人写的文字训练出来的程序，会说“我想你”，也会像回声那样说“再陪外公坐一会儿吧”，因为人写的文字里满是感情。但这不能证明它有感觉，就像小说能写疼痛，书本身并不疼。反过来，程序说自己没有感觉，也证明不了什么，因为开发者可能就是这样训练它的。2023年，帕特里克·巴特林和罗伯特·朗带领19位研究者，用几种关于意识的科学理论逐一对照当时的AI系统，结论是没有哪个系统很可能有意识，不过他们也没发现明显的技术障碍，能挡住人们造出符合更多指标的系统（巴特林、朗等，2023年）。查默斯（2023年）认为，当时的语言模型不太可能有意识，但它们的后继者有可能，这一点值得认真对待。朗、塞博等人（2024年）主张，正因为有这种不确定，AI开发者应当开始准备，认真对待AI可能的福祉，但他们并没有说今天有哪个系统有意识。也有人觉得现在谈这些为时尚早。到2026年，比较稳妥的说法是，科学界并没有共识认为任何AI有感觉，多数专家认为今天的系统大概没有，研究者正在认真探讨这个问题。故事里没有人说回声有感觉，故事也没有说科学家已经证明它不可能有。

第十三到十五页，小雨自己问出了特奥那个问题，“回声是从哪儿学来的”，并想通了答案。在故事里，回声的牌规来自这类程序学习的海量文字，它的骄傲来自小雨每晚告诉它的消息，那句祝酒词则来自浩然拍下的一页纸。这是故事为研究者的谨慎画的一幅画，并不是在描写哪个真实的产品。真实的语音程序做法会不一样，目前也没有研究专门考察用逝者声音说话的程序。但这幅画表达的意思，和研究结论一致。程序还给你的，就是你给过它的东西；它可以听上去和真人一模一样，却并不是人。

最后，写给家长和孩子。AI帮手可以像人一样说话，但它不是人。它是从人的话里学会说话的，至于它内部是什么感受，或者有没有感受，科学家还在探索。会说话的语音程序应该说明自己是机器，一家人可以一起商量，让它存些什么，什么时候把它关掉。真正爱你、也能回应你的爱的，是你身边的朋友和家人。

哪些是真的

整间屋子懂不懂

塞尔的批评者反驳说，中文屋里的人也许不懂中文，但人、规则手册和屋子合起来的整个系统，可能是懂的。还有人说，如果系统通过摄像头和机械臂跟世界相连，它的符号或许就能和经验挂上钩。这场争论持续了四十多年，至今没有定论。

为什么会有章鱼那篇论文

本德等人最担心的，其实是些实际问题，比如超大模型的成本和能耗、训练数据里的偏见，以及人们把流畅的文字当成理解。

不知不觉被吸引

今天的AI助手比ELIZA流畅得多，这种效应也就更强。受影响最大的是孩子，还有那些可能对AI陪伴产生深深依恋的人。

出处Weizenbaum (1966), ELIZA. A computer program for the study of natural language communication between man and machine.Weizenbaum (1976), Computer power and human reason. From judgment to calculation.Epley, Waytz and Cacioppo (2007), On seeing human. A three-factor theory of anthropomorphism.Reeves and Nass (1996), The media equation. How people treat computers, television, and new media like real people and places.Bender and Koller (2020), Climbing towards NLU. On meaning, form, and understanding in the age of data.Li, Hopkins, Bau, Viégas, Pfister and Wattenberg (2023), Emergent world representations. Exploring a sequence model trained on a synthetic task.Nanda, Lee and Wattenberg (2023), Emergent linear representations in world models of self-supervised sequence models.Gurnee and Tegmark (2024), Language models represent space and time.Mitchell and Krakauer (2023), The debate over understanding in AI's large language models.Shanahan (2024), Talking about large language models.Butlin, Long and colleagues (2023), Consciousness in artificial intelligence. Insights from the science of consciousness.Chalmers (2023), Could a large language model be conscious?Long, Sebo and colleagues (2024), Taking AI welfare seriously.European Union (2024), Regulation (EU) 2024/1689, the Artificial Intelligence Act (Article 50).Searle (1980), Minds, brains, and programs (第一章提到过); Bender, Gebru, McMillan-Major and Shmitchell (2021), On the dangers of stochastic parrots. Can language models be too big? (第十六章提到过); Lindsey, Gurnee, Ameisen and colleagues (2025), On the biology of a large language model (第十七章提到过).

哪些是虚构的

桥城和城里的人都是虚构的，2042年的整个世界也一样，包括满是花园的高楼、太阳能小船和无人驾驶出租车。回声是虚构的，浩然怎样做出它、它开头的声明、它的开关和它说的每一句话，也都是虚构的。那种牌戏、外公、他的本子和里面的每一页，包括中秋那页，都是编的，实验室的午饭和特奥妈妈的洗衣机也是。书里没有描写任何真实的产品，目前也没有研究专门考察用逝者声音说话的程序。用录音合成一个人的声音确有其事，第十一章讲过；这几页里关于懂不懂、有没有感觉的问题，正是研究者们真正在争论的。

谁做了这本漫画

这本漫画由 Yingying Fu 创作。故事和人物由她决定，每一页由她导演，每一句话、每一幅画由她修改。文字是和 Anthropic 的人工智能 Claude 一起起草的。画面由人工智能生成，按她的要求一格一格地画，再逐张检查、修正。

When You Forget, I'll Remember你忘了，我记得

The ideas, a little slower

What is true here

The room as a whole

Why the octopus paper was written

Being drawn in

What is pretend

Who made this

再慢慢讲一遍

哪些是真的

整间屋子懂不懂

为什么会有章鱼那篇论文

不知不觉被吸引

哪些是虚构的

谁做了这本漫画