Prism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training

Shuyuan Tu¹ Qi Tian² Yinming Huang¹ Yue Wu²

Xintong Han² Kaihang Pan³ Weijie Kong² Jiangfeng Xiong²

Jian-Wei Zhang² Zuxuan Wu¹ Yu-Gang Jiang¹

¹Fudan University ²Hunyuan Foundation Model Team, Tencent Inc ³Zhejiang University

PDFPaper GHCode YTYouTube HFModel

Demo Video

Watch in HD on YouTube ↗

Synthesized Results

Please turn on your audio.

Case 01

Ours Ours

Case 02

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>rhythmic percussive drum beats and faint outdoor street traffic ambience</sfx>. Eye-level tracking shot behind a traffic police officer on a sunlit city street. The Black male officer, dressed in a crisp white uniform, peaked cap, and a green-yellow-blue striped belt, energetically directs a long queue of white cars. He raises his right hand to signal vehicles, then bends low into a dynamic, dance-like lunge while sweeping his arms forward. Deep rhythmic male vocalizations accompany his stylized movements: <speech>hm, ooh, ah, ha-ya</speech>. In the background, pedestrians walk along the roadside sidewalk past multi-story urban buildings and trees under clear daylight.

Case 03

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>ambient store sounds, including people talking and footsteps</sfx> throughout. Medium close-up, eye-level view. Inside an indoor store with bright lighting. The main focus is a man and a woman conversing. On the left side of the frame is a young-to-middle-aged white woman wearing glasses, with brown wavy medium-short hair, wearing a black jacket and a dark red inner layer, holding a dark-colored wine bottle with a black label featuring gold English text. On the right side is a middle-aged white man with a beard, receding hairline, wearing a gray plaid suit jacket and a light blue shirt, holding a green wine bottle with a white label featuring a minimalist black line pattern and text. Behind them are shelves filled with products, with multiple customers and staff walking and shopping in the background, and a row of track spotlights on the ceiling. Initially, the man in the gray suit holds up the green wine bottle, looking at the woman across from him. Then he dramatically widens his eyes, showing the bottle to her, enthusiastically saying <speech>And the second one that we have a wine.</speech>. The woman lowers her head, looking at her own dark-colored bottle, smiling. Immediately afterward, the woman in the black jacket looks up at the man, asking curiously <speech>They are also do a wine?</speech>. The man nods affirmatively, saying <speech>Yep.</speech>. The man then raises his left hand in a gesture of explanation, continuing to speak <speech>So when you don't know it, you're kind of afraid because maple.</speech>

Case 04

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>outdoor woodland ambience, footsteps on dirt, and clear speech</sfx>. Eye-level wide shot on a dirt trail in a forest with tall pine trees. In the background, a vintage red fire truck and parked SUVs stand near the trees. Beside a miniature red off-road vehicle containing a helmet, a man with long hair remarks: <speech>All right. Well, that's enough for me.</speech>. A bearded man in a black hoodie and grey pants turns, walks toward the camera, gestures with open arms, and crosses his arms while explaining: <speech>I had to roll it because we've all, you know, we've all now rolled it, except Stephen, when he clean clothes, which is basically the same thing as rolling for Stephen.</speech>, followed by an off-camera response: <speech>Yeah.</speech>.

Case 05

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>cutlery clinking and scraping gently against a ceramic plate</sfx>. Extreme close-up shot of a plated gourmet lobster dish on a dark-grey plate over a wooden table. A perfectly seared lobster medallion topped with a generous mound of black caviar and resting in a pool of orange seafood bisque is gently sliced and separated with a silver fork and knife, revealing the flaky white meat inside. A casual conversation in English and Malayalam plays over the action: <speech>Oh, delicate as...</speech> <speech>Mmm.</speech> <speech>കുറഞ്ഞു നാശമായി.</speech> <speech>That's right.</speech> <speech>Okay.</speech> <speech>അത് ആദ്യം തന്നെ പറഞ്ഞതാ.</speech> <speech>Okay, there we go.</speech>.

Case 06

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>low engine rumble and tire friction</sfx>, clear audio with no noticeable reverb. Eye-level medium shot inside a moving car. A middle-aged white man with a short beard, wearing a blue sweater over a light-blue striped shirt and a seatbelt, drives smoothly on an overcast highway. The black interior features white stitching and a panoramic sunroof. He gestures with his right hand while speaking in Portuguese: <speech>Como nós sabemos, uma coisa são os valores anunciados pelas marcas, outras são os valores que nós conseguimos aqui em conditions reais.</speech>. He then places both hands on the wheel and continues: <speech>ainda só com o iste C40 durante cerca de 80 quilômetros.</speech>. Industrial buildings, bridges, and marked shipping containers pass outside.

Case 07

Ours Ours

Case 08

Ours Ours

Text Prompt Scroll to read

<music>An upbeat pop/R&B track</music> plays continuously with a female off-screen vocal: <lyrics>I can feel the rhythm down to my toes, yeah, I can see the party is jump—</lyrics>. Elevated daytime tracking shot outside an urban restaurant with outdoor patio seating and string lights under a wooden pergola. Pedestrians walk along the sidewalk while patrons sit at outdoor tables. A stylish Black man in a green patterned shirt exits the glass door smiling, leading out two young Black women—one wearing a lime-green outfit with a colorful floral robe and sunglasses, and another in a white lace dress. As they step onto the sidewalk, the camera pans right to reveal a brand-new light-blue vehicle adorned with a large red gift bow on its hood. The women react with astonished smiles as everyone enthusiastically shouts: <speech>Surprise!</speech>, followed by <sfx>cheerful laughter</sfx>.

Case 09

Ours Ours

Text Prompt Scroll to read

<music>Whimsical orchestral underscoring</music> plays alongside a deep male comedic singing voice: <speech>I must fix all our voices before the big show. So switch them all back to where they should go!</speech>, accompanied by <sfx>magical twinkling wand chimes</sfx> and a playful <sfx>giggle</sfx>. Low-angle tracking shot inside a colorful animated room with light-blue walls, wooden ceiling beams, and a framed portrait of bear characters. A chubby animated fairy with purple hair, butterfly wings, and a voluminous green dress floats gracefully mid-air. She waves a star-tipped magic wand, creating swirling golden sparkles as she twirls in flight, swoops downward, points her wand with determination, and bobs happily in place.

Case 10

Ours Ours

Text Prompt Scroll to read

No background music; quiet indoor recording with slight room reverb. Eye-level medium shot in a softly lit living room. A middle-aged white woman with short curly dark hair, wearing a yellow V-neck dress, necklace, earrings, and rings, stands near a white sofa and framed botanical artwork, with a bookshelf, floor lamp, and leather chair behind her. The camera slowly pans left and slightly zooms in. She starts with her hands clasped, then speaks warmly: <speech>Because I feel like this get really softens the room a lot.</speech>, opening both hands gently. She turns right, gestures toward the wall art, and continues: <speech>And there was just a lot of blank wall here. We had one piece over the sofa, but then.</speech>

Case 11

Ours Ours

Case 12

Ours Ours

Case 13

Ours Ours

Case 14

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>noisy outdoor restaurant ambience with conversations and utensil clinking</sfx>. Eye-level medium close-up. A young white woman with brown hair, round gold-rimmed sunglasses, a nose ring, and a black striped T-shirt sits at an outdoor restaurant surrounded by tables and green umbrellas. She gestures while saying, <speech>Yeah, I would say so. I'm really enjoying the fresh herbs in here. It's lightening it up in a way that I just didn't anticipate.</speech>. She then smiles, raises a patterned beer glass to her lips, and takes a small sip, but does not actually drink any beer. She lowers the glass and sets it down. She continues <speech>Well, cheers to that and a fantastic final meal.</speech>. She looks down at her plate, then back at the camera with a smile.

Case 15

Ours Ours

Case 16

Ours Ours

Text Prompt Scroll to read

Natural close-range audio with low background noise and no noticeable reverb. Handheld selfie close-up, slightly low-angle view on a narrow dirt path through a lush temperate rainforest covered in moss and ferns. A young white man with a short beard wears a blue T-shirt, black backpack, and black mesh cap with reflective sunglasses tucked into the brim and a small chest microphone. The frame gently shakes as he walks. He looks at the camera and says admiringly, <speech>How magical this bit of the forest is, though.</speech>, then glances around, smiles, and sweeps his left arm toward the forest while saying excitedly, <speech>It's unreal. Look at this!</speech>. He lowers his arm, looks left again, grinning in awe, and says <speech>Crazy.</speech>.

Case 17

Ours Ours

Case 18

Ours Ours

Case 19

Ours Ours

Case 20

Ours Ours

Case 21

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>hip-hop background music with rhythmic beats and vocal samples playing over store speakers</sfx>. Medium interior shot of a vintage streetwear and sneaker store. In the foreground, a customer browses a clothing rack out of focus. A young man wearing a light-blue plaid button-down shirt and shorts walks into the frame, followed by a friend in a dark green jacket with curly hair. They look around at rows of vintage t-shirts, hanging retro sports jerseys, and a large wall display of colorful sneakers. The young man in plaid turns and speaks: <speech>Yeah, me and my family go to some Seahawks games every once in a while, but...</speech>. He looks around in awe and continues: <speech>This place is awesome though. You guys come here a...</speech>.

Case 22

Ours Ours

Case 23

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>electronic house dance track with a four-on-the-floor kick, synth stabs, rhythmic percussion, and recurring vocal chops</sfx>. Eye-level medium shot of an outdoor DJ booth set up during golden hour. In the foreground, professional audio gear including Pioneer DJ consoles, studio monitors, a camera rig, and a drink glass sit on the table. A woman in a white halter top and sunglasses dances energetically with raised arms and claps, while a male DJ wearing futuristic shades, headphones, and a white shirt bobs and claps along to the beat. In the background, a massive golden sand dune with distant people along the ridgeline stands adjacent to city skyline buildings under a clear sky as a small drone flies past.

Case 24

Ours Ours

Case 25

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>gentle acoustic guitar strumming and subtle ambient wind noise from a moving open-top vehicle</sfx>. An off-screen acoustic track features a soft female voice singing: <lyrics>You know it's true</lyrics>. Medium interior side-profile shot of a young couple riding in an open-air vehicle on a sunny day. The young man drives happily with one hand on the steering wheel, smiling as he glances at his partner and sings aloud: <speech>I don't have to tell you, I love you.</speech>. Beside him, a young woman with wavy red hair in a burgundy top brushes her hair back and gazes affectionately at him under warm afternoon sunlight, with green roadside trees passing in the background.

Model Comparisons

Please turn on your audio.

Case 01

Ovi

LTX-2.3

MOVA

MagiHuman

Ours Ours

Text Prompt Scroll to read

Continuous <sfx>cheerful cell phone ringtone</sfx>, followed by <sfx>sci-fi laser beam blast and fiery sizzling sound effects</sfx>. Eye-level medium shot in a vibrant classroom with wooden cabinets and colorful circle decals. A group of kids and adults sit crowded on a blue couch: a girl in a shark onesie on the left, a girl in a pink tank top, a blonde boy in a blue t-shirt, a little girl in a red dress on the right, and several adults and older children sitting behind them. As a phone rings loudly off-camera, the girl in a shark onesie says: <speech>We can do a lot of things.</speech>. The girl in the pink tank top turns to the side and complains: <speech>Britney, did you forget to turn your phone off?</speech>. The woman seated in the back points forward off-camera and replies: <speech>I think it's the guy in the second row.</speech>. A hand enters the lower-right foreground holding a ringing smartphone showing an incoming call from "Fuzz Muffin" with a cat picture. The blonde boy in the blue shirt smiles mischievously and says: <speech>He should know I could do this.</speech>. Suddenly, his eyes illuminate with glowing red light and fire powerful crimson laser beams directly at the phone, causing explosive sparks, smoke, and flames to erupt.

Case 02

Ovi

LTX-2.3

MOVA

MagiHuman

Ours Ours

Text Prompt Scroll to read

<sfx>Mountain bike on a forest trail with tire friction, chain, and suspension sounds</sfx>. Daytime. An eye-level wide shot shows a young rider in black gear with a blue helmet descending a narrow forest trail on a black mountain bike. The dirt path is covered with roots and rocks, bordered by mossy slopes and tall pine trees. The camera follows from behind. From 2.0s onward, a yellow warning sign with black rockfall symbol and German text <text>Ausfahrt</text> remains on the right. The rider carefully rolls over the rough terrain with <sfx>bumpy tire sounds over roots and rocks</sfx>, steering right then left. The camera suddenly pans left with strong motion blur as he speeds through a left turn, revealing a green T-shirt. After stabilizing, it follows him along a wider forest road

Case 03

Ovi

LTX-2.3

MOVA

MagiHuman

Ours Ours

Text Prompt Scroll to read

Continuous <music>epic orchestral music with deep synths, strings, and percussion</music>. Overhead wide-to-full shot of a vast granite ridge bordered by dense forests beneath a blue sky with white clouds. A wooden rope barrier and a dead tree stand on the summit. The camera glides forward above the ridge, tilting downward. A man in a beige long-sleeve shirt, red pants, and dark boots appears at the ridge's edge, holding a white rectangular container. The camera rapidly accelerates, rotating right as it closes in. The man walks along the ridge, passing the right side of the frame, while the camera skims the rock surface at high speed with strong motion blur. The camera flies low over the mountaintop, following the ridgeline downhill with gentle side-to-side sways, revealing a vast forest stretching ahead.

Case 04

Ovi

LTX-2.3

MOVA

MagiHuman

Ours Ours

Case 05

Ovi

LTX-2.3

MOVA

MagiHuman

Ours Ours

Case 06

Kling3

MinMaxH3

Wan3.0

Seedance-2.5

Ours Ours

Text Prompt Scroll to read

A cinematic medium side-profile shot featuring a soldier taking cover against a stone corner in the left foreground, set against a fiery warzone with smoke and orange tracer rounds in the right background. The sequence starts in dramatic slow motion for 2 seconds as stone debris explodes near his head while he flinches with his rifle held diagonally, then speed-ramps to normal combat speed as he raises the muzzle against his chest, slaps a box magazine from his waist pouch into the rifle, and racks the bolt. Upon loading, he turns his head to gaze tensely toward the upper-left while bracing against the wall, captured with falling snow, striking blue-orange contrast lighting, volumetric dust, and photorealistic CGI realism.

Case 07

Kling3

MinMaxH3

Wan3.0

Seedance-2.5

Ours Ours

Text Prompt Scroll to read

A smooth broadcast-style wide tracking shot of an indoor high school basketball game. A guard in a white jersey (#0) executes a give-and-go with teammate #2 on the sideline, sizes up defender #1 in black at the top of the key with a sharp between-the-legs crossover dribble, and delivers a chest pass to teammate #15, who pops out from the high post to the open right 3-point wing. White #15 catches and rises into a contested 3-point jump shot that bounces high off the rim, prompting multiple interior players (including Black #15 and White #3) to leap and reach for the ball in mid-air as they contest the rebound, with the camera panning seamlessly from perimeter to rim in photorealistic high definition. A white cursive watermark reading "COZY" is prominently positioned at the top center of the frame throughout the video.