Skip to main content

Voice & Lip-Sync in Dream Engine

How to Generate realistic Voiceover and create lip-synced videos where characters speak your script in Dream Engine

Updated yesterday

Voice & Lip-Sync

Generate realistic voiceovers and create lip-synced videos where characters speak your script with perfect mouth movements.

πŸŽ™οΈ Pro Feature: Voice & Lip-Sync requires a Pro or Studio subscription plan.

Overview

This feature combines text-to-speech AI with video lip-sync technology to create talking character videos. Choose from dozens of professional voices powered by DreamLabs and let the AI handle perfect lip synchronization.

The Voice & Lip-Sync Editor Interface

Here's what the Voice & Lip-Sync editor looks like and how each element works:

A screenshot of a video

AI-generated content may be incorrect.

A screenshot of a computer

AI-generated content may be incorrect.

Understanding the Interface

Video Preview

Displays your selected video that will receive lip-sync animation. The video player shows the current frame and includes basic playback controls. You can remove and replace the video at any time using the "Remove Video" button.

Audio Section

Shows the current audio status. You can either generate audio using text-to-speech or upload your own audio file. Once audio is added, this section displays a waveform visualization and playback controls.

Text to Speech Tab

Generate professional voiceovers using AI. Select from dozens of voices, enter your script, and the AI creates natural-sounding speech perfectly synced to your video.

  • Choose from 50+ professional voices

  • Filter by gender and characteristics

  • Preview voices before selecting

  • Real-time character and duration counting

Upload Audio Tab

Use your own pre-recorded audio files for lip-syncing. Perfect for using professional voice actors, existing recordings, or custom audio productions. Supports MP3, WAV, and other common audio formats.

Voice Selection

Browse and preview available voices using the grid layout:

  • Gender Filters: Quickly filter voices by Male, Female, Other, or view All

  • Play Button: Click the play icon on any voice card to hear a sample

  • Voice Names: Each voice includes descriptive characteristics in its name

Create Lip-Sync Video Button

Once you've selected a video, chosen a voice, and entered your text, click this button to generate your lip-synced video. Processing typically takes 1-3 minutes depending on video length.

⚑ Requirements: Make sure you have a video selected, audio generated or uploaded, and sufficient tokens before generating.

Getting Started

1. Select or Upload a Video

Choose a video clip with a visible face/character. Best results come from:

  • Clear, frontal view of the face

  • Good lighting and resolution

  • Minimal head movement

  • 5-30 seconds in length

2. Write Your Script

Enter the text you want the character to speak. The AI will:

  • Generate natural-sounding speech

  • Match lip movements to the audio

  • Preserve the original video quality

3. Choose a Voice

Select from our library of professional voices powered by DreamLabs:

  • Male voices: Various ages, accents, and tones

  • Female voices: Diverse range of characteristics

  • Character voices: Unique personalities and styles

4. Generate

Click generate and wait 1-3 minutes. The AI will produce a video with perfect lip-sync and audio.

Voice Selection

Voice Categories

Voices are organized by type:

  • Narration: Clear, authoritative voices for voiceovers

  • Conversational: Natural, friendly voices for dialogue

  • Character: Unique personalities for creative projects

  • Professional: Corporate and business-appropriate voices

Voice Attributes

Filter voices by:

  • Gender: Male, Female, Neutral

  • Age: Young, Middle-aged, Mature

  • Accent: American, British, Australian, etc.

  • Tone: Warm, Professional, Energetic, Calm

Preview Voices

Click the play button on any voice card to hear a sample before selecting.

Script Writing Tips

Natural Speech

  • Write how people actually talk

  • Use contractions (don't, can't, won't)

  • Include natural pauses with commas

  • Vary sentence length

Pronunciation

  • Use phonetic spelling for difficult words

  • Add periods for longer pauses

  • Use ALL CAPS sparingly for emphasis

Timing

  • Keep scripts under 300 characters for best results

  • Match script length to video duration

  • Leave room for natural pacing

Pro Tip: Read your script aloud before generating. If it sounds natural when you speak it, it will sound natural with AI voice.

Lip-Sync Quality

Factors Affecting Quality

  • Video Quality: Higher resolution = better sync

  • Face Visibility: Clear, unobstructed faces work best

  • Lighting: Well-lit faces improve accuracy

  • Head Position: Frontal angles are optimal

Supported Video Types

  • Real person videos

  • 3D animated characters

  • 2D illustrated characters

  • AI-generated character videos

Advanced Features

Voice Customization

  • Speed: Adjust speaking rate (0.5x to 2x)

  • Pitch: Make voice higher or lower

  • Emphasis: Highlight specific words

Multi-Character Dialogue

Create conversations by:

  1. Generate voice for first character

  2. Use video editing to combine clips

  3. Alternate between different voices

Translation

Make your character speak different languages:

  • Write script in target language

  • Select voice with appropriate accent

  • Generate lip-sync for international content

Export Options

Audio Only

Download just the voice audio as:

  • MP3 - For podcasts, audiobooks

  • WAV - For professional audio editing

Video with Audio

Complete lip-synced video as:

  • MP4 - Standard video format

  • Original resolution preserved

  • Audio perfectly synchronized

Common Use Cases

Content Creation

  • YouTube videos with character narration

  • Educational content with animated teachers

  • Social media videos with branded characters

Marketing

  • Product demonstrations with spokesperson

  • Explainer videos

  • Video ads with custom voiceovers

Entertainment

  • Animated shorts

  • Character-driven stories

  • Meme videos with custom dialogue

Localization

  • Translate content to multiple languages

  • Create region-specific versions

  • Dubbing for international audiences

Troubleshooting

Lip-Sync Not Matching

Solution: Ensure face is clearly visible and well-lit. Use frontal face angles. Check video resolution.

Voice Sounds Robotic

Solution: Add punctuation for natural pacing. Use contractions. Try different voice selections.

Audio Quality Issues

Solution: Check source video audio. Ensure proper export settings. Try re-generating with different voice.

Processing Takes Too Long

Solution: Video length affects processing time. Break longer scripts into shorter segments.

Best Practices

  • Test voices with short scripts before committing to long projects

  • Use high-quality source videos for best lip-sync results

  • Write natural, conversational scripts

  • Match voice personality to character/brand

  • Keep videos under 30 seconds for optimal quality

  • Review and iterate - generate multiple versions if needed

  • Combine with video animation for dynamic results

Did this answer your question?