Avatar Video With Animated SFX Intro

I want to add a task that will generate a short 1 minute video of a talking head avatar reading out a promotional script, preceded by some animated video with sound effects. The video will begin with a short animation related to the script, with sound effects, and then the main video will begin with the talking head. Here's how it will work... first user inputs information about the video they want, and hits go. Next, GPT4 writes a short 800-1200 character script. Next, we turn the script into a voice-over mp3. Then we browse from a collection of "talking head images" and choose the one that is most relevant to our script (I will give the agent a folder URL containing images for it to choose from). Now we pass the selected talking-head.jpg image, along with the mp3 voice, to the talking head task which makes our video. Now we need to make our animated intro video. To do this we should generate an animated video. Next we generate our sound effects. Finally, we take the animated video, sound effect file and talking head video and combine them into a timeline to make our final video.

First, pre-entered info...

final-output2

The final output of this automated workflow would be a short promotional video in MP4 format, approximately 1 minute in length. The video will consist of two main parts: 1. An animated intro (approx. 3-6 seconds) with relevant sound effects 2. A talking head avatar video (approx. 45-50 seconds) lip-syncing a promotional script These two parts will be combined into a single MP4 video file, stitched together in a timeline.

subagent-summary-amended-for-actual-tasks

A) SUBAGENT SUMMARY: This subagent generates a short animated intro video based on the promotional script. B) FINAL TASK OUTPUT: The final output will be a 5-second animated intro video in MP4 format, saved on the server with both internal and external URLs provided. C) SUBAGENT INPUT: The generated promotional script from Subagent 1. E) SUBAGENT TASK SUMMARY: 1. Script input > #182 - Research Topic (Or Keyword) Lightly > Output: 300 characters of text summarizing the main points of the script to inform the intro animation. 2. Script input + Research output > #178 - Rewrite Text Based On Instructions > Output: A concise 10-50 word text prompt tailored for generating an intro animation. 3. Animation prompt > #194 - Make Short Animated Video From Text Prompt > Output: A 5-second animated intro video saved as an MP4 file, with internal and external URLs provided. F) SILOS: This subagent does not require silos as it follows a linear sequence of skills to generate the final output.

subagentnumber

OVERVIEW OF SUBAGENTS: SUBAGENT 1: Script Generator - Skill Used: #178 - Rewrite Text Based On Instructions - Description: This skill uses a LLM (typically GPT4) to generate a short promotional script based on user input and instructions. - Input Needed: Structured user input data from the user interface - Output: A text file containing a 120-180 word generated promotional script - SUBAGENT FINAL OUTPUT: [generated-promo-script] SUBAGENT 2: Voice-over Creator - Skill Used: #187 - Turn Script Into Voice Over MP3 - Description: This skill accepts a text script and converts it to an MP3 voice-over file. - Input Needed: Text script from Subagent 1 - Output: MP3 File URL with both internal and external link - SUBAGENT FINAL OUTPUT: [script-voiceover-mp3] SUBAGENT 3: Talking Head Video Generator - Skill Used: #219 - Generate Talking Head Video From MP3 - Description: This skill will input an MP3 and generate a "talking head" video of an AI avatar lip-syncing the audio. - Input Needed: Voice-over MP3 URL from Subagent 2 - Output: URL of the talking head avatar MP4 video - SUBAGENT FINAL OUTPUT: [talking-head-video] SUBAGENT 4: Intro Animator - Skill Used: #194 - Make Short Animated Video From Text Prompt - Description: This skill will return a short 5 second AI-generated animation video based on a given prompt derived from the script. - Input Needed: The generated script from Subagent 1 - Output: MP4 URL of the animated intro video with both internal and external link - SUBAGENT FINAL OUTPUT: [animated-intro-video] SUBAGENT 5: Video Stitcher - Skill Used: #207 - Concatenate Videos (Combine 2-10 MP4s) - Description: This skill stitches and concatenates multiple MP4s into one single video file. - Input Needed: Animated intro MP4 URL from Subagent 4, and talking head avatar MP4 URL from Subagent 3 - Output: The final composed MP4 video URL with both internal and external link - SUBAGENT FINAL OUTPUT: [final-promo-video] SUBAGENT #6: Video Outputter - Skill Used: #215 - Summarise and Return All Final Output Files - Description: This skill returns the final video file along with the individual MP4s of the animated intro and avatar. - Input Needed: Animated intro MP4 URL from Subagent 4, and talking head avatar MP4 URL from Subagent 3 - Output: simple text summary of the links - SUBAGENT FINAL OUTPUT: [video-links] SUBAGENT SEQUENCE: 1. Script Generator 2. Voice-over Creator 3. Talking Head Video Generator 4. Intro Animator 5. Video Stitcher 6. Video Outputter

Then, agent response...

subagent1refined-new-json-core

G) TASKFLOW SUMMARY - ID: #182 - Title task: Research Topic (Or Keyword) Lightly - Description of the task: Perform a brief research on the main points of the promotional script to inform the intro animation, generating a 300-character summary. - Input(s) involved: [generated promotional script from Subagent 1] - Output token name: [research output summary] - ID: #178 - Title task: Rewrite Text Based On Instructions - Description of the task: Generate a concise 10-50 word text prompt tailored for creating an intro animation, based on the script input and research output. - Input(s) involved: [generated promotional script from Subagent 1], [research output summary] - Output token name: [animation prompt] - ID: #194 - Title task: Make Short Animated Video From Text Prompt - Description of the task: Create a 5-second animated intro video in MP4 format based on the provided animation prompt, saving the file on the server with both internal and external URLs. - Input(s) involved: [animation prompt] - Output token name: [animated intro video MP4], [internal URL], [external URL]

subagent1mermaid

<!DOCTYPE html> <html> <head> <title>Mermaid Diagram Example</title> <script src="https://cdnjs.cloudflare.com/ajax/libs/mermaid/9.4.3/mermaid.min.js"></script> </head> <body> <div class="mermaid"> graph TD A[Promotional Script] --> B{#182 - Research Topic Lightly} B --> C[Research Output Summary] A --> D{#178 - Rewrite Text Based On Instructions} C --> D D --> E[Animation Prompt] E --> F{#194 - Make Short Animated Video From Text Prompt} F --> G[Animated Intro Video MP4] F --> H[Internal URL] F --> I[External URL] </div> <script> mermaid.initialize({ startOnLoad: true }); </script> </body> </html>

Mermaid Image - https://static.aiz.ac/1720296502-mermaid/mermaid1.png

prompts-required

ID #: 182 Task: Research Topic (Or Keyword) Lightly Output of the task/skill: A 300-character summary of the main points of the promotional script to inform the intro animation. Description: Please analyze the provided promotional script and generate a concise 300-character summary highlighting the key points, themes, or ideas that could be effectively conveyed through a short animated intro video. Focus on the most essential and visually engaging aspects of the script. ID #: 178 Task: Rewrite Text Based On Instructions Output of the task/skill: A 10-50 word text prompt tailored for generating an intro animation based on the script and research summary. Description: Using the provided promotional script and the 300-character research summary, please create a concise and engaging 10-50 word text prompt designed to guide the creation of a compelling 5-second animated intro video. The prompt should capture the key themes, ideas, or visuals that will effectively introduce and set the tone for the main promotional video content. ID #: 194 Task: Make Short Animated Video From Text Prompt Output of the task/skill: A 5-second animated intro video in MP4 format, saved on the server with internal and external URLs. Description: No prompt required for this skill as it involves generating an animated video directly from the provided text prompt using a separate tool or API.

subagent1-json-array

[ { "taskID": 182, "semanticTitleOfTask": "Research Topic (Or Keyword) Lightly", "taskDescription": "Perform a brief research on the main points of the promotional script to inform the intro animation, generating a 300-character summary.", "inputDescription": "The generated promotional script from Subagent 1.", "inputRequired": ["generated-promotional-script"], "outputDescription": "A 300-character summary of the main points of the promotional script to inform the intro animation.", "outputName": "research-output-summary", "promptInstruction": "Please analyze the provided promotional script and generate a concise 300-character summary highlighting the key points, themes, or ideas that could be effectively conveyed through a short animated intro video. Focus on the most essential and visually engaging aspects of the script." }, { "taskID": 178, "semanticTitleOfTask": "Rewrite Text Based On Instructions", "taskDescription": "Generate a concise 10-50 word text prompt tailored for creating an intro animation, based on the script input and research output.", "inputDescription": "The generated promotional script from Subagent 1 and the 300-character research output summary.", "inputRequired": ["generated-promotional-script", "research-output-summary"], "outputDescription": "A 10-50 word text prompt tailored for generating an intro animation based on the script and research summary.", "outputName": "animation-prompt", "promptInstruction": "Using the provided promotional script and the 300-character research summary, please create a concise and engaging 10-50 word text prompt designed to guide the creation of a compelling 5-second animated intro video. The prompt should capture the key themes, ideas, or visuals that will effectively introduce and set the tone for the main promotional video content." }, { "taskID": 194, "semanticTitleOfTask": "Make Short Animated Video From Text Prompt", "taskDescription": "Create a 5-second animated intro video in MP4 format based on the provided animation prompt, saving the file on the server with both internal and external URLs.", "inputDescription": "The 10-50 word animation prompt generated from the previous task.", "inputRequired": ["animation-prompt"], "outputDescription": "A 5-second animated intro video in MP4 format, saved on the server with internal and external URLs.", "outputName": ["animated-intro-video-mp4", "internal-url", "external-url"], "promptInstruction": "" } ]

subagent1-json-array-mermaid

<!DOCTYPE html> <html> <head> <title>Mermaid Diagram Example</title> <script src="https://cdnjs.cloudflare.com/ajax/libs/mermaid/9.4.3/mermaid.min.js"></script> </head> <body> <div class="mermaid"> graph TD A[Subagent 1 Output: Generated Promotional Script] --> B{#182 Research Topic Lightly} B --> C{#178 Rewrite Text Based On Instructions} C --> D{#194 Make Short Animated Video From Text Prompt} D --> E[Final Output: 5-second Animated Intro Video MP4, Internal URL, External URL] </div> <script> mermaid.initialize({ startOnLoad: true }); </script> </body> </html>