Refine SubAgent & Output

Describe

Describe your task

Refine

Refine the plan

SubAgents

Review all agents

Deploy

Deploy your agent

A) FULL TASK SUMMARY: Create a comprehensive, media-rich article from a "how-to" video, including transcription, key steps, screenshots, and formatted text.

B) FINAL TASK OUTPUT: A formatted article file (HTML, Word, Google Doc, or Markdown) containing a title, introduction, six main steps with corresponding screenshots, detailed explanations, and a conclusion. The article should be well-structured, visually appealing, and ready for publication.

C) COMPONENTS OVERVIEW:
1. Video file (input)
2. Audio transcription with timestamps
3. Six extracted high-resolution screenshots
4. Step-by-step breakdown of the process
5. Generated article text
6. Formatted article (output)

D) OVERVIEW OF SUBAGENTS:
1. Audio Extraction and Transcription Agent: Extracts audio from the video and generates a transcription with timestamps
2. Step Identification and Image Extraction Agent: Analyzes the transcription to identify the six key steps and extracts corresponding screenshots
3. Article Generation Agent: Generates the article text based on the step-by-step breakdown and transcription
4. Formatting and Assembly Agent: Combines the article text and images into a formatted document or file

E) SUBAGENT 1: Audio Extraction and Transcription Agent
- Final Output: A complete, accurate text transcript of the video's audio, including timestamps for each spoken sentence or phrase, saved as a plain text file (e.g., transcription.txt)
- Tasks:
  1. Extract audio from the input video
  2. Generate a transcription of the audio with timestamps
  3. Save transcription as text file
- Sequence: Extract audio from video > Generate transcription with timestamps > Save transcription as text file

F) SUBAGENT 2: Step Identification and Image Extraction Agent
- Final Output: A list of the six main steps extracted from the video transcription, along with six high-resolution screenshots (PNG or JPG) taken from the video at specific timestamps, corresponding to the key steps in the process
- Tasks:
  1. Analyze the transcription to identify the six key steps
  2. Extract six thumbnail images at specific timestamps based on the identified steps
  3. Resize and save the extracted images
- Sequence: Analyze transcription > Identify key steps > Extract thumbnail images > Resize and save images

G) SUBAGENT 3: Article Generation Agent
- Final Output: The main text of the article, including an introduction, detailed explanations of the six steps (with corresponding image filenames), and a conclusion, saved as a plain text file (e.g., article.txt)
- Tasks:
  1. Generate the article text based on the step-by-step breakdown and transcription
  2. Refine the generated text for clarity, readability, and style
  3. Save article text as plain text file
- Sequence: Generate article text based on step-by-step breakdown and transcription > Refine text for clarity and style > Save article text as plain text file

H) SUBAGENT 4: Formatting and Assembly Agent
- Final Output: A formatted article file (HTML, Word, Google Doc, or Markdown) that combines the generated text with the embedded images, ready for publication
- Tasks:
  1. Format the article text into a visually appealing file
  2. Embed the extracted images in the appropriate locations within the article text
  3. Save the final formatted article file
- Sequence: Format article text > Embed images in appropriate locations > Save final formatted article file

Final Exact Output You Want

Expand

Title Of Task (You Wrote)

Expand

Task Summary (You Wrote)

Expand

I want to record a video on a "how to" topic and turn it into an article, with text and images. For example, I will record a video about "how to make software mockups with GIMP" and then want it turned into a video. I want this to be a very media-rich article with lots and lots of screenshots, so the idea is that in the video I will explain what I am doing (eg "the first thing we do is open GIMP and click on new image and choose an image size of 1000x1000"), and then we will want to extract the transcription from the video. Then we review this transcription/timestamps and decide on the core steps of the how to task (eg step 1 - download GIMP.. step 2 - create a new image), and then we look at the timestamps mentioned and extract images at those specific timestamps (so if I say "let me open the image now" at 23.39 then we would extract an image frame from the video at that point). Then we will use my transcription file to set specific timings. My software works best when it has a fixed number of actions to take, so I suggest we (fairly abitrarily) go with six steps. This means we will want six images embedded, and six steps written in the article. It will mean that an LLM will need to review the transcription and decide which are the six steps (if the video narrator does not explicitly list six steps, or even does more or fewer).

Diagram Of Entire Task (All SubAgents)

Expand Diagram

Ready To Proceed?

When you are ready to proceed, click the Save button to load the next step...
The next step is SubAgents. It will take around 10 minutes to load this page...
If you are entirely unhappy with this page, click Back to rerun Step 1 again.
Before saving, check the SubAgents and Output fields above (very important!)
The Agent heavily relies on the SubAgents and Output fields to build your task.

-- The LLM has raised some questions to help you clarify the desired final `output` (important - this must be specific) 
-- These ideas are worth scanning briefly (then either amend output/subagents or go back to step 1)
-- The first few points regarding how to clarify the `output` are particular important!

## QUESTIONS RAISED BY THE LLM:

a) To clarify the final output, I would ask the following questions:

1. What format should the final article be in? (e.g., plain text, HTML, Markdown)
2. Approximately how long should the article be in terms of word count?
3. Should the article include any additional elements besides the text and images, such as a title, introduction, conclusion, or call-to-action?
4. How should the images be formatted and positioned within the article? (e.g., inline with text, separate gallery, specific dimensions)
5. Is there a specific target audience or platform for the article? (This can influence the writing style and formatting)

b) The task should accept the following inputs before starting:

1. The video file containing the "how to" demonstration
2. The desired title of the article (if not provided, it can be generated based on the video content)
3. Any specific formatting requirements or templates to follow (if applicable)

c) I suggest segmenting the task into the following specialized areas:

1. Video transcription: Extracting the spoken content from the video and generating a text transcript with timestamps. This can be done using a separate speech-to-text service or API.

2. Key step identification: Analyzing the transcript to identify the main steps of the process. This can be done by looking for phrases like "first," "next," "then," or "finally," as well as any explicitly mentioned steps. If the video does not clearly outline six steps, the AI will need to use its judgment to break down the process into a logical sequence of six parts.

3. Image extraction: Using the identified key steps and their corresponding timestamps, extract relevant images from the video at those specific points. This ensures that the images align with the content being described in each step.

4. Article generation: Using the transcript, identified steps, and extracted images, generate the final article text. This involves rephrasing and summarizing the transcript content, organizing it into coherent paragraphs, and ensuring a logical flow between the steps.

5. Article formatting: Applying the specified formatting requirements, such as adding a title, introduction, and conclusion, and inserting the images at appropriate locations within the text. This step ensures that the final article meets the desired format and style.

By segmenting the task into these specialized areas, each component can be handled by a dedicated service or module, allowing for a more modular and maintainable workflow. This also enables easier troubleshooting and iteration on individual components if needed.

Expand

a) Here are some questions that I would ask to clarify the final output:

1. What is the minimum and maximum word count for the article? The length of the article significantly impacts the depth of information and the allocation of screenshots in each step.
2. Are the six steps rigid, or can we break the process down into fewer than six steps or more than six if necessary? 
3. Along with screenshots, do you want to include original video clips in the final article that correspond with each step? If yes, what should be their ideal length?
4. Do you want a specific format for the article? For instance, introduction, steps, conclusion? Or do you prefer a freestyle format?
5. Will the article require additional elements such as a header, subheaders, bullet points, or numbered steps?
6. Do you have any specific style of writing in mind for the final article – professional, casual, instructive, narrative?

b) The task should accept the following inputs before launching the task completion process:

1. The recorded video that will serve as the basis for the article.
2. Any additional notes or information that the user wants to be incorporated in the article but was not included in the video.
3. Specific text, phrases, or terminology that the user wants to be included or avoided in the article.
4. The desired format or template of the article, if any.
5. Information regarding the style of writing, if the user has specific preferences.
6. The target audience or readers of the article, which may influence the language, tone and depth of information in the text.
7. The decision on whether the extraction of screenshots from the video should be automated or manually verified.

Research Links

"How to Create a Logo in Photoshop" Article

"GIMP Tutorial for Beginners" YouTube Screenshots

"How to Edit Photos in Lightroom" Markdown GitHub

WikiHow "How to Use GIMP" Article HTML Source

"GIMP Interface Screenshot" Google Images

☝️ Like These? Consider Bringing These Ideas Into Output Or SubAgents (on previous page)

-- The LLM has suggested possible templates that could be useful to build this agent. 
-- Consider preparing these now...(you can upload them as `pre-prompts` in the next stage).
-- These prompts must be text, HTML or a URL (eg of an image or some folder).

## TEMPLATE IDEAS FROM THE LLM:

Based on the task description and the final output goals, here are some template suggestions that could help refine the definition of a successful output:

1. Existing "how-to" articles with a similar structure:
   - Search for articles on topics like "How to create a logo in Photoshop" or "How to edit photos in Lightroom"
   - Review the structure, formatting, and content of these articles to get a sense of how successful "how-to" articles are presented
   - Pay attention to the use of images, step-by-step instructions, and overall clarity of the content

2. Screenshots from video tutorials:
   - Find popular video tutorials on similar topics (e.g., "GIMP Tutorial for Beginners")
   - Scan through the videos and observe how the creators use screenshots to illustrate their points
   - Note the frequency and relevance of the screenshots used, as well as their quality and clarity

3. Markdown files of well-structured articles:
   - Search for Markdown files of "how-to" articles on platforms like GitHub or in open-source documentation
   - Analyze the use of headings, subheadings, lists, and embedded images within these Markdown files
   - Consider how the Markdown format contributes to the readability and clarity of the article

4. HTML source code of successful "how-to" websites:
   - Visit websites known for their high-quality "how-to" content (e.g., WikiHow, Instructables)
   - View the source code of these pages to understand how they structure their content using HTML tags
   - Look for patterns in the use of headings, paragraphs, lists, and image placement

5. Google Image search results for relevant screenshots:
   - Perform a Google Image search for screenshots related to the specific task (e.g., "GIMP interface screenshot")
   - Analyze the quality, clarity, and relevance of the top search results
   - Consider how these screenshots could be used to enhance the article's visual content

By collecting and reviewing these templates, the AI Agent can better understand what makes a successful "how-to" article in terms of structure, content, and visual elements. This information can then be used to guide the creation of the final output, ensuring that it meets the desired standards of quality and effectiveness.

Final Points Before Saving!

If you are at all unsure about this step, consider returning to step 1 (having taken new ideas from this Step 2 page)
DO NOT proceed to Step 3 if the information on this page has raised fundamental problems with your initial task
If the original description you wrote on Step 1 is largely correct, and this page has not really changed your mind about anything, then simply tweak the Output and SubAgents fields and Save (you can always hit BACK later)
IMPORTANT: If your initial description (Step 1) and Subagent & Output (Step 2) are flawless then the Agent will take it from here and your task will be easy to build. BUT if you are already seeing problems, consider hitting BACK and starting again.
It is MUCH easier to go back a step than to try to refine and imperfect task down the line. Final chance to start again!
Remember - the initial description on Step 1, along with the SubAgent summary & Output spec on Step 2, are the foundation on which all remaining steps and Agents run. This step is here for a reason, so please consider hitting back. It will save time later!

Need To Start Afresh?

BACK TO DESCRIBE

Refine SubAgent & Output

Describe

Refine

SubAgents

Deploy

Final Exact Output You Want

Expand

Title Of Task (You Wrote)

Expand

Task Summary (You Wrote)

Expand

Diagram Of Entire Task (All SubAgents)

Expand Diagram

Ready To Proceed?

More Questions & Research Ideas (LLM #2)

Expand

Research Links

☝️ Like These? Consider Bringing These Ideas Into Output Or SubAgents (on previous page)

Final Points Before Saving!

Need To Start Afresh?

Tweaked & Good To Go?