AMD Developer Hackathon Act IITrack 2Fireworks AI-ready prototype

CaptionForge AI

AI-powered multi-style video captioning for short clips.

Built as an AMD Developer Hackathon Act II concept with a Fireworks AI-ready frontend flow: upload, sample frames, generate style variants, review, and copy.

Prototype Console

Waiting for a short clip

Upload
Sample
Copy

Video Upload Panel

Add a short clip

No video selected

Choose a local video file to preview and sample frames.

Video preview appears here

Frame Extraction Preview

Sample five frames

Frame 1
Frame 2
Frame 3
Frame 4
Frame 5

Base64 image data is stored in browser state for the future Fireworks AI captioning step.

Caption Generator Panel

Four caption styles

Fireworks AI reads the sampled frames through a secure API route. Extract frames first; fallback mock captions keep the demo moving when the API is unavailable.

Formal

Waiting

Extract preview frames, then generate a polished caption.

Sarcastic

Waiting

Waiting for frames before the wit engine clocks in.

Humorous-tech

Waiting

Frame tensors pending. Caption runtime not yet initialized.

Humorous-non-tech

Waiting

Upload, sample, and this card gets much funnier.

Visual summary

Visual summary appears after captions are generated.

Safety note

Safety note appears after captions are generated.

Responsible AI Notes

Review before publish

  • Captions should be reviewed before publishing.
  • AI may miss context, speech, sarcasm, or sensitive content.
  • Users should not use captions to misrepresent people or events.
  • The prototype uses uploaded video frames and optional user-provided context.

Architecture

Caption pipeline

1

Video Upload

User selects a short clip and optional context.

2

Frame Sampling

Browser canvas captures representative preview frames.

3

Fireworks AI Captioning

Fireworks Vision reads sampled frames and user-provided context.

4

Style Transformation

One base caption becomes four audience-ready styles.

5

Human Review

Creator checks tone, accuracy, and sensitive context.

6

Publish/Copy

Approved captions are copied into the publishing workflow.