Skip to content

dmtan90/AntStudio

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

20 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

AntStudio - Autonomous AI Streamer for Live Commerce

Landing Page

The world's first fully autonomous AI Streamer built specifically for Live Commerce and E-Commerce sales. Transform your products into viral 24/7 sales livestreams.

License: AGPL-3.0 Node.js MongoDB Docker Status

πŸ“Έ Platform Overview

Dashboard

Admin Dashboard

🎬 Overview

AntStudio is redefining live commerce with our fully autonomous AI Streamer. It combines real-time video generation, intelligent sales orchestration, and interactive commerce tools into a unified platform built to drive conversions 24/7.

🌟 AI Streamer for Sales (Core Features)

  • πŸ€– AI Streamer (Sales Mode):

    • 24/7 Autonomous Live Selling
    • Dynamic product pitching based on real-time viewer interaction
    • Script-driven Aidol (AI Idol) video clip mapping for seamless product showcases
    • Natural conversational sales flow with context awareness
  • πŸ’° Commerce Intelligence Engine:

    • Automatic product mention detection and synchronization
    • Dynamic QR code generation for instant checkout (real scannable codes)
    • Autonomous flash-sale and scarcity overlay triggering
    • Live conversion tracking and engagement analytics
  • 🎀 Neural Audio & Sales Dubbing:

    • Expressive, sales-optimized text-to-speech
    • Multi-language support to sell globally
    • Instant translation of viewer questions
  • πŸŽ₯ Live Highlight Service:

    • Autonomous capture of viral sales moments
    • AI-driven engagement analysis to find the best pitches
    • Instant social-ready exports for TikTok/Reels marketing
  • 🌍 Multi-Modal Accessibility:

    • Visual subtitles + Audio dubbing
    • Interactive QR codes
    • Global reach with local authenticity

🎨 Additional Features

  • πŸ€– AI-Powered Workflow:
    • Script to Video: Automated analysis and storyboard generation
    • Product Ads: Marketing wizard for e-commerce videos
    • AI Avatars: Generate realistic talking avatars using Google Veo 3
    • Presentation to Video: Convert PDF/PPTX slides into video scenes

Product Ads Wizard AI-driven Product Ads Wizard

  • 🎬 Live Studio:
    • Real-time AI processing (face detection, segmentation, AR)
    • Virtual production (chromakey, 3D stages)
    • Multi-platform streaming (YouTube, Facebook, TikTok, Ant Media Server)
    • Mobile camera ingest
    • WebRTC guest integration

Influencers & Live Studio Live Studio & Virtual Production Management

  • 🎨 Advanced Video Editor:
    • Professional timeline with magnetic snapping
    • Multi-track support and drag-and-drop
    • 50+ editing tools and effects
    • Export to disk for unlimited duration

Templates Professional Video Templates & Editor

  • 🎀 Voice Intelligence:

    • Voice Lab: Manage and clone voices
    • Voice Cloning: Create instant digital twins using ElevenLabs
    • Text-to-Speech: High-quality synthesis via ElevenLabs or Google Gemini
  • πŸ’³ Monetization & Licensing:

    • Hybrid Payment System: Seamless integration with Stripe and PayPal for diverse billing options.
    • License Portal: Enterprise-grade license key verification and management.
    • Smart Subscriptions: Automated recurring billing, trial management, and webhook callbacks.
    • Usage Tracking: Granular credit tracking for AI generation features.

Licensing & Subscription Monetization and Subscription Management

  • 🏒 Enterprise Features:
    • White-label multi-tenant architecture
    • Global CDN delivery
    • Multi-region deployment
    • Real-time monitoring and alerting
    • Perpetual and subscription licensing

System Monitoring Enterprise System Monitoring Dashboard

πŸ—οΈ Architecture

Monorepo Structure

antstudio/
β”œβ”€β”€ client/              # Vite + Vue 3 frontend
β”‚   β”œβ”€β”€ src/
β”‚   β”‚   β”œβ”€β”€ components/  # Reusable UI components
β”‚   β”‚   β”œβ”€β”€ views/       # Page components
β”‚   β”‚   β”‚   β”œβ”€β”€ user/    # Dashboard, Projects, LiveStudio
β”‚   β”‚   β”‚   β”œβ”€β”€ admin/   # Settings, Monitoring, Tenants
β”‚   β”‚   β”‚   └── video-editor/  # Advanced timeline editor
β”‚   β”‚   β”œβ”€β”€ stores/      # Pinia state management
β”‚   β”‚   └── utils/
β”‚   β”‚       └── ai/      # AI engines (Director, Commerce, Vibe, etc.)
β”œβ”€β”€ server/              # Express.js backend
β”‚   β”œβ”€β”€ src/
β”‚   β”‚   β”œβ”€β”€ models/      # MongoDB schemas
β”‚   β”‚   β”œβ”€β”€ routes/      # API endpoints
β”‚   β”‚   β”œβ”€β”€ services/    # Business logic
β”‚   β”‚   β”‚   β”œβ”€β”€ StreamingService.ts
β”‚   β”‚   β”‚   β”œβ”€β”€ ClusterManager.ts
β”‚   β”‚   β”‚   └── MonitoringService.ts
β”‚   β”‚   β”œβ”€β”€ integrations/
β”‚   β”‚   β”‚   β”œβ”€β”€ ai/      # AI provider clients
β”‚   β”‚   β”‚   └── flow/    # Direct API clients
β”‚   β”‚   └── utils/       # Helpers and utilities
└── docker-compose.yml   # Full stack orchestration

Tech Stack

Frontend:

  • Vue 3 + TypeScript + Vite
  • Pinia + Vue Query
  • Element Plus + TailwindCSS
  • Fabric.js (Canvas) + FFmpeg.js
  • MediaPipe (AI inference)
  • Three.js (3D virtual stages)

Backend:

  • Node.js + Express
  • MongoDB + Mongoose
  • FFmpeg (video processing)
  • WebRTC + Socket.io
  • AI Integrations: Google Vertex AI, ElevenLabs, Custom models
  • AWS S3 (Storage)
  • Payments: Stripe (Connect/Checkout), PayPal (Smart Buttons)
  • Licensing: Custom License Portal Integration

AI Services:

  • Google: Gemini, Veo 3, Imagen 3
  • ElevenLabs: Voice cloning, TTS, Music generation
  • MediaPipe: Face detection, body segmentation
  • Custom: Commerce Intelligence, Vibe Engine, AI Director

Important

Architectural Decision: Client-Side Video Assembly AntStudio uses a Decentralized Rendering Architecture. All video assembly, encoding, and final exports are processed on the client-side (browser) using WebWorkers and @webav/av-cliper. The backend serves only as an asset repository and data orchestrator. DO NOT implement backend rendering services to avoid unnecessary GPU/CPU load on the server cluster.

πŸš€ Quick Start (Docker)

The easiest way to run AntStudio is with Docker.

  1. Clone the repository

    git clone https://github.com/yourusername/antstudio.git
    cd antstudio
  2. Configure Environment Create a .env file in the root directory:

    # Required for Core Features
    MONGODB_URI=mongodb://mongo:27017/antstudio
    JWT_SECRET=your_secret_key_here
    
    # AI Services
    GEMINI_API_KEY=your_gemini_key
    ELEVENLABS_API_KEY=your_elevenlabs_key
    
    # Storage
    AWS_ACCESS_KEY_ID=your_aws_key
    AWS_SECRET_ACCESS_KEY=your_aws_secret
    AWS_S3_BUCKET=your_bucket_name
    AWS_REGION=us-east-1
    
    # Optional: FFmpeg path for streaming
    FFMPEG_BIN=ffmpeg
  3. Run with Docker Compose

    docker-compose up --build -d
  4. Access the App

    • Frontend: http://localhost:5173
    • Backend API: http://localhost:4000/api
    • Live Studio: http://localhost:5173/live-studio

πŸ› οΈ Local Development

If you prefer running services individually:

# Install dependencies
pnpm install

# Run Client (http://localhost:5173)
cd client
pnpm dev

# Run Server (http://localhost:4000)
cd server
pnpm dev

🎯 Key Capabilities

AI Video Production

  • Generate videos from scripts in 2-5 minutes
  • Support for 10+ video formats
  • Automated storyboard generation
  • AI-powered scene composition

Live Streaming

  • Simultaneous broadcast to 3+ platforms
  • 60 FPS real-time rendering
  • <100ms AI decision latency
  • WebRTC and RTMP support

Commerce Integration

  • 90%+ product detection accuracy
  • <500ms QR code generation
  • Real-time conversion tracking
  • Autonomous overlay management

Global Accessibility

  • Real-time translation in multiple languages
  • Neural voice dubbing with cloning
  • Multi-modal content delivery
  • CDN-powered global reach

πŸ“– Documentation

πŸ† What Makes AntStudio Unique

World's First Features

  1. Autonomous AI Live Streamer - Fully autonomous 24/7 sales orchestration
  2. Live Commerce Intelligence - Real-time product detection and QR generation
  3. Neural Voice Translation - Voice cloning with live translation
  4. Autonomous Viral Capture - AI-driven highlight recording
  5. Multi-Modal Accessibility - Combined visual, audio, and interactive elements

Production Ready

  • βœ… 0 lint errors, 100% TypeScript
  • βœ… High-Performance Smart Rendering (Optimized WebGL)
  • βœ… Multi-tenant architecture
  • βœ… Global CDN integration
  • βœ… Real-time monitoring
  • βœ… Comprehensive documentation

πŸ’° Pricing & Credits

Subscription Tiers:

  • Free: 500 credits/month
  • Pro: 2000 credits/month + priority support
  • Enterprise: 6000 credits/month + dedicated infrastructure

Credit Costs:

  • Text generation: 1 credit
  • Image generation: 4 credits
  • Video generation: 10 credits
  • Live streaming: 1 credit per 60 minutes
  • Music generation: 5 credits

Unlimited Bypass: ElevenLabs integration provides unlimited media generation

🀝 Contributing

We welcome contributions! Please see CONTRIBUTING.md for guidelines.

οΏ½ Support the Project

If you find AntStudio useful and want to support its development, you can sponsor the project via PayPal:

πŸ‘‰ Sponsor via PayPal (dmtan90@gmail.com)


οΏ½πŸ“„ License

AntStudio is dual-licensed:

  1. Personal & Non-Commercial Use: Licensed under the GNU Affero General Public License v3.0 (AGPL-3.0). You can use, modify, and distribute the software for free, provided that any derivative works are also licensed under AGPL-3.0 and their source code is made available.
  2. Commercial Use: Requires a Commercial License. If you wish to use AntStudio for commercial purposes, in a closed-source environment, or without the restrictions of AGPL-3.0, please contact Tan Do at dmtan90@gmail.com to purchase a commercial license.

See the LICENSE file for more details.


🌟 Status

Version: 2.0.0 (Singularity)
Status: Production Ready βœ…
Last Updated: January 2026


Made with ❀️ and πŸ€– by the AntStudio Team

"From Script to Singularity - Transforming Creativity with AI"

About

Transform your ideas into cinematic videos with AI. The world's first fully autonomous entertainment and commerce engine.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors