👧
Amica
Launch DemoTelegramGitHubTwitter
  • Welcome to Amica!
  • 🌸Overview
    • How Amica Works
    • Core Features
    • Amica Life
    • Emotion System
    • Other Features
    • Use Cases
    • Amica vs Other Tools
  • 🌳Getting Started
    • Quickstart Guide
    • Installing Amica
    • Next Steps
  • 🗣️Connecting LLMs (Your Core AI Chatbot Model)
    • Using LM Studio
    • Using LLaMA.cpp
    • Using Ollama
    • Using KoboldCpp
    • Using OpenAI
    • Using Oobabooga
    • Using OpenRouter
  • 🔊Connecting Speech Options (TTS)
    • Using SpeechT5
    • Using ElevenLabs
    • Using Coqui Local
    • Using Piper
    • Using Alltalk TTS
    • Using Kokoro TTS
    • Using RVC
  • 👂Connecting Microphone Options (STT)
    • Using whisper.cpp
  • 👁️Connecting Multi-Modal Modules
    • Using LLaVA
  • 🔧Other Guides
    • Using Window.ai
    • Using Moshi (Voice to Voice)
  • 🧩Plugin System
    • Plugins Intro
    • Getting Real World News on Amica
  • 🔌API System
    • External API for Agents
  • 🌻Tutorials
    • Creating new Avatars
    • Using Custom Assets
  • 🌺Contributing to Amica
    • Setting up your developer environment
    • Contributing to the Docs
    • Developing Amica
    • Adding Translations
Powered by GitBook
On this page
  • Overview of Amica
  • Chat System
  • Voice System
  • Avatar System
  • Transcription System
  • Expression System
  • Visual System
Edit on GitHub
  1. Overview

How Amica Works

PreviousWelcome to Amica!NextCore Features

Last updated 1 year ago

Read the guide if you are interested in getting everything running locally quickly.

Overview of Amica

Amica is composed of a few different components:

  • Chat System

  • Voice System

  • Avatar System

  • Transcription System

  • Expression System

  • Visual System

These work together to create a virtual assistant that can be used to interact with the world. The chat system is the core of Amica, and the other systems are built on top of it.

Chat System

The chat system is the core of Amica. It is responsible for processing messages and generating responses. It is also responsible for managing the other systems. Detected emotions will cause the expression system to change the avatar's expression. Detected intents will cause the voice system to generate speech.

Voice System

The voice system is responsible for generating speech from text. The voice system can accept emotion to generate speech with different intonation. It can also accept a voice to generate speech with a specific voice.

Avatar System

The avatar system is responsible for displaying the avatar. It is composed of a few different components. The avatar system can accept emotion to change the avatar's expression. It can also accept a voice to change the avatar's lip sync.

Transcription System

The transcription system is responsible for transcribing speech to text. This is what is used when you speak to Amica. Part of this is voice activity detection, which is used to detect when you begin and stop speaking.

Expression System

The expression system is responsible for changing the avatar's expression. This is done by changing the avatar's blendshapes. The expression system can accept emotion to change the avatar's expression.

Visual System

The visual system is how Amica sees the world. It is responsible for detecting faces and emotions. It is also responsible for detecting objects and text. This uses the camera of the device that Amica is running on.

🌸
Local Setup