Skip to content

cmunozdev/DominiSigns

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

6 Commits
Β 
Β 

Repository files navigation

DominiSigns: Avatar Translator for Dominican Sign Language

πŸ“ Project Description

DominiSigns is an innovative accessibility application that uses artificial intelligence to translate text and voice into Dominican sign language (LSRD) through an animated 3D avatar. Our goal is to break down communication barriers and promote the inclusion of the deaf community in the Dominican Republic.

🌟 Key Features

  • Text-to-Sign Translation: Converts text input into Dominican sign language animations
  • Speech-to-Sign Translation: Recognizes audio and converts it to signs
  • Customized 3D Avatar: Realistic avatar that performs signs with precision and fluidity
  • Integrated Dictionary: Comprehensive LSRD database
  • Accessible Interface: Designed following universal accessibility principles

πŸš€ Project Status

Currently in active development phase. The project is at the following stages:

  • Collection of LSRD dictionary and reference videos
  • Development of text/voice processor
  • Creation of base 3D avatar
  • Implementation of sign animations
  • Development of user interface
  • Testing with the Dominican deaf community

πŸ› οΈ Technologies Used

  • Frontend: React, Three.js
  • Backend: Node.js, Express
  • Language Processing: TensorFlow/PyTorch for NLP
  • 3D Animation: Blender, Mixamo
  • Generative AI: Pollinations.ai API
  • Database: MongoDB

πŸ“‹ Requirements

  • Node.js v14 or higher
  • Access to Pollinations.ai API
  • Dependencies listed in package.json

πŸ”§ Installation and Setup

# Clone the repository
git clone https://github.com/cmunozdev/dominisigns.git
cd dominisigns

# Install dependencies
npm install

# Configure environment variables
cp .env.example .env
# Edit the .env file with your API credentials

# Start the development server
npm run dev

πŸ“Š System Architecture

                      β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
                      β”‚  Text/Audio   β”‚
                      β”‚    Input      β”‚
                      β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
                              β”‚
                      β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”
                      β”‚     NLP       β”‚
                      β”‚   Processor   β”‚
                      β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
                              β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β”‚           β”‚                  β”‚           β”‚
β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”
β”‚  Syntactic β”‚ β”‚   LSRD    β”‚    β”‚ Animation  β”‚ β”‚   Sign    β”‚
β”‚  Analysis  β”‚ β”‚Translationβ”‚    β”‚ Generation β”‚ β”‚ Sequencingβ”‚
β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”˜
        β”‚           β”‚                  β”‚           β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                              β”‚
                      β”Œβ”€β”€β”€β”€β”€β”€β”€β–Όβ”€β”€β”€β”€β”€β”€β”€β”
                      β”‚      3D       β”‚
                      β”‚    Avatar     β”‚
                      β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

πŸ” Use Cases

  • Education: Support in inclusive classrooms
  • Public Services: Improved accessibility in hospitals, banks, etc.
  • Personal Communication: Facilitates everyday interactions
  • Events and Conferences: Automatic interpretation for presentations

🌍 Social Impact

This project is aimed at approximately 100,000 deaf people in the Dominican Republic who use LSRD as their primary means of communication. By providing a technological tool that respects the cultural and linguistic particularities of the country, we seek to:

  1. Reduce communication barriers
  2. Promote social inclusion
  3. Preserve and spread Dominican sign language
  4. Support independence and autonomy of the deaf community

πŸ“œ License

This project is licensed under the MIT License.

πŸ™ Acknowledgements

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published