Revolutionizing Sign Language Communication with Cutting-Edge Real-Time Translation Models.
Enjoy seamless Sign Language Translation on desktop and mobile.
Contribution Guidelines · Submit an Issue
┌─────────────────────┐
│Spoken Language Audio│ ┌─────────┐
└─────────┬───────────┘ ┌──────────►│Human GAN│
│ │ └─────────┘
▼ │
┌────────────────────┐ ┌───────────────┐ ┌───────────┐ ┌──────┴──────┐ ┌───────────────┐
│Spoken Language Text├────►│Normalized Text├────►│SignWriting├───►│Pose Sequence├───►│Skeleton Viewer│
└─────────┬──────────┘ └───────────────┘ └───────────┘ └──────┬──────┘ └───────────────┘
│ ▲ ▲ │
▼ │ │ │ ┌─────────┐
┌───────────────────────┐ │ │ └──────────►│3D Avatar│
│Language Identification├──────────┘───────────────────┘ └─────────┘
└───────────────────────┘
┌──────────────────────────┐ ┌────────────────────┐
│Upload Sign Language Video│ ┌────────►│Spoken Language Text│
└──────────┬───────────────┘ │ └──────────┬─────────┘
│ │ │
│ ┌────────────┐ ┌──────┴────┐ │
├─────────►│Segmentation├──────►│SignWriting│ │
│ └────────────┘ └───────────┘ │
│ ▼
┌──────────┴────────────────┐ ┌─────────────────────┐
│Camera Sign Language Video │ │Spoken Language Audio│
└───────────────────────────┘ └─────────────────────┘
Join us on the journey to revolutionize sign language communication. Follow our progress on the Project Board, shape the project's future, and delve deeper into our vision and plans in the Wiki.
Wish to report a bug, contribute some code, or enhance documentation? Fantastic! Check our guidelines for contributing and then explore our issues marked as help wanted or good first issue.
Find this useful? Give our repo a star ⭐ ⬆️.
- Install Node.js which includes Node Package Manager
Install dependencies locally:
npm installRun the application:
npm startTest the application:
npm testRun the application on iOS:
npm run build:full && \
npx cap sync ios && \
npx cap run ios@misc{moryossef2023signmt,
title={sign.mt: Effortless Real-Time Sign Language Translation},
author={Moryossef, Amit},
howpublished={\url{https://sign.mt/}},
year={2023}
}