Lightweight Transformers is an open-source library optimized for efficient inference of large language models, compatible with EleutherAI models.
Lightweight Transformers is an open-source library optimized for efficient inference of large language models, compatible with EleutherAI models.
You might also be interested in these tools
Open source API management system with 50k+ GitHub stars, supports self-hosting
Leading AI research company offering GPT-4, GPT-3.5, DALL-E, and Whisper APIs
Unified API for 200+ AI models with competitive pricing and smart routing
AI safety company offering Claude 3 family with extended context windows