Open Source
LitData (Lightning AI)
GitHub
- LitData scales
data processing tasks
(data scraping, image resizing, distributed inference, embedding creation
) on local or cloud machines. - It also enables
optimizing datasets to accelerate AI model training
and work with large remote datasets without local loading
.
LitServe (Lightning AI)
GitHub
- LitServe is an easy-to-use, flexible
serving engine for AI models
built on FastAPI. - It augments FastAPI with features like
batching, streaming, and GPU autoscaling
to eliminate the need to rebuild a FastAPI server per model.