Open Source

LitData (Lightning AI)

GitHub

• LitData scales data processing tasks (data scraping, image resizing, distributed inference, embedding creation) on local or cloud machines.
• It also enables optimizing datasets to accelerate AI model training and work with large remote datasets without local loading.

LitServe (Lightning AI)

GitHub

• LitServe is an easy-to-use, flexible serving engine for AI models built on FastAPI.
• It augments FastAPI with features like batching, streaming, and GPU autoscaling to eliminate the need to rebuild a FastAPI server per model.