Open Source

LitData (Lightning AI)

GitHub

  • LitData scales data processing tasks (data scraping, image resizing, distributed inference, embedding creation) on local or cloud machines.
  • It also enables optimizing datasets to accelerate AI model training and work with large remote datasets without local loading.

LitServe (Lightning AI)

GitHub

  • LitServe is an easy-to-use, flexible serving engine for AI models built on FastAPI.
  • It augments FastAPI with features like batching, streaming, and GPU autoscaling to eliminate the need to rebuild a FastAPI server per model.