aim 4.0.3


pip install aim

  This release has been yanked

Released: Oct 04, 2023

Project Links

Meta
Requires Python: >=3.7.0

Classifiers

License
  • OSI Approved :: Apache Software License

Programming Language
  • Python
  • Python :: 3
  • Python :: 3.7
  • Python :: 3.8
  • Python :: 3.9
  • Python :: 3.10
  • Python :: 3.11
  • Python :: Implementation :: PyPy
Drop a star to support Aim ⭐ Join Aim discord community

⚡ ⚡ Aim 4.0 stable has been released! ⚡ ⚡ !!


Open-source modular observability for AI Systems.

Easily log, connect and observe any parts of your AI Systems from experiments to production to prompts to AI system monitoring.


Discord Server Twitter Follow Medium

Platform Support PyPI - Python Version PyPI Package License PyPI Downloads Issues



SEAMLESSLY INTEGRATES WITH:


TRUSTED BY ML TEAMS FROM:


AimStack offers enterprise support that's beyond core Aim. Contact via hello@aimstack.io e-mail.


AboutDemosDefault logging appsQuick StartExamplesDocumentationCommunityBlog


ℹ️ About

Aim is an open-source operating system for logs. With Aim you can build, run and combine any kind of logging applications - experiment tracking, production monitoring, AI System (LLM-based) monitoring, usage monitoring etc.

The Logging applications are typically a combination of these components:

  • The types and relationships of the data being logged
  • The observability UI over the data logged
  • Automations over the data logged

Aim comes installed with a number of default logging apps:

  • Base App - a basic generic log exploration and the logging primitives
  • AI Experiment Tracking App - log and explore your machine learning experiments. Includes integrations with the majority of leading ML frameworks.
  • AI Systems Tracing and Debugging Apps - a combination of variety of apps that log from langchain to llamaindex traces all in one place.

Apart from running the logging apps, Aim comes with explorers and reports.

  • Explorers are advanced logs comparison tools for specific kind of logs - they allow to compare 1000s of sessions of metrics, images, text, audio and other types of data.
  • Reports are embedded knowledge-base that operate with the apps and explorers seamlessly to enable capture the knowledge built on top of the logged data from the observations through Aim apps and explorers.

With the rise of AI Systems and the challenges it brings forward, logging apps are going to be a crucial part of the software.

Our mission is to democratize developer tools for building AI.


Base App

A general observability over anything logged with Aim.

Visualize all the logs ever logged with Aim for the given project 🗺️
Base types to log common artifacts such as Images, Audio objects, Figures, Metrics
High-level overview of the logs, the types logged and the respective sessions/ containers
Deep-dive into each type of the log

Experiment Tracking App

Log Metadata Across Your ML Pipeline 💾 Visualize & Compare Metadata via UI 📊
  • ML experiments and any metadata tracking
  • Integration with popular ML frameworks
  • Easy migration from other experiment trackers
  • Metadata visualization via Aim Explorers
  • Grouping and aggregation
  • Querying using Python expressions
Run ML Trainings Effectively ⚡ Organize Your Experiments 🗂️
  • System info and resource usage tracking
  • Real-time alerting on training progress (upcoming)
  • Detailed run information for easy debugging
  • Centralized dashboard for holistic view

AI Systems Tracing Apps

Log Inputs, Outputs and Actions of Executions 🤖 Visualize & Compare Executions Steps via UI 🔍
  • Track all the prompts, generations of LLMs
  • Track all the inputs, outputs of tools
  • Capture chains metadata
  • Deep dive into single execution steps
  • Compare executions side-by-side

🎬 Demos

Check out live Aim demos NOW to see it in action.

Tracing LangChain-based chatbot executions

View Demo  |  View Code

Tracing LlamaIndex query executions

View Demo  |  View Code

Tracking PyTorch-based CNN trainings

View Demo  |  View Code

🌍 Default logging apps

Aim comes pre-installed with a wide variety of apps. Here is the full list:

App Name Description Category Docs Source
base Base Aim app for general observability over anything logged with Aim. Includes base types to log common artifacts, such as Image, Audio object, Figure, Metric. Base docs source
docs Use this Aim app to access Aim docs. Docs - source
langchain_debugger Debugger for LangChain that logs LLMs prompts and generations, tools inputs/outputs, and chains metadata. AI Systems Tracing docs source
llamaindex_observer Debugger and observer for LlamaIndex. Logs metadata like retrieval nodes, queries and responses, embeddings chunks, etc. AI Systems Tracing docs source
experiment_tracker App for tracking and exploring ML experiments. Integrations with various ML libraries, including Acme, CatBoost, fastai, Hugging Face Transformers, Keras, Keras Tuner, LightGBM, MXNet, Optuna, PaddlePaddle, PyTorch Ignite, SDB3, and XGBoost. Experiment Tracking docs source

🏁 Quick start

Follow the steps below to get started with Aim.

1. Install Aim on your training environment

pip3 install aim

2. Integrate Aim with your code

from aimstack.base import Run, Metric

# Initialize a new run
run = Run()

# Log run parameters
run["hparams"] = {
    "learning_rate": 0.001,
    "batch_size": 32,
}

# Init a metric
metric = Metric(run, name='loss', context={'subset': 'training'})

for i in range(1000):
      metric.track(i, epoch=1)

3. Start Aim server

aim server

4. Start Aim UI

aim ui

🛣️ Roadmap

TODO:

👥 Community

Aim README badge

Add Aim badge to your README, if you've enjoyed using Aim in your work:

Aim

[![Aim](https://img.shields.io/badge/powered%20by-Aim-%231473E6)](https://github.com/aimhubio/aim)

Cite Aim in your papers

In case you've found Aim helpful in your research journey, we'd be thrilled if you could acknowledge Aim's contribution:

@software{Arakelyan_Aim_2020,
  author = {Arakelyan, Gor and Soghomonyan, Gevorg and {The Aim team}},
  doi = {10.5281/zenodo.6536395},
  license = {Apache-2.0},
  month = {6},
  title = {{Aim}},
  url = {https://github.com/aimhubio/aim},
  version = {3.9.3},
  year = {2020}
}

Contributing to Aim

Considering contibuting to Aim? To get started, please take a moment to read the CONTRIBUTING.md guide.

Join Aim contributors by submitting your first pull request. Happy coding! 😊

Made with contrib.rocks.

More questions?

  1. Read the docs
  2. Open a feature request or report a bug
  3. Join Discord community server
4.0.3 Oct 04, 2023
4.0.2 Oct 03, 2023
4.0.1 Oct 03, 2023
4.0.0 Sep 27, 2023
4.0.0b1 Sep 27, 2023
4.0.0a18 Sep 12, 2023
4.0.0a17 Aug 15, 2023
4.0.0a16 Aug 02, 2023
4.0.0a15 Jul 25, 2023
4.0.0a14 Jul 14, 2023
4.0.0a13 Jul 12, 2023
4.0.0a12 Jun 21, 2023
4.0.0a10 Jun 19, 2023
4.0.0a9 Jun 16, 2023
4.0.0a7 Jun 05, 2023
4.0.0.dev6 Jul 12, 2023
3.30.0.dev20250611 Jun 11, 2025
3.30.0.dev20250610 Jun 10, 2025
3.30.0.dev20250609 Jun 09, 2025
3.30.0.dev20250608 Jun 08, 2025
3.30.0.dev20250607 Jun 07, 2025
3.30.0.dev20250606 Jun 06, 2025
3.30.0.dev20250605 Jun 05, 2025
3.30.0.dev20250604 Jun 04, 2025
3.30.0.dev20250603 Jun 03, 2025
3.30.0.dev20250602 Jun 02, 2025
3.30.0.dev20250601 Jun 01, 2025
3.30.0.dev20250531 May 31, 2025
3.30.0.dev20250530 May 30, 2025
3.30.0.dev20250529 May 29, 2025
3.30.0.dev20250528 May 28, 2025
3.30.0.dev20250527 May 27, 2025
3.30.0.dev20250526 May 26, 2025
3.30.0.dev20250525 May 25, 2025
3.30.0.dev20250524 May 24, 2025
3.30.0.dev20250523 May 23, 2025
3.30.0.dev20250522 May 22, 2025
3.30.0.dev20250521 May 21, 2025
3.30.0.dev20250520 May 20, 2025
3.30.0.dev20250519 May 19, 2025
3.30.0.dev20250518 May 18, 2025
3.30.0.dev20250517 May 17, 2025
3.30.0.dev20250516 May 16, 2025
3.30.0.dev20250515 May 15, 2025
3.30.0.dev20250513 May 13, 2025
3.30.0.dev20250512 May 12, 2025
3.30.0.dev20250511 May 11, 2025
3.30.0.dev20250510 May 10, 2025
3.30.0.dev20250509 May 09, 2025
3.30.0.dev20250508 May 08, 2025
3.29.1 May 08, 2025
3.29.0 May 08, 2025
3.29.0.dev20250419 Apr 19, 2025
3.29.0.dev20250418 Apr 18, 2025
3.29.0.dev20250417 Apr 17, 2025
3.29.0.dev20250416 Apr 16, 2025
3.29.0.dev20250415 Apr 15, 2025
3.29.0.dev20250413 Apr 13, 2025
3.29.0.dev20250412 Apr 12, 2025
3.29.0.dev20250411 Apr 11, 2025
3.29.0.dev20250410 Apr 10, 2025
3.29.0.dev20250409 Apr 09, 2025
3.29.0.dev20250408 Apr 08, 2025
3.29.0.dev20250407 Apr 07, 2025
3.29.0.dev20250406 Apr 06, 2025
3.29.0.dev20250405 Apr 05, 2025
3.29.0.dev20250404 Apr 04, 2025
3.29.0.dev20250403 Apr 03, 2025
3.29.0.dev20250402 Apr 02, 2025
3.29.0.dev20250401 Apr 01, 2025
3.29.0.dev20250331 Mar 31, 2025
3.29.0.dev20250330 Mar 30, 2025
3.29.0.dev20250329 Mar 29, 2025
3.29.0.dev20250328 Mar 28, 2025
3.29.0.dev20250327 Mar 28, 2025
3.29.0.dev20250324 Mar 24, 2025
3.29.0.dev20250323 Mar 23, 2025
3.29.0.dev20250322 Mar 22, 2025
3.29.0.dev20250321 Mar 21, 2025
3.28.0 Mar 21, 2025
3.27.0 Dec 18, 2024
3.26.1 Dec 03, 2024
3.26.0.dev1 Nov 05, 2024
3.25.1 Nov 06, 2024
3.25.0 Oct 02, 2024
3.24.0 Aug 14, 2024
3.23.0 Jul 15, 2024
3.22.0 Jun 20, 2024
3.21.0 Jun 17, 2024
3.20.1 Jun 03, 2024
3.19.3 Apr 17, 2024
3.19.2 Mar 22, 2024
3.19.1 Mar 14, 2024
3.19.0 Mar 13, 2024
3.18.1 Feb 07, 2024
3.18.0 Feb 06, 2024
3.18.0.dev5 May 23, 2023
3.18.0.dev4 May 03, 2023
3.18.0.dev3 May 02, 2023
3.18.0.dev2 May 02, 2023
3.17.5 Jun 02, 2023
3.17.5rc4 Jan 10, 2024
3.17.5rc3 Jan 09, 2024
3.17.5rc2 Jan 09, 2024
3.17.5rc1 Jan 08, 2024
3.17.4 May 04, 2023
3.17.3 Apr 06, 2023
3.17.2 Mar 28, 2023
3.17.1 Mar 24, 2023
3.17.0 Mar 24, 2023
3.16.2 Mar 02, 2023
3.16.1 Feb 27, 2023
3.16.0 Feb 03, 2023
3.15.2 Dec 23, 2022
3.15.1 Dec 01, 2022
3.15.0 Nov 26, 2022
3.14.4 Nov 11, 2022
3.14.3 Oct 29, 2022
3.14.2 Oct 28, 2022
3.14.1 Oct 07, 2022
3.14.0 Oct 06, 2022
3.13.4 Sep 25, 2022
3.13.3 Sep 16, 2022
3.13.2 Sep 10, 2022
3.13.1 Sep 01, 2022
3.13.0 Aug 21, 2022
3.12.2 Aug 05, 2022
3.12.1 Aug 02, 2022
3.12.0 Jul 22, 2022
3.12.0.dev2 Jul 07, 2022
3.11.2 Jul 08, 2022
3.11.1 Jun 27, 2022
3.11.1.dev1 Jun 25, 2022
3.11.0 Jun 21, 2022
3.11.0.dev4 Jun 20, 2022
3.10.3 May 31, 2022
3.10.2 May 26, 2022
3.10.1 May 18, 2022
3.10.0 May 17, 2022
3.10.0.dev9 May 16, 2022
3.9.4 May 11, 2022
3.9.3 May 10, 2022
3.9.2 Apr 29, 2022
3.9.0a14 Apr 05, 2022
3.9.0a1 Apr 07, 2022
3.8.1 Apr 06, 2022
3.8.0 Mar 25, 2022
3.7.5 Mar 17, 2022
3.7.4 Mar 15, 2022
3.7.3 Mar 14, 2022
3.7.2 Mar 10, 2022
3.7.1 Mar 10, 2022
3.7.0 Mar 09, 2022
3.6.3 Mar 04, 2022
3.6.2 Mar 02, 2022
3.6.1 Feb 25, 2022
3.6.0 Feb 21, 2022
3.5.4 Feb 15, 2022
3.5.3 Feb 11, 2022
3.5.2 Feb 10, 2022
3.5.1 Feb 04, 2022
3.5.0 Feb 03, 2022
3.4.1 Jan 23, 2022
3.4.0 Jan 22, 2022
3.3.5 Jan 14, 2022
3.3.4 Jan 10, 2022
3.3.3 Dec 24, 2021
3.3.2 Dec 19, 2021
3.3.1 Dec 18, 2021
3.3.0 Dec 17, 2021
3.2.2 Dec 11, 2021
3.2.1 Dec 08, 2021
3.2.0 Dec 03, 2021
3.1.1 Nov 25, 2021
3.1.0 Nov 19, 2021
3.0.7 Nov 18, 2021
3.0.6 Nov 09, 2021
3.0.5 Nov 08, 2021
3.0.4 Nov 08, 2021
3.0.3 Nov 04, 2021
3.0.2 Oct 27, 2021
3.0.1 Oct 22, 2021
3.0.0 Oct 21, 2021
2.7.4 Oct 11, 2021
2.7.3 Oct 06, 2021
2.7.2 Oct 06, 2021
2.7.1 Jun 30, 2021
2.7.0 Jun 23, 2021
2.6.0 Jun 12, 2021
2.5.0 May 27, 2021
2.4.0 May 13, 2021
2.3.0 Apr 10, 2021
2.2.1 Mar 31, 2021
2.2.0 Mar 24, 2021
2.1.6 Feb 26, 2021
2.1.5 Jan 07, 2021
2.1.4 Dec 02, 2020
2.1.3 Nov 23, 2020
2.1.2 Nov 23, 2020
2.1.1 Nov 22, 2020
2.1.0 Nov 19, 2020
2.0.27 Nov 13, 2020
2.0.26 Nov 10, 2020
2.0.25 Nov 09, 2020
2.0.24 Nov 08, 2020
2.0.23 Nov 05, 2020
2.0.22 Nov 05, 2020
2.0.21 Nov 01, 2020
2.0.20 Oct 26, 2020
2.0.19 Oct 26, 2020

Wheel compatibility matrix

Platform CPython 3.7 CPython 3.8 CPython 3.9 CPython 3.10 CPython 3.11
macosx_10_14_x86_64
macosx_11_0_arm64
manylinux2014_x86_64
manylinux_2_17_x86_64
manylinux_2_24_x86_64

Files in release

Extras: None
Dependencies:
aim-ui (==4.0.3)
aimrocks (==0.5.1)
khash (==0.5.0a5)
cachetools (>=4.0.0)
click (>=7.0)
cryptography (>=3.0)
filelock (<4,>=3.3.0)
numpy (<2,>=1.12.0)
psutil (>=5.6.7)
RestrictedPython (>=5.1)
tqdm (>=4.20.0)
alembic (<2,>=1.5.0)
fastapi (<1,>=0.69.0)
jinja2 (<4,>=2.10.0)
SQLAlchemy (>=1.4.1)
uvicorn (<1,>=0.12.0)
Pillow (>=8.0.0)
packaging (>=15.0)
websockets
watchdog
requests
segment-analytics-python
importlib-metadata
tabulate