Skip to content
@ndif-team

National Deep Inference Fabric

The National Deep Inference Fabric is a proposed research computing project that will enable us to crack open the mysteries inside large-scale AI

National Deep Inference Fabric

A research computing project enabling transparent and reproducible experiments on large-scale AI systems.


Projects

nnsight

nnsight

A Python library for interpreting and manipulating the internals of deep learning models. Access activations, modify them to study causal effects, compute gradients, and batch interventions efficiently.

Documentation | GitHub | Paper

pip install nnsight

NDIF

NDIF

The National Deep Inference Fabric — a nationwide research computing infrastructure enabling scientists and students to perform transparent experiments on running AI models without local GPU resources.

Website | GitHub | Paper

pip install ndif

nnterp

nnterp

A unified interface for mechanistic interpretability of transformers. Built on NNsight, it provides standardized naming conventions across all transformer architectures with built-in interventions like logit lens, patchscope, and activation steering.

Documentation | GitHub | Paper

pip install nnterp

Workbench

Workbench

A UI for doing exploratory analysis on open source AI models by applying interpretability techniques. Leverages both NNsight and NDIF to provide an interactive environment for exploring LLM internals.

Use Workbench now! | GitHub


Join the community

Discord | Forum | Twitter

Pinned Loading

  1. nnsight nnsight Public

    The nnsight package enables interpreting and manipulating the internals of deep learned models.

    Python 767 65

Repositories

Showing 10 of 11 repositories

Most used topics

Loading…