---
title: Transformers Modular Refactor
emoji: 😻
colorFrom: yellow
colorTo: gray
sdk: gradio
sdk_version: 5.39.0
app_file: app.py
pinned: false
license: mit
short_description: Interactive analyzer for modular models in Transformers lib
---

# 🔍 Transformers Modular Refactor Analyzer

This interactive tool helps analyze modular refactoring opportunities in the HuggingFace Transformers library by visualizing model relationships, similarity patterns, and the impact of modularization on code maintainability.

## 📊 Features Overview

### 🕒 **Tab 1: Chronological Timeline**
Interactive timeline showing the evolution of transformer models with modular dependencies positioned by their creation dates.

**Key Features:**
- Models positioned chronologically by git history
- Modular dependency connections between models
- Similarity scores between candidate models (red dashed edges)
- Timeline axis with year/month markers
- **Modular Logic Milestone**: May 31, 2024 marker showing when modular logic was introduced
- Search functionality to highlight specific models and their connections
- Zoom and pan to explore the full timeline

**Visual Legend:**
- 🟡 **Base models**: Foundation models that others depend on
- 🔵 **Modular models**: Models with existing `modular_*.py` implementations
- 🔴 **Candidate models**: Models without modular implementations (refactoring opportunities)
- **Blue edges**: Import dependencies between modular implementations
- **Red dashed edges**: High similarity scores indicating refactoring potential

### 📈 **Tab 2: LOC Growth**
Chart visualizing how modular refactoring impacts Lines of Code (LOC) over time in the transformers repository.

**Metrics Tracked:**
- **Effective LOC**: Total maintainable code (modeling LOC for non-modular + modular LOC)
- **Modular LOC**: Lines of code in `modular_*.py` files
- **Modeling LOC (all)**: Total lines in all `modeling_*.py` files
- **Modeling LOC (included)**: Lines in `modeling_*.py` files for models without modular versions

**Key Insights:**
- Shows the trajectory toward reduced code duplication
- Demonstrates how modular refactoring can reduce total maintainable code
- May 31, 2024 annotation marks the introduction of modular logic
- Interactive chart with time-series data from git history

### 🌐 **Tab 3: Dependency Graph**
Static network visualization focusing on model relationships and similarity patterns without chronological constraints.

**Features:**
- Force-directed graph layout optimized for relationship visibility
- Toggle to show/hide candidate models and similarity edges
- Node sizes reflect connection degree (more connected = larger)
- Interactive drag-and-drop for graph exploration
- Zoom and pan capabilities

**Analysis Capabilities:**
- Identify clusters of highly similar models (refactoring targets)
- Understand modular dependency patterns
- Spot potential consolidation opportunities
- Explore the current modular architecture

### Filtering Options
- **Similarity Threshold**: Adjustable cutoff for showing similarity edges (0.5-0.95)
- **Multimodal Filter**: Focus on models with multimodal capabilities (models mentioning "pixel_values")
- **Show/Hide Candidates**: Toggle visibility of non-modular models and their similarities

---

*Built with Gradio, D3.js, and ApexCharts for interactive data visualization*