Modernize Monorepo Structure with pnpm Workspaces and Turborepo

Modernize Monorepo Structure with pnpm Workspaces and Turborepo

Summary

Propose to migrate the current npm-based monorepo to a more modern and efficient setup using pnpm workspaces and Turborepo for improved developer experience, build performance, and dependency management.

Current State

Currently, the Codex monorepo:

• Uses npm for package management
• Has manual coordination between packages
• Lacks efficient caching for builds and tests
• Requires manual configuration of cross-package dependencies
• Has inconsistent script naming across packages

Proposed Solution

Migrate to a modern monorepo setup with:

1. pnpm as the package manager:

• Faster installation with content-addressable store
• Efficient disk space usage with symlinks
• Strict dependency management preventing phantom dependencies
• Built-in workspaces support

1. Turborepo for build orchestration:

• Intelligent task scheduling and parallelization
• Local and remote caching for faster builds
• Dependency graph awareness
• Consistent script naming conventions

Benefits

• Faster CI/CD pipelines: Turborepo's caching can dramatically reduce build times
• Improved developer experience: Consistent commands across packages
• Better dependency management: pnpm prevents phantom dependencies
• Reduced disk usage: pnpm's content-addressable store saves significant space
• Simplified onboarding: Single command to install all dependencies
• Better cross-package development: Automatic linking of local packages

Implementation Plan

1. Add pnpm-workspace.yaml at the root
2. Convert existing package.json files to be workspace-compatible
3. Add turbo.json configuration for build pipelines
4. Update CI/CD workflows to use pnpm and Turborepo
5. Update documentation and contributor guides
6. Add proper workspace scripts for common operations

Example Configuration

# pnpm-workspace.yaml
packages:
  - 'codex-cli'
  - 'future-packages/*'// turbo.json
{
  "$schema": "[https://turbo.build/schema.json",](https://turbo.build/schema.json",)
  "pipeline": {
    "build": {
      "dependsOn": ["^build"],
      "outputs": ["dist/**"]
    },
    "test": {
      "dependsOn": ["build"],
      "inputs": ["src/**/*.ts", "tests/**/*.ts"]
    },
    "lint": {},
    "format": {},
    "dev": {
      "cache": false,
      "persistent": true
    }
  }
}