azcomputerguru/claudetools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
55936579b67e8755802cb9568c49f0f1924f4f6b
claudetools/scripts/README.md
Mike Swanson 89e5118306 Remove conversation context/recall system from ClaudeTools 
Completely removed the database context recall system while preserving
database tables for safety. This major cleanup removes 80+ files and
16,831 lines of code.

What was removed:
- API layer: 4 routers (conversation-contexts, context-snippets,
  project-states, decision-logs) with 35+ endpoints
- Database models: 5 models (ConversationContext, ContextSnippet,
  DecisionLog, ProjectState, ContextTag)
- Services: 4 service layers with business logic
- Schemas: 4 Pydantic schema files
- Claude Code hooks: 13 hook files (user-prompt-submit, task-complete,
  sync-contexts, periodic saves)
- Scripts: 15+ scripts (import, migration, testing, tombstone checking)
- Tests: 5 test files (context recall, compression, diagnostics)
- Documentation: 30+ markdown files (guides, architecture, quick starts)
- Utilities: context compression, conversation parsing

Files modified:
- api/main.py: Removed router registrations
- api/models/__init__.py: Removed model imports
- api/schemas/__init__.py: Removed schema imports
- api/services/__init__.py: Removed service imports
- .claude/claude.md: Completely rewritten without context references

Database tables preserved:
- conversation_contexts, context_snippets, context_tags,
  project_states, decision_logs (5 orphaned tables remain for safety)
- Migration created but NOT applied: 20260118_172743_remove_context_system.py
- Tables can be dropped later when confirmed not needed

New files added:
- CONTEXT_SYSTEM_REMOVAL_SUMMARY.md: Detailed removal report
- CONTEXT_SYSTEM_REMOVAL_COMPLETE.md: Final status
- CONTEXT_EXPORT_RESULTS.md: Export attempt results
- scripts/export-tombstoned-contexts.py: Export tool for future use
- migrations/versions/20260118_172743_remove_context_system.py

Impact:
- Reduced from 130 to 95 API endpoints
- Reduced from 43 to 38 active database tables
- Removed 16,831 lines of code
- System fully operational without context recall

Reason for removal:
- System was not actively used (no tombstoned contexts found)
- Reduces codebase complexity
- Focuses on core MSP work tracking functionality
- Database preserved for safety (can rollback if needed)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-01-18 19:10:41 -07:00

4.2 KiB
Raw Blame History

ClaudeTools Scripts

Utility scripts for managing the ClaudeTools system.

Core Scripts

Context Recall System

setup-context-recall.sh

  • One-time setup for context recall system
  • Configures JWT authentication
  • Tests API connectivity

test-context-recall.sh

  • Verify context recall system functionality
  • Test API endpoints
  • Check compression

Conversation Import & Archive

import-conversations.py

  • Import conversation JSONL files to database
  • Extract and compress conversation context
  • Tag extraction and categorization
  • Optional tombstone creation with --create-tombstones

archive-imported-conversations.py

  • Archive imported conversation files
  • Create tombstone markers
  • Move files to archived/ subdirectories
  • Database verification (optional)

check-tombstones.py

  • Verify tombstone integrity
  • Validate JSON structure
  • Check archived files exist
  • Database context verification

TOMBSTONE_QUICK_START.md

  • Quick reference for tombstone system
  • Common commands
  • Troubleshooting tips

Database & Testing

test_db_connection.py

  • Test database connectivity
  • Verify credentials
  • Check table access

test-server.sh

  • Start development server
  • Run basic API tests

MCP Servers

setup-mcp-servers.sh

  • Configure Model Context Protocol servers
  • Setup GitHub, Filesystem, Sequential Thinking

Tombstone System (NEW)

Archive imported conversation files with small marker files.

Quick Start

# Archive all imported files
python scripts/archive-imported-conversations.py --skip-verification

# Verify tombstones
python scripts/check-tombstones.py

# Check space savings
du -sh imported-conversations/

Documentation

  • TOMBSTONE_QUICK_START.md - Quick reference
  • ../TOMBSTONE_SYSTEM.md - Complete documentation
  • ../TOMBSTONE_IMPLEMENTATION_SUMMARY.md - Implementation details

Expected Results

  • 549 tombstone files (~1 MB)
  • 549 archived files in subdirectories
  • 99%+ space reduction in active directory

Usage Patterns

Initial Setup

# 1. Setup context recall
bash scripts/setup-context-recall.sh

# 2. Setup MCP servers (optional)
bash scripts/setup-mcp-servers.sh

# 3. Test database connection
python scripts/test_db_connection.py

Import Conversations

# Import with automatic tombstones
python scripts/import-conversations.py --create-tombstones

# Or import first, archive later
python scripts/import-conversations.py
python scripts/archive-imported-conversations.py --skip-verification

Verify System

# Test context recall
bash scripts/test-context-recall.sh

# Check tombstones
python scripts/check-tombstones.py

# Test API
bash scripts/test-server.sh

Script Categories

Setup & Configuration

  • setup-context-recall.sh
  • setup-mcp-servers.sh

Import & Archive

  • import-conversations.py
  • archive-imported-conversations.py
  • check-tombstones.py

Testing & Verification

  • test_db_connection.py
  • test-context-recall.sh
  • test-server.sh
  • test-tombstone-system.sh

Utilities

  • Various helper scripts

Common Commands

# Start API server
uvicorn api.main:app --reload

# Import conversations
python scripts/import-conversations.py

# Archive files
python scripts/archive-imported-conversations.py --skip-verification

# Check system health
python scripts/check-tombstones.py
bash scripts/test-context-recall.sh

# Database connection test
python scripts/test_db_connection.py

Requirements

Most scripts require:

  • Python 3.8+
  • Virtual environment activated (api\venv\Scripts\activate)
  • .env file configured (see .env.example)
  • Database access (172.16.3.30:3306)

Environment Variables

Scripts use these from .env:

DATABASE_URL=mysql+pymysql://user:pass@172.16.3.30:3306/claudetools
JWT_TOKEN=your-jwt-token-here
API_USER_EMAIL=user@example.com
API_USER_PASSWORD=your-password

Documentation

  • TOMBSTONE_QUICK_START.md - Tombstone system quick start
  • ../TOMBSTONE_SYSTEM.md - Complete tombstone documentation
  • ../.claude/CONTEXT_RECALL_QUICK_START.md - Context recall guide
  • ../CONTEXT_RECALL_SETUP.md - Full setup instructions

Last Updated: 2026-01-18 Version: 1.0

Reference in New Issue View Git Blame Copy Permalink