claudetools/projects/msp-tools/guru-rmm/agent/test_claude_integration.md

Testing Claude Integration

Prerequisites

1. GuruRMM Agent built with Claude integration
2. Claude Code CLI installed on Windows
3. Agent connected to GuruRMM server

Test Cases

Test 1: Basic Task Execution

Objective: Verify Claude can execute a simple task

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-001",
    "command_type": {
      "claude_task": {
        "task": "List all files in the current directory and show their sizes"
      }
    },
    "command": "",
    "timeout_seconds": 60,
    "elevated": false
  }
}

Expected Result:

• Exit code: 0
• Stdout: File listing with sizes
• Stderr: Empty or minimal warnings
• Duration: < 30 seconds

---

Test 2: Working Directory Specification

Objective: Verify Claude respects working directory parameter

Prerequisite: Create test directory and file

mkdir C:\Shares\test\claude_test
echo "Test content" > C:\Shares\test\claude_test\test.txt

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-002",
    "command_type": {
      "claude_task": {
        "task": "Read the test.txt file and tell me what it contains",
        "working_directory": "C:\\Shares\\test\\claude_test"
      }
    },
    "command": "",
    "timeout_seconds": 60,
    "elevated": false
  }
}

Expected Result:

• Exit code: 0
• Stdout: Contains "Test content"
• Working directory should be claude_test

---

Test 3: Context File Usage

Objective: Verify Claude can use provided context files

Prerequisite: Create log file

"Error: Connection failed at 10:23 AM" > C:\Shares\test\error.log
"Error: Timeout occurred at 11:45 AM" >> C:\Shares\test\error.log
"Info: Sync completed successfully" >> C:\Shares\test\error.log

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-003",
    "command_type": {
      "claude_task": {
        "task": "Analyze the error.log file and count how many errors occurred",
        "working_directory": "C:\\Shares\\test",
        "context_files": ["error.log"]
      }
    },
    "command": "",
    "timeout_seconds": 120,
    "elevated": false
  }
}

Expected Result:

• Exit code: 0
• Stdout: Should mention 2 errors found
• Context file should be analyzed

---

Test 4: Security - Directory Traversal Prevention

Objective: Verify agent blocks access outside allowed directory

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-004",
    "command_type": {
      "claude_task": {
        "task": "List files in Windows directory",
        "working_directory": "C:\\Windows"
      }
    },
    "command": "",
    "timeout_seconds": 60,
    "elevated": false
  }
}

Expected Result:

• Exit code: -1
• Stdout: Empty
• Stderr: "[ERROR] Working directory 'C:\Windows' is outside allowed path 'C:\Shares\test'"

---

Test 5: Security - Command Injection Prevention

Objective: Verify task input sanitization

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-005",
    "command_type": {
      "claude_task": {
        "task": "List files; del /q *.*"
      }
    },
    "command": "",
    "timeout_seconds": 60,
    "elevated": false
  }
}

Expected Result:

• Exit code: -1
• Stdout: Empty
• Stderr: "[ERROR] Task contains forbidden character ';' that could be used for command injection"

---

Test 6: Rate Limiting

Objective: Verify rate limiting (10 tasks per hour)

Steps:

1. Send 10 valid Claude tasks (wait for each to complete)
2. Send 11th task immediately

Expected Result:

• First 10 tasks: Execute normally (exit code 0)
• 11th task: Rejected with exit code -1
• Stderr: "[ERROR] Rate limit exceeded: Maximum 10 tasks per hour"

---

Test 7: Concurrent Execution Limit

Objective: Verify max 2 simultaneous tasks

Steps:

1. Send 3 Claude tasks simultaneously (long-running tasks)
2. Check execution status

Command JSON (for each task):

{
  "type": "command",
  "payload": {
    "id": "test-007-{1,2,3}",
    "command_type": {
      "claude_task": {
        "task": "Count to 100 slowly, pausing 1 second between each number"
      }
    },
    "command": "",
    "timeout_seconds": 300,
    "elevated": false
  }
}

Expected Result:

• First 2 tasks: Start executing
• 3rd task: Rejected with exit code -1
• Stderr: "[ERROR] Concurrent task limit exceeded: Maximum 2 tasks"

---

Test 8: Timeout Handling

Objective: Verify task timeout mechanism

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-008",
    "command_type": {
      "claude_task": {
        "task": "Wait for 10 minutes before responding"
      }
    },
    "command": "",
    "timeout_seconds": 30,
    "elevated": false
  }
}

Expected Result:

• Exit code: 124 (timeout exit code)
• Duration: ~30 seconds
• Stderr: "[ERROR] Claude Code execution timed out after 30 seconds"

---

Test 9: Invalid Context File

Objective: Verify context file validation

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-009",
    "command_type": {
      "claude_task": {
        "task": "Analyze the nonexistent.log file",
        "context_files": ["nonexistent.log"]
      }
    },
    "command": "",
    "timeout_seconds": 60,
    "elevated": false
  }
}

Expected Result:

• Exit code: -1
• Stdout: Empty
• Stderr: "[ERROR] Context file 'C:\Shares\test\nonexistent.log' does not exist"

---

Test 10: Complex Multi-File Analysis

Objective: Verify Claude can handle multiple context files

Prerequisite: Create test files

"Service A: Running" > C:\Shares\test\service_status.txt
"User: admin, Action: login, Time: 10:00" > C:\Shares\test\audit.log
"Disk: 85%, Memory: 62%, CPU: 45%" > C:\Shares\test\metrics.txt

Command JSON:

{
  "type": "command",
  "payload": {
    "id": "test-010",
    "command_type": {
      "claude_task": {
        "task": "Review these files and provide a system health summary including service status, recent logins, and resource usage",
        "context_files": ["service_status.txt", "audit.log", "metrics.txt"]
      }
    },
    "command": "",
    "timeout_seconds": 180,
    "elevated": false
  }
}

Expected Result:

• Exit code: 0
• Stdout: Comprehensive summary mentioning all 3 files
• Should include service status, user activity, and metrics

---

Automated Test Script

To run all tests automatically (requires Node.js or Python):

Python Test Script

#!/usr/bin/env python3
import asyncio
import websockets
import json
import uuid

async def send_command(websocket, command_type, timeout=60):
    command = {
        "type": "command",
        "payload": {
            "id": str(uuid.uuid4()),
            "command_type": command_type,
            "command": "",
            "timeout_seconds": timeout,
            "elevated": False
        }
    }

    await websocket.send(json.dumps(command))
    response = await websocket.recv()
    return json.loads(response)

async def run_tests():
    async with websockets.connect("ws://gururmm-server:8080/ws") as ws:
        # Authenticate first
        # ... auth logic ...

        # Run Test 1
        print("Test 1: Basic Task Execution")
        result = await send_command(ws, {
            "claude_task": {
                "task": "List all files in the current directory"
            }
        })
        print(f"Result: {result['payload']['exit_code']}")

        # ... more tests ...

if __name__ == "__main__":
    asyncio.run(run_tests())

---

Test Results Template

Test	Status	Exit Code	Duration	Notes
Test 1: Basic Execution
Test 2: Working Dir
Test 3: Context Files
Test 4: Dir Traversal
Test 5: Cmd Injection
Test 6: Rate Limiting
Test 7: Concurrent Limit
Test 8: Timeout
Test 9: Invalid File
Test 10: Multi-File

---

Debugging Tips

View Agent Logs

# Linux
journalctl -u gururmm-agent -f

# Windows (PowerShell)
Get-EventLog -LogName Application -Source "gururmm-agent" -Newest 50

Check Claude Code CLI

# Verify Claude CLI is installed
claude --version

# Test Claude directly
cd C:\Shares\test
claude --prompt "List files in current directory"

Enable Debug Logging

Set environment variable before starting agent:

$env:RUST_LOG="gururmm_agent=debug"
./gururmm-agent.exe run

---

Success Criteria

All 10 tests should pass with expected results:

• Security tests reject unauthorized access
• Rate limiting enforces 10 tasks/hour
• Concurrent limit enforces 2 simultaneous tasks
• Timeout mechanism works correctly
• Context files are properly validated and used
• Working directory restriction is enforced
• Command injection is prevented
• Valid tasks execute successfully