Monitoring Dashboard

​

Dashboard Overview

• Real-time security events and threat detection
• Usage analytics and API consumption
• Performance metrics and latency monitoring
• Error rates and system health
• Cost tracking and billing information

​

Security Monitoring

​

Threat Detection

• Blocked Requests: Requests stopped by security policies
• Redacted Content: PII and sensitive data automatically masked
• Attack Patterns: Common injection and jailbreak attempts
• Risk Scores: Threat level assessment for each request

​

Security Analytics

• Threat Volume: Number of security events per day/hour
• Attack Types: Distribution of different threat categories
• False Positives: Requests incorrectly flagged as threats
• Policy Effectiveness: Success rate of security policies

​

Event Details

• Request Content: Original prompt (sanitized for display)
• Detection Reason: Why the request was flagged
• Risk Score: Numerical threat assessment
• Response Action: Block, redact, or allow decision
• Timestamp: When the event occurred

​

Usage Analytics

​

API Metrics

• Request Volume: Total requests per time period
• Model Usage: Distribution across different AI models
• Provider Split: Usage between OpenAI, Anthropic, etc.
• Success Rates: Percentage of successful requests

​

Cost Tracking

• Token Consumption: Input and output token usage
• Cost per Model: Spending breakdown by AI model
• Monthly Trends: Cost patterns over time
• Budget Alerts: Notifications when approaching limits

​

Geographic Distribution

• Request Origins: Geographic source of API calls
• Latency by Region: Performance across different locations
• Regional Security Events: Threat patterns by geography

​

Performance Monitoring

​

Latency Metrics

• Average Latency: Mean response time across all requests
• P95/P99 Latency: High-percentile response times
• PromptGuard Overhead: Additional processing time
• Provider Latency: Underlying AI service performance

​

System Health

• Uptime: Service availability percentage
• Error Rates: Failed request percentage
• Rate Limits: Current usage against limits
• Capacity: System load and performance

​

Performance Trends

• Daily/Weekly Patterns: Performance trends
• Peak Usage: High-traffic periods
• Degradation Alerts: Performance issue notifications

​

Alerts and Notifications

​

Security Alerts

• High-Risk Requests: Immediate alerts for severe threats
• Unusual Patterns: Notifications for anomalous behavior
• Policy Violations: Alerts when rules are triggered
• Failed Authentication: Invalid API key usage

​

Performance Alerts

• High Latency: Response time threshold alerts
• Error Rate Spikes: Increased failure notifications
• Rate Limit Warnings: Approaching usage limits
• Downtime Alerts: Service availability issues

​

Usage Alerts

• Budget Thresholds: Spending limit notifications
• Usage Spikes: Unusual activity patterns
• Token Limits: Approaching consumption caps
• Billing Alerts: Payment and subscription issues

​

Custom Dashboards

​

Dashboard Widgets

• Metric Charts: Time-series graphs of key metrics
• Status Indicators: Current system health status
• Top Lists: Most active users, models, endpoints
• Trend Analysis: Period-over-period comparisons

​

Filtering and Segmentation

• Time Ranges: Last hour, day, week, month
• API Keys: Specific application or environment
• Models: Filter by AI model type
• Security Policies: View by policy configuration

​

Reporting

​

Automated Reports

• Daily Security Summary: Security events and trends
• Weekly Usage Report: API consumption and costs
• Monthly Analytics: Comprehensive usage analysis
• Custom Reports: Tailored to your specific needs

​

Export Options

• CSV Export: Raw data for spreadsheet analysis
• JSON API: Programmatic access to metrics
• PDF Reports: Formatted reports for stakeholders
• Dashboard Screenshots: Visual snapshots

​

API Access

​

Dashboard Analytics API ✅

# Get analytics stats (dashboard API - requires session cookie)
curl https://api.promptguard.co/dashboard/analytics/stats \
  -H "Cookie: session=YOUR_SESSION_COOKIE" \
  -G -d "days=7"

# Get timeseries data
curl https://api.promptguard.co/dashboard/analytics/timeseries \
  -H "Cookie: session=YOUR_SESSION_COOKIE" \
  -G -d "days=7" \
  -d "interval=day"

# Get threat distribution
curl https://api.promptguard.co/dashboard/analytics/threats \
  -H "Cookie: session=YOUR_SESSION_COOKIE" \
  -G -d "days=7"

​

Developer Usage API ✅

# Get current usage statistics (developer API - requires API key)
curl https://api.promptguard.co/api/v1/usage/stats \
  -H "X-API-Key: YOUR_PROMPTGUARD_API_KEY"

​

Roadmap Features 🚧

# PLANNED - Not yet available
# Get security events
curl https://api.promptguard.co/api/v1/metrics/security \
  -H "X-API-Key: YOUR_PROMPTGUARD_API_KEY" \
  -G -d "start_date=2024-01-01" \
  -d "end_date=2024-01-31"

# Get performance metrics
curl https://api.promptguard.co/api/v1/metrics/performance \
  -H "X-API-Key: YOUR_PROMPTGUARD_API_KEY" \
  -G -d "metric=latency"

​

Webhook Integration

// Example webhook payload for security event
{
  "event_type": "security.threat_detected",
  "timestamp": "2024-01-15T10:30:00Z",
  "request_id": "req_abc123",
  "threat_type": "prompt_injection",
  "risk_score": 0.95,
  "action": "blocked",
  "metadata": {
    "model": "gpt-4o",
    "user_id": "user_123"
  }
}

​

Mobile Access

​

Mobile Dashboard

• Responsive Design: Optimized for mobile viewing
• Key Metrics: Essential information at a glance
• Push Notifications: Critical alerts on mobile
• Offline Support: View cached data without connection

​

Next Steps

​

Dashboard Tips