First commit

Signed-off-by: Elena Kolevska <elena@kolevska.com>

Author: elena-kolevska

.env.example

@@ -0,0 +1,65 @@
+# Redis Connection Configuration
+REDIS_HOST=localhost
+REDIS_PORT=6379
+REDIS_PASSWORD=
+REDIS_DATABASE=0
+REDIS_CLUSTER=false
+REDIS_CLUSTER_NODES=
+REDIS_SSL=false
+REDIS_SSL_CERT_REQS=required
+REDIS_SSL_CA_CERTS=
+REDIS_SSL_CERTFILE=
+REDIS_SSL_KEYFILE=
+REDIS_SOCKET_TIMEOUT=5.0
+REDIS_SOCKET_CONNECT_TIMEOUT=5.0
+REDIS_MAX_CONNECTIONS=50
+REDIS_RETRY_ATTEMPTS=3
+REDIS_RETRY_DELAY=0.1
+REDIS_EXPONENTIAL_BACKOFF=true
+
+# Test Configuration
+TEST_CLIENT_INSTANCES=1
+TEST_CONNECTIONS_PER_CLIENT=10
+TEST_THREADS_PER_CLIENT=4
+TEST_DURATION=
+TEST_TARGET_OPS_PER_SECOND=
+TEST_WORKLOAD_PROFILE=basic_rw
+TEST_OPERATIONS=SET,GET
+TEST_OPERATION_WEIGHTS=
+TEST_KEY_PREFIX=test_key
+TEST_KEY_RANGE=10000
+TEST_VALUE_SIZE_MIN=100
+TEST_VALUE_SIZE_MAX=1000
+TEST_READ_WRITE_RATIO=0.7
+TEST_USE_PIPELINE=false
+TEST_PIPELINE_SIZE=10
+TEST_ASYNC_MODE=false
+TEST_PUBSUB_CHANNELS=
+TEST_TRANSACTION_SIZE=5
+
+# Logging Configuration
+LOG_LEVEL=INFO
+LOG_FILE=
+
+# Metrics Configuration
+METRICS_ENABLED=true
+METRICS_PORT=8000
+METRICS_INTERVAL=5
+PROMETHEUS_SCRAPE_INTERVAL=5s
+OTEL_EXPORT_INTERVAL=5000
+GRAFANA_REFRESH_INTERVAL=5s
+
+# OpenTelemetry Configuration
+OTEL_ENABLED=true
+OTEL_SERVICE_NAME=redis-py-test-app
+OTEL_SERVICE_VERSION=1.0.0
+OTEL_EXPORTER_OTLP_ENDPOINT=
+OTEL_EXPORTER_OTLP_HEADERS=
+OTEL_EXPORTER_OTLP_TIMEOUT=10
+OTEL_EXPORTER_JAEGER_ENDPOINT=
+OTEL_RESOURCE_ATTRIBUTES=service.name=redis-py-test-app,service.version=1.0.0
+
+# Output Configuration
+OUTPUT_FILE=
+QUIET=false
+CONFIG_FILE=

.gitignore

@@ -0,0 +1,5 @@
+/__pycache__
+/.env
+/.env.docker
+.idea
+/lettuce-test-app

DOCKER_SETUP.md

@@ -0,0 +1,170 @@
+# Redis Test App - Docker Setup
+
+Simple Docker-based setup for running the Redis testing application with full monitoring capabilities.
+
+## 🚀 Quick Start
+
+### Prerequisites
+- Docker and Docker Compose installed
+- At least 4GB RAM available
+
+### Run Everything
+```bash
+./setup.sh
+```
+
+That's it! The script will:
+- Build the Redis test application
+- Start Redis database
+- Start monitoring services (Prometheus, Grafana, Jaeger)
+- Run the test workload
+
+## 📊 Access Points
+
+After running `./setup.sh`, you can access:
+
+- **Application Metrics**: http://localhost:8000/metrics
+- **Grafana Dashboards**: http://localhost:3000 (admin/admin)
+- **Prometheus**: http://localhost:9090
+- **Jaeger Tracing**: http://localhost:16686
+- **Redis Database**: localhost:6379
+
+## 🔧 Customization
+
+### Change Test Workload
+Edit `docker-compose.yml` and modify the command section:
+
+```yaml
+command: >
+  python main.py
+  --workload-profile basic_rw          # Change workload type
+  --duration 1800                      # Change duration (seconds)
+  --target-ops-per-second 500          # Change target throughput
+```
+
+Available workload profiles:
+- `basic_rw` - Basic read/write operations
+- `high_throughput` - High-performance testing
+- `list_operations` - List-based operations
+- `pubsub_test` - Pub/Sub testing
+- `transaction_test` - Transaction testing
+
+### Restart with New Configuration
+```bash
+docker-compose restart redis-test-app
+```
+
+## 📝 Management Commands
+
+### View Logs
+```bash
+# All services
+docker-compose logs -f
+
+# Just the test app
+docker-compose logs -f redis-test-app
+
+# Just Redis
+docker-compose logs -f redis
+```
+
+### Check Status
+```bash
+docker-compose ps
+```
+
+### Stop Services
+```bash
+docker-compose down
+```
+
+### Complete Cleanup
+```bash
+# Stop services only
+./cleanup.sh
+
+# Stop and remove data
+./cleanup.sh --remove-data
+
+# Stop, remove data and images
+./cleanup.sh --remove-data --remove-images
+```
+
+## 🎯 Use Cases
+
+### Local Development
+- Test Redis performance
+- Debug connection issues
+- Monitor application metrics
+- Analyze traces
+
+### Performance Testing
+- Run long-duration tests
+- Monitor memory usage
+- Track performance over time
+- Detect memory leaks
+
+### Cloud Deployment
+The same Docker setup can be deployed to:
+- AWS ECS/EKS
+- Google Cloud Run/GKE
+- Azure Container Instances/AKS
+- Any Docker-compatible platform
+
+## 🔍 Monitoring
+
+### Key Metrics Available
+- **Operations per second** by operation type
+- **Latency percentiles** (50th, 95th, 99th)
+- **Error rates** and error types
+- **Connection health** and reconnections
+- **Memory and CPU usage**
+
+### Grafana Dashboards
+Pre-configured dashboards show:
+- Redis operation performance
+- Application health
+- Error tracking
+- Resource utilization
+
+### Distributed Tracing
+Jaeger provides detailed traces for:
+- Individual Redis operations
+- Connection management
+- Error propagation
+- Performance bottlenecks
+
+## 🛠️ Troubleshooting
+
+### Services Won't Start
+```bash
+# Check Docker is running
+docker info
+
+# Check logs for errors
+docker-compose logs
+
+# Restart everything
+./cleanup.sh && ./setup.sh
+```
+
+### High Resource Usage
+- Reduce test duration or throughput
+- Adjust metrics retention in Prometheus
+- Scale down monitoring services if needed
+
+### Port Conflicts
+If ports are already in use, modify `docker-compose.yml`:
+- Change `8000:8000` to `8001:8000` for metrics
+- Change `3000:3000` to `3001:3000` for Grafana
+- etc.
+
+## 📚 Next Steps
+
+1. **Run the setup**: `./setup.sh`
+2. **Open Grafana**: http://localhost:3000
+3. **Monitor your tests**: Watch the dashboards
+4. **Customize workloads**: Edit docker-compose.yml
+5. **Deploy to cloud**: Use the same configuration
+
+The application is designed for both short-term testing and long-term monitoring to detect performance degradations and memory leaks across different Redis versions.

Dockerfile

@@ -0,0 +1,53 @@
+# Multi-stage build for Redis Python test app
+FROM python:3.11-slim as builder
+
+# Install system dependencies
+RUN apt-get update && apt-get install -y \
+    gcc \
+    && rm -rf /var/lib/apt/lists/*
+
+# Set working directory
+WORKDIR /app
+
+# Copy requirements and install dependencies
+COPY requirements.txt .
+RUN pip install --no-cache-dir --user -r requirements.txt
+
+# Production stage
+FROM python:3.11-slim
+
+# Install runtime dependencies
+RUN apt-get update && apt-get install -y \
+    curl \
+    && rm -rf /var/lib/apt/lists/*
+
+# Create non-root user
+RUN useradd --create-home --shell /bin/bash app
+
+# Set working directory
+WORKDIR /app
+
+# Copy installed packages from builder
+COPY --from=builder /root/.local /home/app/.local
+
+# Copy application code
+COPY --chown=app:app . .
+
+# Make sure scripts are executable
+RUN chmod +x /app/*.py
+
+# Switch to non-root user
+USER app
+
+# Add local packages to PATH
+ENV PATH=/home/app/.local/bin:$PATH
+
+# Expose metrics port
+EXPOSE 8000
+
+# Health check
+HEALTHCHECK --interval=30s --timeout=10s --start-period=5s --retries=3 \
+    CMD curl -f http://localhost:8000/metrics || exit 1
+
+# Default command
+CMD ["python", "main.py", "--help"]