Development Scripts

Relevant source files

The following files were used as context for generating this wiki page:

• deploy.sh
• setup-dev.sh
• test.sh
• infrastructure/databases/init-databases.sh
• README.md
• IMPLEMENTATION_COMPLETE.md

The development scripts in the Aether-X Ultimate project provide a standardized automated workflow for environment provisioning, database initialization, testing, and multi-environment deployment. These scripts are designed to manage the lifecycle of a microservices-based architecture, ensuring consistency between local development and production Kubernetes environments.

Sources: README.md:46-56, IMPLEMENTATION_COMPLETE.md:104-120

Environment Initialization

The setup-dev.sh script automates the initial creation of the project structure and development configurations. It handles the generation of ignore files, directory structures, and a centralized development.yaml configuration that maps service ports and database connection strings.

Configuration Generation

The script creates a config/development.yaml file that defines the networking and debugging parameters for all microservices, including:

• Service Ports: Assignments ranging from 8000 (Text Generation) to 8006 (Data Processing).
• Database Hosts: Connection details for MySQL, PostgreSQL, MongoDB, and Redis.
• Infrastructure: Kafka bootstrap servers and monitoring ports for Prometheus/Grafana.

Sources: setup-dev.sh:6-140

Provisioning Flow

The following diagram illustrates the environment setup process:

The script ensures that the environment is ready for Docker-based orchestration by defining standard exclusion patterns for Python, IDEs, and binary artifacts.
Sources: setup-dev.sh:15-64

Database Initialization

The init-databases.sh script is responsible for bootstrapping the multi-database infrastructure. It generates initialization SQL and JavaScript files for four distinct database engines: MySQL, PostgreSQL, MongoDB, and Cassandra.

Database	Primary Purpose	Initialization File
MySQL	User management & App data	mysql-init/01-create-tables.sql
PostgreSQL	Workflow definitions	postgres-init/01-create-tables.sql
MongoDB	Unstructured content storage	mongodb-init/01-create-collections.js
Cassandra	High-availability data	cassandra-init/01-create-keyspace.cql

Sources: infrastructure/databases/init-databases.sh:5-150

Schema Architecture

The scripts establish a shared schema across relational and non-relational engines, primarily focusing on users, apps, workflows, and content_generated. For example, the MySQL and PostgreSQL scripts implement Foreign Key constraints to maintain referential integrity between users and their generated apps.
Sources: infrastructure/databases/init-databases.sh:10-50

Automated Testing Suite

The test.sh script provides a comprehensive testing framework that supports health checks, integration testing, and load testing. It targets the microservices via their exposed ports and verifies the JSON responses from specific endpoints.

Integration Test Logic

The script executes a sequence of functional tests against live services:

1. Health Checks: Verifies the /health endpoint of all 7 core services.
2. Functional Verification: POSTs real data to services like text-generation and image-generation to verify content creation.
3. Security Integration: Tests the user registration and login flow, extracts JWT tokens, and attempts to access protected /security-logs endpoints.

Sources: test.sh:14-135

Load Testing

The script includes a run_load_tests function that simulates high-frequency traffic to the API Gateway. It measures:

• Success Count: The number of 200 OK responses.
• Duration: Total time for the request burst.
• Rate: Calculated requests per second (req/s).

Sources: test.sh:220-250

Deployment Orchestration

The deploy.sh script manages the transition to production-like environments using Kubernetes. It follows a strictly ordered execution path to ensure infrastructure readiness before microservices are deployed.

Deployment Phases

1. Prerequisites Check: Validates the presence of kubectl and docker.
2. Infrastructure Provisioning: Applies K8s manifests for databases, Kafka, and the monitoring stack.
3. Image Construction: Uses docker build to create images for all 8 microservices.
4. Service Deployment: Applies deployment.yaml and api-gateway.yaml to the aether-x namespace.
5. Verification: Uses kubectl wait to ensure all deployments reach an available state before testing API connectivity via curl.

Sources: deploy.sh:31-135

Kubernetes Operations

The script supports different command arguments:

• ./deploy.sh deploy: Full setup and build.
• ./deploy.sh status: Summarizes the status of pods and services.
• ./deploy.sh cleanup: Deletes the namespace and associated resources.

Sources: deploy.sh:160-185

Summary

The Aether-X Ultimate development scripts provide a robust automation layer that minimizes manual configuration. By linking environment setup (setup-dev.sh), data layer readiness (init-databases.sh), and deployment management (deploy.sh), the project maintains a reliable CI/CD-ready structure for microservice development.

Sources: IMPLEMENTATION_COMPLETE.md:12-40