Projects
Automated Deployment of MongoDB on AWS EKS Cluster using Infrastructure as a Code
This project automates the deployment of a highly available MongoDB instance on AWS Elastic Kubernetes Service (EKS) using Terraform for infrastructure provisioning and Ansible for configuration management. The solution includes secure access via a bastion host, dynamic storage provisioning with AWS EBS, and integration with AWS Secrets Manager for credential management.
Key Features:
- Infrastructure-as-Code (IaC) with Terraform
- Kubernetes-native MongoDB deployment
- Secure access via SSH tunneling and RBAC
- Automated secrets management
Architecture Overview
Kafka to S3 Data Streaming Pipeline
Project Overview:
In this proof of concept (PoC) project, I designed and built a real-time data streaming pipeline utilizing several AWS services, including AWS Lambda, Kafka, Amazon Kinesis Data Streams (KDS), Kinesis Data Firehose (KDF), and S3. The goal was to create an efficient data ingestion pipeline from a Kafka topic to an S3 bucket using a serverless approach, ensuring resilience with a dead-letter queue setup.
Technologies Used:
- AWS Secrets Manager (for storing Kafka connection secrets)
- Kafka (Darwin Pub/Sub, an open data source)
- AWS Lambda
- Amazon SQS (as a dead-letter queue)
- Amazon Kinesis Data Streams (KDS)
- Amazon Kinesis Data Firehose (KDF)
- Amazon S3
Architecture Overview
Event Driven Serverless Architecture Using ECS Fargate (PDF to DOCX at scale)
Project Overview:
A cloud-native solution that converts PDF files to DOCX format using event-driven serverless architecture. Designed for scalability and cost efficiency, the system automatically processes documents through a coordinated workflow of AWS services: Triggerless initiation via S3 uploads Message queuing for fault-tolerant processing Containerized conversion in isolated Fargate tasks End-to-end monitoring with CloudWatch integration Implements infrastructure-as-code (IaC) principles with Terraform for reproducible deployments across environments.
Technologies Used:
- AWS Lambda: Event-driven compute layer
- Amazon SQS: Message queuing for decoupled processing (used as a dead-letter queue)
- Amazon S3: Durable object storage for input/output files
- AWS Fargate: Container orchestration with serverless scaling
- CloudWatch: Centralized logging and monitoring
Architecture Overview
Serverless Web application on GitHub pages using AWS API Gateway and Lambda
Project Overview:
Convert SMILES notation to molecular structures with serverless AWS backend and GitHub Pages frontend.
Technologies Used:
- AWS Lambda
- API Gateway
- Python
- RDKit
- GitHub Pages
- Amazon Certificate Manager (ACM)
Architecture Overview
