Data Engineering & Infrastructure Lead

About the role

AgileEngine is seeking a part‑time Data Engineering and Infrastructure Lead to provide advisory audit of its AWS architecture, CI/CD processes, and ETL pipeline decisions. The role involves evaluating managed tooling versus custom builds, reviewing SageMaker‑based MLOps pipelines, and mentoring engineers on best practices.

Key responsibilities

• Audit current AWS architecture across live applications (ECS/ECR, RDS Postgres, S3, VPC, CloudFront/SSO, SageMaker MLOps pipelines).
• Review CI/CD processes and the end‑to‑end development lifecycle, recommending SDLC governance layers such as schema versioning, environment separation, and release gating.
• Evaluate the use of Claude Code for PR generation, automated reviews, and token/cost management.
• Provide technical opinions on ETL/data‑ingestion pipeline architecture (managed ELT tools vs. custom builds).
• Mentor the infrastructure build team on AWS, DevOps, CI/CD, and data‑engineering practices.
• Set recommendations and technical direction based on audit findings.
• Report findings and risk assessments directly to leadership.

Required profile

• 6+ years of hands‑on experience with AWS services: ECS/Fargate, ECR, RDS (Postgres), S3, SageMaker, EventBridge, VPC/ALB/CloudFront, IAM.
• Fluency with Infrastructure‑as‑Code, specifically Terraform.
• Proven experience designing or auditing CI/CD pipelines and SDLC governance (e.g., Alembic for schema/version control).
• Strong data‑engineering background to assess ETL/ingestion architectures.
• Experience evaluating AI‑assisted development workflows (e.g., Claude Code) for quality and cost governance.
• Comfortable operating in a part‑time advisory capacity and mentoring less‑experienced engineers.
• Upper‑intermediate English communication skills.

Required skills

• AWS ECS/Fargate
• AWS ECR
• AWS RDS (Postgres)
• AWS S3
• AWS SageMaker
• AWS EventBridge
• AWS VPC, ALB, CloudFront
• AWS IAM
• Terraform
• CI/CD pipeline design
• SDLC governance (schema versioning, environment separation, release gating)
• Alembic (schema/version control)
• Data engineering & ETL pipeline architecture
• AI‑assisted development workflow evaluation (Claude Code)

What we offer

• Professional growth through mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation.