[8AD] Data Engineer

Skills

What you'll do

• Design and implement Infrastructure as Code (IaC) using Terraform to automate and manage infrastructure across Azure and Cloudflare, ensuring consistent and scalable deployments.
• Oversee PostgreSQL DB operations and automate DB-related tasks to streamline database management.
• Message Queue Configuration: Deploy and configure message queues to facilitate efficient data processing and communication between services.
• Develop and maintain CI/CD pipelines using GitHub Actions, automating the software delivery process to improve deployment efficiency.
• Ensure security across the infrastructure, enforcing RBAC practices and applying best practices for compliance and security within the DevOps lifecycle.
• Implement and maintain monitoring and observability solutions to track and optimize system performance, identify bottlenecks, and maintain system health.

About the role

Responsibilities: • Design and implement Infrastructure as Code (IaC) using Terraform to automate and manage infrastructure across Azure and Cloudflare, ensuring consistent and scalable deployments. • Oversee PostgreSQL DB operations and automate DB-related tasks to streamline database management. • Message Queue Configuration: Deploy and configure message queues to facilitate efficient data processing and communication between services. • Develop and maintain CI/CD pipelines using GitHub Actions, automating the software delivery process to improve deployment efficiency. • Ensure security across the infrastructure, enforcing RBAC practices and applying best practices for compliance and security within the DevOps lifecycle. • Implement and maintain monitoring and observability solutions to track and optimize system performance, identify bottlenecks, and maintain system health. • Quickly diagnose and resolve any infrastructure- related issues, ensuring minimum disruption to our services. • Power BI (must-have): semantic models, DAX, report definitions authored as PBIP with .pbix deployment, incremental refresh, query folding, and troubleshooting model performance issues (e.g., refresh/XMLA timeouts). • Azure Synapse (must-have): notebooks, pipelines, triggers, and workspace management; source-side query optimization. • Strong SQL for data validation, transformation, and troubleshooting. • PowerShell scripting, with comfort working across common modules (e.g., Az, MicrosoftPowerBIMgmt) for deployment and operational tasks. • Familiarity with Azure Functions/function apps and CI/CD deployment workflows. • Experience with Azure DevOps (work item tracking) and Git/GitHub (branching, pull requests). • Senior-level experience preferred, with strong proficiency across this specific tech stack and the ability to work with a high degree of autonomy. We are Software Mind , an awesome team of engineers who are ready to ramp up any top-notch company’s projects! Our aim? To always be one step ahead. Become part of a multicultural company in constant growth with an excellent work environment certified by Great Place To Work! Originally posted on Himalayas