Want to know if this job is worth applying to?
Brasil
Remote only
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer – Platform, Automation & AI Acceleration (GCP) based in Brazil.
We are seeking a Senior Data Engineer to help build and evolve a modern data engineering platform on Google Cloud Platform (GCP). This role focuses on automation, CI/CD, Developer Experience, and accelerating development through artificial intelligence. You will design intelligent tools, reusable frameworks, and automated workflows that streamline the creation, validation, and deployment of data pipelines and models. By combining AI-assisted development with robust engineering practices, you will help improve data quality, governance, and cost efficiency. You will work across platform engineering, cloud infrastructure, orchestration, and developer tooling. This is a fully remote opportunity for a professional who enjoys building scalable solutions and improving how engineering teams deliver software.
You will contribute to the development and continuous improvement of the data engineering platform, creating automation capabilities and intelligent development workflows that improve productivity, reliability, and delivery speed. Your responsibilities will include:
Developing and enhancing AI-assisted development workflows using Antigravity, including context libraries, templates, tools, and validation mechanisms to accelerate pipeline and data transformation generation.
Building and maintaining CI/CD pipelines with automated SQL validation, contract testing, schema checks, data quality controls, and performance testing.
Implementing cost analysis and query optimization mechanisms for BigQuery using tools such as Dry Run and Query Explain to identify inefficient consumption patterns.
Designing Infrastructure as Code (IaC) solutions with Terraform, including reusable modules for provisioning GCP resources, permissions, and governance policies.
Improving orchestration processes using Cloud Composer/Airflow, Cloud Workflows, Eventarc, and Pub/Sub through metadata-driven and event-driven architectures.
Integrating data engineering, automation, and AI tools into development workflows, including automated validations within Pull Requests.
Enhancing Developer Experience by reducing manual tasks, minimizing rework, and accelerating delivery cycles.
Promoting engineering standards and practices that support platform reliability, scalability, governance, and cost optimization.
We are looking for a senior professional with strong hands-on experience in cloud-based data engineering, automation, and platform development. You should be comfortable building internal tools, integrating AI-assisted development practices, and implementing reliable engineering workflows.
Solid experience in Data Engineering on Google Cloud Platform (GCP), particularly with BigQuery, Cloud Composer/Airflow, Dataflow, Cloud Run, Cloud Functions, and Cloud Workflows.
Advanced proficiency in Python and SQL, including automation development, internal tooling, and integration with APIs and GCP SDKs.
Experience implementing CI/CD pipelines using GitHub Actions, GitLab CI, or Cloud Build.
Practical experience with Terraform, Infrastructure as Code, and DataOps practices.
Knowledge of SQL analysis and validation tools such as SQLFluff and SQLGlot.
Experience developing and maintaining automated pipelines, tests, schema validation processes, and data governance mechanisms.
Hands-on experience with AI-assisted development tools, particularly Antigravity, for code generation and validation.
Nice to have:
Experience with Dataform or dbt, including unit testing, ephemeral environments, and Slim CI.
Knowledge of SQL Abstract Syntax Trees (AST), data lineage, and automated anti-pattern detection.
Experience developing AI agents, Model Context Protocol (MCP) servers, IDE extensions, or automated code review bots for Pull Requests.
Knowledge of BigQuery cost and performance optimization, including BigQuery Editions and slot consumption.
Experience with Golden Paths, Golden Modules, and Platform Engineering practices.
CLT employment contract.
100% remote work.
Meal and/or food allowance.
Discounts on courses, universities, and language-learning institutions.
Access to an online learning platform offering free, regularly updated courses with certificates.
Mentoring opportunities.
Discount programs for medical consultations and examinations.
Medical insurance.
Dental insurance.
Discounts and special offers at selected establishments.
Travel benefits and discounts.
Pet care partnership.