We use essential technologies to keep Swiftcruit secure and running. With your permission, we also use analytics and marketing technologies to understand usage and improve the product. You can change this anytime from Cookie Settings in the footer. Read our Cookie Policy.
Senior Lead Data Engineer - R01573561 at Brillio | Swiftcruit
Experience Range: With at least 5 to 8 years of hands-on experience in data engineering, including significant expertise in GCP infrastructure and cloud-based ETL solutions Key Responsibilities: 1. Design, develop, and optimize scalable data pipelines and ETL workflows on Google Cloud Platform using IICS and BigQuery 2. Implement, maintain, and troubleshoot GCP infrastructure components, ensuring high availability and security compliance 3. Automate data integration processes utilizing Python, SQL, and shell scripting to support business analytics and reporting 4. Configure and manage GCP security protocols, including IAM roles, audit logging, and data encryption to safeguard sensitive information 5. Integrate Salesforce data with cloud data warehouses, ensuring seamless data flow and accuracy 6. Monitor and tune BigQuery performance, optimizing queries and resource utilization for large-scale datasets 7. Lead migration and modernization initiatives, transitioning legacy systems to GCP-based architectures 8. Document technical solutions, workflow processes, and best practices for ongoing knowledge sharing and operational excellence Required Skills: 1. Google Cloud Platform (GCP) administration 2. IICS (Informatica Intelligent Cloud Services) 3. BigQuery 4. Shell scripting 5. Python 6. Advanced SQL Preferred Skills: 1. Experience with Salesforce data integration 2. Expertise in cloud migration strategies 3. Knowledge of data governance frameworks 4. Proficiency with Terraform or similar infrastructure-as-code tools 5. Familiarity with Kubernetes on GCP 6. Experience with real-time data streaming solutions Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline 2. Google Professional Data Engineer certification or equivalent relevant GCP certification 3. Informatica Cloud certification
