Senior Data Engineer

At Similarweb, we are revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online.

Our unique data and solutions empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies.

In 2021, we went public on the New York Stock Exchange, and we continue to reach new heights! Come work alongside Similarwebbers across the globe who are bright, curious, practical, and good people.

Role Summary:

We are looking for a Data Engineer to join our team and play a key role in designing, building, and maintaining scalable, cloud-based data pipelines. You will work with AWS services , Airflow and databricks to integrate, process, and analyze large datasets, ensuring data reliability and efficiency.

Your work will directly impact business intelligence, analytics, and data-driven decision-making across the company.

What You’ll Do:

• ETL & Data Processing: Develop and maintain ETL processes, integrating data from various sources (APIs, databases, external platforms) using Python, SQL, and cloud technologies.
• Utilize LangGraph and other frameworks to create state of the art AI agents that integrate various tools and data sources.
• Implement integrations that allow agents to take automated actions on behalf of users, streamlining workflows and reducing overhead.
• Data Modeling: Design and maintain logical and physical data models to support business needs.
• Optimization & Scalability: Improve process efficiency and optimize runtime performance to handle large-scale data workloads.
• Collaboration: Work closely with BI analysts and business stakeholders to define data requirements and functional specifications.
• Monitoring & Troubleshooting: Ensure data integrity and reliability by proactively monitoring pipelines and resolving issues.

Requirements:

• Education & Experience:
• BSc in Computer Science, Engineering, or equivalent practical experience.
• 5+ years of experience in data engineering or related roles.
• Technical Expertise:
• Proficiency in Python for data engineering and automation.
• Experience with Big Data technologies such as Spark, Databricks, DBT, and Airflow.
• Hands-on experience with AWS services (S3, Redshift, Glue, Managed Airflow, Lambda)
• Knowledge of Docker, Terraform, Kubernetes, and infrastructure automation.
• Strong understanding of data warehouse (DWH) methodologies and best practices.
• Soft Skills:
• Strong problem-solving abilities and a proactive approach to learning new technologies.
• Excellent communication and collaboration skills, with the ability to work independently and in a team.

Nice to Have ( Advantage):

• Experience with LangGraph, LangChain, or similar frameworks for building AI agents.
• Understanding of LLMs, prompt engineering, and AI agent architectures.
• Familiarity with K8s for infrastructure as code.
• Experience with JavaScript, React, and Node.js.

 

Why you’ll love being a Similarwebber:

You’ll actually love the product you work with: Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world.

You’ll find a home for your big ideas: We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization.

We offer competitive perks & benefits: We take your well-being seriously, and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours.

You can grow your career in any direction you choose: Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here.

Diversity isn’t just a buzzword: People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. Our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day.