JOB RESPONSIBILITIES

• Work on the Data Lake platform handling millions of documents annually, built on No SQL Architecture. Focus on developing new features while supporting and maintaining existing systems, ensuring the platform's continuous improvement.
• Develop innovative solutions for feature additions and bug fixes, optimizing existing SQL queries as needed to enhance system efficiency and performance.
• Engage with Python, Frontend and C#.NET repositories to support ongoing development and maintenance, ensuring robust integration and functionality across the application stack.
• Create comprehensive design documents for major architectural changes and facilitate peer reviews to ensure quality and alignment with best practices.
• Utilize object-oriented programming principles to develop low-level designs that effectively support high-level architectural frameworks, contributing to scalable solutions.
• Collaborate with product managers and key stakeholders to thoroughly understand requirements and propose strategic solutions, leveraging cross-functional insights.
• Actively participate in technical discussions with principal engineers and architects to support proposed design solutions, fostering a collaborative engineering environment.
• Accurately estimate key development tasks and share insights with architects, engineering directors, to align on priorities and resource allocation.
• Operate within an agile framework, collaborating with engineers and product developers using tools like Jira and Confluence. Engage in test-driven development and elevate team practices through coaching and reviews.
• Create and review documentation and test plans to ensure thorough validation of new features and system modifications.
• Work effectively as part of a geographically diverse team, coordinating with other departments and offices for seamless project progression.
• Participate in weekly On Call support to address urgent queries and issues in common communication channels, ensuring operational reliability and user satisfaction.
• These responsibilities aim to highlight the complexity of managing a platform that ingests millions of documents, underscoring the importance of innovative solutions, technical proficiency, and collaborative efforts to ensure the Data Lake platform's success.

JOB REQUIREMENTS:

• Educational Background: Bachelor’s or master’s degree in computer science, Engineering, or a related field is required.
• Experience: 8+ years of experience in software development, with a focus on systems handling large-scale data operations.
• Technical Skills:
  • In-depth understanding of data structures and algorithms to optimize software performance and efficiency.
  • Proficiency in object-oriented design principles is essential.
  • Strong skills in Python, AWS, Frontend and C#.NET to comprehend and contribute to existing applications.
  • Experience with non-relational databases, specifically DynamoDB, MongoDB Elasticsearch, for optimal query development and troubleshooting.
  • Experience with frontend technologies like Angular, React or Vue.js to support development of key interfaces
• Software Development:
  • Familiarity with GitHub-based development processes, facilitating seamless collaboration and version control.
  • Experience in building and deploying production-level services, demonstrating ability to deliver reliable and efficient solutions.
• API and System Integration: Proven experience working with APIs, ensuring robust connectivity and integration across the system.

• AWS Expertise: Working experience with AWS services such as Lambda, EC2, S3, and AWS Glue is beneficial for cloud-based operations and deployments.

• Problem-Solving and Analysis: Strong analytical and problem-solving skills are critical for developing innovative solutions and optimizing existing platform components.
• Communication and Collaboration: Excellent collaborative and communication skills, enabling effective interaction with geographically diverse teams and key stakeholders.
• On Call and Operational Support: Capability to address system queries and provide weekly On Call support, ensuring system reliability and user satisfaction.
• Organizational Skills: Ability to prioritize and manage work effectively in a fast-paced environment, demonstrating self-direction and resourcefulness.
• Coding Assistants: Ability to use various coding agents like Claude Code, Chat GPT etc. to reduce development effort.

Good to have skills

• Python Proficiency: Experience with Python and relevant libraries like Pandas and NumPy is beneficial for data manipulation and analysis tasks.
• Jupyter Notebooks: Familiarity with Jupyter Notebooks is a plus for supporting data visualization and interactive analysis.
• Agile Methodologies: Understanding of Agile software development is advantageous, with experience in Scrum as a preferred approach for iterative project management.
• Linux/Unix Experience: Exposure to Linux/Unix environments is desirable, enhancing versatility in system operations and development.