Business Function
Middle Office Technology (MOT) works hand-in-glove with the Bank’s middle office units to protect and manage risks & controls, financials, and regulations, enabled by purpose-built innovative solutions. The Risk Platform team focuses on developing robust data processing pipelines, risk engines, and analytical platforms using advanced big data and distributed processing technologies to support enterprise risk management, regulatory compliance, and data-driven decision-making across DBS.
Job Responsibilities
- Create Scala/Spark/Pyspark jobs for data transformation and aggregation
- Produce unit tests for Spark transformations and helper methods
- Use Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API.
- Develop an application by using Hadoop tech stack and deliver effectively, efficiently, on-time, in-specification and in a cost-effective manner.
- Work closely with Business Analysts team to review the test results and obtain sign off
- Prepare necessary design/operations documentation for future usage Perform peer reviews
- Code quality review and be gatekeeper for quality checks Hands-on coding, usually in a pair programming environment
- Working in highly collaborative teams and building quality code
- Ensure smooth production deployments as per plan and post-production deployment verification.
Job Requirements
- The candidate must exhibit a good understanding of data structures, data manipulation, distributed processing, application development, and automation.
- Familiar with Oracle, Spark streaming, Kafka, ML.
- Tech stack: Hadoop, Spark, Scala, Java, Hive, Impala, CI/CD, Git, Jenkins, Agile Methodologies, DevOps, Cloudera Distribution.
- Strong Knowledge in data warehousing Methodology
- Strong problem-solving skills, ability to manage deliverables within desired timeframes, and effective communication skills.
Location:
DBS Asia Hub
Job:
Technology
Schedule:
Regular
Employee Status:
Full time
.png?1714733948){kind=logo}
