Job Position Details
Job ID: JD20231106-1080
Job Name: Senior Data Engineer – Datastage Years of Experience: 4
No of Opening: 1
Job Description: We are looking for a skilled and experienced Data Engineers to join our team! As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, think strategically, and innovate, and helping others, this job is for you! Senior Data Engineer specializing in IBM InfoSphere DataStage, responsible for designing, developing, and managing the ETL processes and data infrastructure. Play a critical role to ensure the smooth flow, transformation, and integration of data from various sources to data warehouse or data lake.
Primary Skills: Datastage,SQL / PL SQL
Secondary Skills: Python
Role Description:
Data engineering role requires creating and managing technological infrastructure of a data platform, be in-charge / involved inarchitecting, building, and managing data flows / pipelines and construct data storages(noSQL, SQL), tools to work with big data(Hadoop, Kafka), and integration tools to connect sources or other databases.
Role Responsibility:
• Translate functional specifications and change requests into technical specifications
• Translate business requirement document, functional specification, and technical specification to related coding
• Develop efficient code with unit testing and code documentation
• Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving
• Setting up the development environment and configuration of the development tools
• Communicate with all the project stakeholders on the project status
• Manage, monitor, and ensure the security and privacy of data to satisfy business needs
• Contribute to the automation of modules, wherever required
• To be proficient in written, verbal and presentation communication (English)
• Co-ordinating with the UAT team
Role Requirement:
• Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)
• Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing dimensions etc.)
• Knowledgeable in Shell / PowerShell scripting
• Knowledgeable in relational databases, nonrelational databases, data streams, and file stores
• Knowledgeable in performance tuning and optimization
• Experience in Data Profiling and Data validation
• Experience in requirements gathering and documentation processes and performing unit testing
• Understanding and Implementing QA and various testing process in the project
• Knowledge in any BI tools will be an added advantage
• Sound aptitude, outstanding logical reasoning, and analytical skills
• Willingness to learn and take initiatives
• Ability to adapt to fast-paced Agile environment
Additional Requirement:
• 2 years of experience in Data Engineering, with a focus on ETL using IBM InfoSphere DataStage.
• Understanding how to configure and utilize sequence generators within DataStage jobs to fulfill specific business requirements or to establish a consistent numbering scheme across data sets.
• Creating strategies for capturing historical changes while retaining previous versions of data in the data warehouse.
• Handling various types of flat file structures and formats to access the necessary information.
• Using the parameters to customize ETL jobs, adapt data extraction or transformation logic, or configure connections to different data sources or destinations.
• Certifications in IBM InfoSphere DataStage or related technologies would be a plus.
• Open to travel to onsite client location on need basis.