Data Engineer/Architect - Lead
TECHNICAL SKILLS
Must Have
• Ability to write complex procedures/views/SQL
• Apache Kafka
• Apache NIFI & SQL
• Cloud Data Warehousing - Snowflake preferred
• DataStage, SQL, understanding of dimensionally-designed databases, and experience interacting with a relational database (DB2, Oracle, etc.). Mainframe experience would be a bonus, but not required. Ability to analyze complex data flows and understand existing jobs.
• ETL
• scripting languages for automation (Java, Python, Powershell); Experience working in Data Management framework; Experience in platform engineering activities (platform standup, software upgrades, patching, etc); and proficiency in admin operating systems (Linux, CLI)
ESSENTIAL DUTIES AND RESPONSIBILITIES:
• Provide technical knowledge, leadership and collaboration as an ETL developer & designer
• Develop and maintain data transfer jobs & schedulers, as required, including to identify & execute opportunities to automate
• Achieve operational excellence by automating processes and writing maintainable, supportable, and testable code
• Assist with problem resolution for end users and customers, including incident & problem management
• Support both application and environment upgrades, new implementations & patches, as required.
• Develop software meeting code quality standards and metrics
• Participate in communities of practice by contributing to and following standards, test driven development, reviewing others code, and sharing knowledge
• Maintain effective partnerships with operations and engineering teams to drive service improvement
• Remain current on IT trends pertaining to their area of practice
• Contribute to the definition of operational procedures for software development
• Maintain appropriate controls and documentation to ensure compliance of audit requirements
MINIMUM KNOWLEDGE, SKILLS AND ABILITIES REQUIRED:
• Bachelor's degree in Computer Science/Information Systems
• Understanding of Object-Oriented Programming Languages
• Understanding of Software Development Lifecyle
• Strong SQL Skills with ability to perform ETL
• Familiarity with relational database architecture techniques like EDW, Postgrese, etc
• Demonstrated practice for scripting languages, like Python, Java, Powershell
• Strong Windows Server Experience and/or Application Support Experience
• Prior experience with Alation, Snowflake, NIFI/KAFKA, PowerBI, Tableau, & Git is a plus
• Understanding of Agile Software Development methodologies
• Understanding of data management and info security best practices
• Demonstrated problem solving skills
• Demonstrated collaboration skills
• Excellent verbal and written communication skills
• Prior experience working for a financial institution or with Debit Cards a plus
Must Have
• Ability to write complex procedures/views/SQL
• Apache Kafka
• Apache NIFI & SQL
• Cloud Data Warehousing - Snowflake preferred
• DataStage, SQL, understanding of dimensionally-designed databases, and experience interacting with a relational database (DB2, Oracle, etc.). Mainframe experience would be a bonus, but not required. Ability to analyze complex data flows and understand existing jobs.
• ETL
• scripting languages for automation (Java, Python, Powershell); Experience working in Data Management framework; Experience in platform engineering activities (platform standup, software upgrades, patching, etc); and proficiency in admin operating systems (Linux, CLI)
ESSENTIAL DUTIES AND RESPONSIBILITIES:
• Provide technical knowledge, leadership and collaboration as an ETL developer & designer
• Develop and maintain data transfer jobs & schedulers, as required, including to identify & execute opportunities to automate
• Achieve operational excellence by automating processes and writing maintainable, supportable, and testable code
• Assist with problem resolution for end users and customers, including incident & problem management
• Support both application and environment upgrades, new implementations & patches, as required.
• Develop software meeting code quality standards and metrics
• Participate in communities of practice by contributing to and following standards, test driven development, reviewing others code, and sharing knowledge
• Maintain effective partnerships with operations and engineering teams to drive service improvement
• Remain current on IT trends pertaining to their area of practice
• Contribute to the definition of operational procedures for software development
• Maintain appropriate controls and documentation to ensure compliance of audit requirements
MINIMUM KNOWLEDGE, SKILLS AND ABILITIES REQUIRED:
• Bachelor's degree in Computer Science/Information Systems
• Understanding of Object-Oriented Programming Languages
• Understanding of Software Development Lifecyle
• Strong SQL Skills with ability to perform ETL
• Familiarity with relational database architecture techniques like EDW, Postgrese, etc
• Demonstrated practice for scripting languages, like Python, Java, Powershell
• Strong Windows Server Experience and/or Application Support Experience
• Prior experience with Alation, Snowflake, NIFI/KAFKA, PowerBI, Tableau, & Git is a plus
• Understanding of Agile Software Development methodologies
• Understanding of data management and info security best practices
• Demonstrated problem solving skills
• Demonstrated collaboration skills
• Excellent verbal and written communication skills
• Prior experience working for a financial institution or with Debit Cards a plus
