Experienced Data Engineer (for a unique project)

Your Role and Responsibilities :
IBM’s data engineering team is one of the most exciting examples of our passion for combining data and technology! Our engineers build secure, end-to-end solutions. They develop the custom software used to process transactions, the tools that providers use to deliver content, all the server-side systems, and the APIs for many services.

This job opportunity is for a unique partnership between IBM and Apple, related to the direct work with Apple Team in the Analytics area, with focus on Apple Music store.

Role Description
As a team member of the Data Engineering team, you will have significant responsibility and influence in shaping its future direction. This role is inherently cross-functional and the ideal candidate will work across disciplines. We are looking for someone with a love for data and ability to iterate quickly on all stages of data pipeline. This position involves working on a small team to develop large scale data pipelines and analytical solutions using Big Data technologies. Successful candidates will have strong engineering skills and communication, as well as, a belief that data driven processes lead to phenomenal products. You will need to have a passion for quality and an ability to understand sophisticated systems.

What do you need for your success with us?

Key Qualifications
- Experience in high level programming languages such as Java, Scala.
- Proficiency with databases and SQL is required.
- Proficiency in data processing using technologies like Spark - Streaming, Spark SQL, or Map/Reduce.
- Expertise in Hadoop related technologies such as HDFS, Azkaban, Oozie, Impala, Hive, and Pig.
- Expertise in developing big data pipelines using technologies like Kafka, Flume, or Storm.
- Experience with large scale data warehousing, mining or analytic systems.
- Ability to work with analysts to gather requirements and translate them into data engineering tasks
- Aptitude to independently learn new technologies.

Education & Experience
Bachelor's degree or equivalent work experience in Engineering, Computer Science, Business Information Systems. IBM is an Equal Opportunity Employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other legally protected characteristics.