Senior Spark Data Engineer

Why Valtech? We’re advisors, visionaries, creatives and techies. We embrace all things digital. We collaborate with each other. We have fun. We love our clients. We’re looking ahead. We are global.

The opportunity

At Valtech, we’ve got opportunities to offer you — for learning; for growing; for making world-changing impact; for being a real agent of change. Our global workforce exists to unlock a better way to experience the world, and that all starts with our workplace. We’re proud of:

• What we do
• Our values
• Our workplace
• The borderless framework we work in

The role

Ideal candidates will have strong quantitative backgrounds and analytical discipline. While they will have some demonstrated ability to write code, they will not have learned programming languages for the sake of building their resume, but rather as a means to express their intellectual curiosity and analytical voice. Valtech will provide a platform and training to help them reach their full potential.

Valtech is looking to hire Senior Spark Data Engineer to join our growing capabilities team. If you are innovative, passionate about data and AI technologies, and look to continually learn and enjoy sharing expertise, read on!

Role responsibilities

• Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities
• Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
• Provide consultation and lead the implementation of complex programs
• Develop and maintain documentation relating to all assigned systems and projects
• Tune queries running over billions of rows of data running in a distributed query engine
• Perform root cause analysis to identify permanent resolutions to software or business process issues

Minimum qualifications

We want all new hires to succeed in their roles at Valtech. That's why we've outlined the job requirements below. To be considered for this role, it's important that you meet all Minimum Qualifications. If you do not meet all of the Preferred Qualifications, we still encourage you to apply.

• Proven industry experience executing data engineering, analytics and/or data science projects or Bachelor's/Master's degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science or computation-intensive Sciences and Humanities.
• More than 2 years of experience working with:
  1. Strong/expert Spark (PySpark) Using Jupyter Notebooks, Colab or DataBricks
  2. Hands-on data pipeline development, ingest patterns in Azure
  3. Orchestration tools, ADF or Airflow
  4. SQL
  5. Denormalized Data modeling for big data systems
• Collaborative, able to work remotely, and still be an engaging team member.
• Strong analytical and design skills.

Preferred qualifications

• Proficiency in visualization/reporting tools such as Tableau and PowerBI or programmatic visualization library such as R ggplot2, Python matplotlib/seaborn/bokeh, Javascript D3.
• Proficiency scripting in UNIX environment
• Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc.
• Proficiency with cloud architecture components (AWS, Azure, Google)
• Proficiency with data pipeline software such as Airflow, Luigi, or Prefect
• Ability to turn raw data and ambiguous business questions into distilled findings and recommendations for action
• Experience with statistical and machine learning libraries along with the ability to apply them appropriately to business problems
• Proficiency in front and back-end web application development stacks and frameworks (Javascript, HTML, CSS, React/Vue/AngularJS) including API design (REST/GraphQL) and library development
• Experience leading and managing technical data/analytics/machine learning projects

Your process

After submitting your application, you will hear from a member of our Talent Acquisition team if your skills and experience match the position. Be mindful of recruitment fraud by only replying and engaging with email contacts that end with the '@valtech.com' domain.

We strive to create an inclusive environment for all candidates. If you have any specific requirements or need reasonable adjustments to participate in the application or interview process, please let us know at kincarta-amer.ta.team@valtech.com.

About Valtech

Valtech, who recently acquired Kin + Carta, is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, our global team of 8,000 professionals in more than 60 offices help brands unlock value in a digitally accelerated world. At the intersection of insights and perspectives, we leverage the power of data, AI, creativity, and technology to achieve experience innovation for many of the world’s best-known organisations, including L’Oreal, NatWest, DWP, P&G, Volkswagen, and US department of Agriculture.

Valtech will always be recognized not just for the quality of the work we deliver, but for all the amazing people that make it happen. We work to create an equitable workplace that gives people from all backgrounds the support they need to thrive, grow and meet their goals (whatever they may be). At Valtech, we don’t just talk about how to get things done; we transform by doing.