Senior Spark Data Engineer

Why Valtech?

We’re advisors, visionaries, creatives, and techies. We embrace all things digital, collaborate with each other, have fun, and love our clients. We’re looking ahead and we are global.

The Opportunity

At Valtech, we've got opportunities for learning, growing, and making a world-changing impact. Our global workforce exists to unlock a better way to experience the world, starting with our workplace.

The Role

Ideal candidates will have strong quantitative backgrounds and analytical discipline. While they will have some demonstrated ability to write code, they will have learned programming languages as a means to express their intellectual curiosity and analytical voice. Valtech will provide a platform and training to help them reach their full potential.

Valtech is looking to hire a Senior Spark Data Engineer to join our growing capabilities team. If you are innovative, passionate about data and AI technologies, and look to continually learn and enjoy sharing expertise, read on!

Role Responsibilities

• Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities.
• Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines.
• Provide consultation and lead the implementation of complex programs.
• Develop and maintain documentation relating to all assigned systems and projects.
• Tune queries running over billions of rows of data in a distributed query engine.
• Perform root cause analysis to identify permanent resolutions to software or business process issues.

Minimum Qualifications

• Proven industry experience executing data engineering, analytics, and/or data science projects or a Bachelors/Masters degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science, or computation-intensive Sciences and Humanities.
• More than 2 years of experience working with:
  1. Strong/expert Spark (PySpark) using Jupyter Notebooks, Colab or DataBricks.
  2. Hands-on data pipeline development, ingest patterns in Azure.
  3. Orchestration tools, ADF or Airflow.
  4. SQL.
  5. Denormalized Data modeling for big data systems.
• Collaborative, able to work remotely, and still be an engaging team member.
• Strong analytical and design skills.

Preferred Qualifications

• Proficiency in visualization/reporting tools such as Tableau and PowerBI or programmatic visualization library such as R ggplot2, Python matplotlib/seaborn/bokeh, Javascript D3.
• Proficiency scripting in UNIX environment.
• Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc.
• Proficiency with cloud architecture components (AWS, Azure, Google).
• Proficiency with data pipeline software such as Airflow, Luigi, or Prefect.
• Ability to turn raw data and ambiguous business questions into distilled findings and recommendations for action.
• Experience with statistical and machine learning libraries along with the ability to apply them appropriately to business problems.
• Proficiency in front and back-end web application development stacks and frameworks (Javascript, HTML, CSS, React/Vue/AngularJS) including API design (REST/GraphQL) and library development.
• Experience leading and managing technical data/analytics/machine learning projects.

Hiring Process

After submitting your application, you will hear from a member of our Talent Acquisition team if your skills and experience match the position. Be mindful of recruitment fraud by only replying and engaging with email contacts that end with the 'valtech.com' domain.

We strive to create an inclusive environment for all candidates. If you have any specific requirements or need reasonable adjustments to participate in the application or interview process, please let us know at kincarta-amer.ta.team@valtech.com.

About Valtech

Valtech is the experience innovation company that exists to unlock a better way to experience the world. By blending crafts, categories, and cultures, our global team of 8,000 professionals in more than 60 offices helps brands unlock value in a digitally accelerated world. At the intersection of insights and perspectives, we leverage the power of data, AI, creativity, and technology to achieve experience innovation for many of the world’s best-known organizations, including L’Oreal, NatWest, DWP, P&G, Volkswagen, and US Department of Agriculture.

Valtech will always be recognized not just for the quality of the work we deliver, but for all the amazing people that make it happen. We work to create an equitable workplace that gives people from all backgrounds the support they need to thrive, grow, and meet their goals (whatever they may be). At Valtech, we don’t just talk about how to get things done; we transform by doing.