Data Engineer

Apply now Close

Data Engineer

Philadelphia (Preferred); Remote within EST

Posted on 21 Jun 2022

Location:

  • Preferably in the Philadelphia area otherwise remote within EST

Day-to-Day Responsibilities:

  • Build, operate, and maintain data platforms and systems, including cloud-based services, that enable distributed data consumption and value-generating usage by teams and other end users, as part of cross-functional digital product teams
  • Produce all required design specifications and drive the implementation of appropriate data models, schemas and their associated processing and transformation pipelines, in order to satisfy changing business requirements while ensuring continuously stable running operations
  • Build software that is cost-effective and robust with respect to imperfect data streams and architectural conditions, minimizing unintended errors and system down time, and ensuring a resilient technological foundation for analytics
  • Apply and utilize modern software development practices and related technologies, including continuous integration and delivery, in order to efficiently deliver flexible digital solutions in close collaboration with others
  • Develop resilient and efficient code/processes that extract structured and unstructured data from varied repositories (cloud-based, on-prem, offline data exports) and load it into clientscloud storage platform based on requirements laid out by product/project stakeholders.
  • Build and contribute to our evolving software library of internal data processing tools to minimize the amount of repetitive work happening in product teams across Group Digital and increase the efficiency of analytical problem-solving
  • Implement data validation checks and data quality dashboards, in order to ensure a high degree of trust in the data residing in the systems, as well as in the decisions supported by insights extracted from it
  • Promote and apply agile ways of working in relation to softwaredevelopment, including rapid prototyping and outcome-based evaluation, in order to ensure that we realize the OKRs set by Group Digital

QUALIFICATIONS

  • Formal qualifications (BSc, MSc, PhD) in computer science, software engineering, or equivalent
  • Minimum 5 years of professional experience as a Data Engineer or Software Engineer
  • Broad knowledge of data processing for large datasets
  • Demonstrable experience working in Agile or DevOps communities of engineering practice
  • Familiarity with cloud computing environments, e.g. Amazon Web Services or Google Cloud Platform
  • Preferred: Experience with build and deploy tools (e.g. Jenkins) and infrastructure management frameworks (e.g. Terraform)