Menu

Data Engineer

Big Data JobsData Engineer

London

Competitive salary

Permanent, Full time

Shortlist + Un-shortlist −

Job description

We are looking for a Data Engineer to establish our internal data engineering capability and play a key role in designing and developing the data infrastructure and systems, ensuring that our data pipelines are reliable, scalable, and efficient.

Reporting into the Head of Data Strategy and Services, you will be responsible for designing data infrastructure to support modelling and data analytics, with strong competence in Python, and work with stakeholders to understand their data needs and help design data solutions.

The Technology team within Prevail underpins all of our mission focused teams. No two days are the same and the real world problems we seek to solve are complicated. You will get the opportunity to interact with a wide range of datasets and support both the wider tech team and mission teams turning this data into insights to drive our customers decision making. The team structure is flat with a network centric approach to leadership. A small team, we rely on strong communication and the ability to mutually support each other whilst working at pace.

Responsibilities:

These are the key things that you are responsible for delivering within your role. There will be activities and tasks in addition to this list that are expected from you but the majority of your time will be:

  • Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.
  • Identifying improvements to our current data processes and implementing solutions.
  • Implementing data flows to connect operational systems, data for analytics, and business intelligence systems
  • Creation and development of data pipelines
  • Documenting source-to-target mappings
  • Re-engineering manual data flows to enable scaling and repeatable use
  • Support the build of data streaming systems
  • Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use
  • Develop business intelligence reports that can be used for multiple audiences
  • Build accessible data for analysis
  • Automate data processing tasks and workflows
  • Collaborate with cross functional teams to advocate for high-quality data solutions

Requirements

You:

You will have previous proven experience:

  • Building, modelling, and maintaining data pipelines
  • Using a range of Amazon Web Service products and technologies such as EC2, S3, Athena, Glue, and Redshift
  • Designing data infrastructure to support modelling and data analytics
  • As an AWS Solutions Architect or Lead, or a similar role
  • Strong Python experience or experience with other modern complied languages e.g. Go or Rust
  • Data warehousing - building operation ETL data pipelines across several sources, and constructing relation and dimensional data models
  • If you have previous exposure to geospatial data, that would be advantageous but is not a requirement for the position.
  • Excellent communication and collaboration skills

Us:

Prevail Partners delivers strategic advice, intelligence, specialist capabilities and managed services to clients ranging from governments and multinational corporations to non-governmental organisations. These services are delivered predominantly across Europe, the Middle East and Africa.

Benefits

Competitive salary, salary sacrifice pension, access to onsite gym facilities, enhanced leave polices, and private healthcare after two years at Prevail.

Application url

This job is located on a third party website

Opens in new window - Please mention as the source of data when applying for this job