Data Engineer

Tags: Environment
  • Added Date: Tuesday, 19 November 2024
  • Deadline Date: Monday, 12 May 2025
5 Steps to get a job in the United Nations

The International Rescue Committee (IRC) responds to the world's worst humanitarian crises, helping to restore health, safety, education, economic wellbeing, and power to people devastated by conflict and disaster. Founded in 1933 at the call of Albert Einstein, the IRC is one of the world's largest international humanitarian non-governmental organizations (INGO), at work in more than 40 countries and 29 U.S. cities helping people to survive, reclaim control of their future and strengthen their communities. A force for humanity, IRC employees deliver lasting impact by restoring safety, dignity and hope to millions. If you're a solutions-driven, passionate change-maker, come join us in positively impacting the lives of millions of people world-wide for a better future.

Background/IRC Summary:

Technology and Operations supports the organizationโ€™s work by providing reliable and scalable solutions for the IRCโ€™s offices around the world. The Data Team at IRC is responsible for the design and delivery of global data strategy and the systems and products that deliver on it.

Job Summary:

The Data Engineer will play a pivotal role in the development, maintenance, and optimization of our data infrastructure, focusing on data integration, ETL/ELT processes, and management of Data Warehouses, and Lakehouse.

The successful candidate will be responsible for building and maintaining data pipelines using Databricks, Synapse, and Fabric environments, using tools like DBT and Databricks pipelines. Key responsibilities include ensuring system readiness in terms of security, performance, and health, completing data loads, and implementing data modeling to support various business domains. This hands-on role demands strong technical expertise alongside excellent communication and collaboration skills.

Major Responsibilities:

1. Develop Python, SQL, and PySpark-based applications and data flows within Databricks.

2. Build and maintain data pipelines using DBT and Databricks, ensuring efficient and scalable data processes.

3. Design and implement real-time and batch data processing systems to support analytics, reporting, and business needs.

4. Monitor and analyze data pipelines for performance, reliability, cost, and efficiency.

5. Proactively address any issues or bottlenecks to ensure smooth operations.

6. Discover opportunities for process improvements, including redesigning pipelines and optimizing data delivery mechanisms.

7. Manage and maintain Azure cloud services and monitor alerts to ensure system availability and performance.

Minimum Requirements:

โ€ข Demonstrated ability writing SQL scripts (required).

โ€ข Some experience with Python (strong plus).

โ€ข Exposure to Databricks is a significant advantage.

โ€ข Experience working in a cloud environment (strong plus).

โ€ข Experience with DBT Core or DBT Cloud is a major plus.

๐Ÿ“š ๐——๐—ถ๐˜€๐—ฐ๐—ผ๐˜ƒ๐—ฒ๐—ฟ ๐—›๐—ผ๐˜„ ๐˜๐—ผ ๐—š๐—ฒ๐˜ ๐—ฎ ๐—๐—ผ๐—ฏ ๐—ถ๐—ป ๐˜๐—ต๐—ฒ ๐—จ๐—ก ๐—ถ๐—ป ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฏ! ๐ŸŒ๐Ÿค ๐—ฅ๐—ฒ๐—ฎ๐—ฑ ๐—ผ๐˜‚๐—ฟ ๐—ก๐—˜๐—ช ๐—ฅ๐—ฒ๐—ฐ๐—ฟ๐˜‚๐—ถ๐˜๐—บ๐—ฒ๐—ป๐˜ ๐—š๐˜‚๐—ถ๐—ฑ๐—ฒ ๐˜๐—ผ ๐˜๐—ต๐—ฒ ๐—จ๐—ก ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฏ ๐˜„๐—ถ๐˜๐—ต ๐˜๐—ฒ๐˜€๐˜ ๐˜€๐—ฎ๐—บ๐—ฝ๐—น๐—ฒ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—จ๐—ก๐—›๐—–๐—ฅ, ๐—ช๐—™๐—ฃ, ๐—จ๐—ก๐—œ๐—–๐—˜๐—™, ๐—จ๐—ก๐——๐—ฆ๐—ฆ, ๐—จ๐—ก๐—™๐—ฃ๐—”, ๐—œ๐—ข๐—  ๐—ฎ๐—ป๐—ฑ ๐—ผ๐˜๐—ต๐—ฒ๐—ฟ๐˜€! ๐ŸŒ

โš ๏ธ ๐‚๐ก๐š๐ง๐ ๐ž ๐˜๐จ๐ฎ๐ซ ๐‹๐ข๐Ÿ๐ž ๐๐จ๐ฐ: ๐๐จ๐ฐ๐ž๐ซ๐Ÿ๐ฎ๐ฅ ๐“๐ž๐œ๐ก๐ง๐ข๐ช๐ฎ๐ž๐ฌ ๐ก๐จ๐ฐ ๐ญ๐จ ๐ ๐ž๐ญ ๐š ๐ฃ๐จ๐› ๐ข๐ง ๐ญ๐ก๐ž ๐”๐ง๐ข๐ญ๐ž๐ ๐๐š๐ญ๐ข๐จ๐ง๐ฌ ๐๐Ž๐–!

โ€ข Ability to quickly learn and absorb existing and new data structures.

โ€ข Excellent interpersonal and communication skills (both written and verbal).

โ€ข Ability to work independently and collaboratively within a team.

Preferred Additional Requirements

โ€ข Experience with cloud platforms (Azure preferred).

โ€ข Databricks Data Engineer Certification or similar.

โ€ข Software development

Key Working Relationships:

โ€ข Data Team

โ€ข Enterprise systems owners and technical and analytics teams under their leadership

Position Reports to: Data Architect

Position Supervises: None

Travel Requirements:

โ€ข Special projects may require travel to facilitate hands-on learning that will contribute to our data strategy efforts.

Working Environment:

โ€ข Remote. Location is flexible but must be within an approved IRC country of operation.

Compensation:

Posted pay ranges apply to UK-based candidates. Ranges are based on various factors including the labor market, job type, internal equity, and budget. Exact offers are calibrated by work location, individual candidate experience and skills relative to the defined job requirements.

Standard of Professional Conduct: The IRC and the IRC workers must adhere to the values and principles outlined in the IRC Way โ€“ our Code of Conduct. These are Integrity, Service, Accountability, and Equality.

Commitment to Gender, Equality, Diversity, and Inclusion: The IRC is committed to creating a diverse, inclusive, respectful, and safe work environment where all persons are treated fairly, with dignity and respect. The IRC expressly prohibits and will not tolerate discrimination, harassment, retaliation, or bullying of the IRC persons in any work setting. We aim to increase the representation of women, people that are from country and communities we serve, and people who identify as races and ethnicities that are under-represented in global power structures.

Recommended for you