Senior Associate Engineer - Data

March 25 2024
Industries Consulting services
Categories Oil & Gas, Piping
Remote
Toronto, ON • Full time

ZS is a place where passion changes lives. As a management consulting and technology firm focused on transforming global healthcare and beyond, our most valuable asset is our people. Here you’ll work side-by-side with a powerful collective of thinkers and experts shaping solutions from start to finish. At ZS, we believe that making an impact demands a different approach; and that’s why here your ideas elevate actions, and here you’ll have the freedom to define your own path and pursue cutting-edge work. We partner collaboratively with our clients to develop products that create value and deliver company results across critical areas of their business including portfolio strategy, customer insights, research and development, operational and technology transformation, marketing strategy and many more. If you dare to think differently, join us, and find a path where your passion can change lives.

Our most valuable asset is our people

At ZS we honor the visible and invisible elements of our identities, personal experiences and belief systems—the ones that comprise us as individuals, shape who we are and make us unique. We believe your personal interests, identities, and desire to learn are part of your success here. Learn more about our diversity, equity, and inclusion efforts and the networks ZS supports to assist our ZSers in cultivating community spaces, obtaining the resources they need to thrive, and sharing the messages they are passionate about.

Overview

A Data Engineer is a critical member of this team, specializing in designing, building, and maintaining systems and infrastructure that enable efficient processing, collection, storage, and analysis of large volumes of data. This role collaborates closely with business analysts, data scientists, and other stakeholders to ensure clean, accurate, and readily available data for informed decision-making and operational optimization.

Responsibilities

Data Architecture and Modeling:

  • Design and build robust data models that align with business requirements.
  • Create scalable data architectures that accommodate growth and evolving data needs.

Data Pipeline Development:

  • Develop and maintain data pipelines that facilitate seamless data flow from various sources to data warehouses or storage systems.
  • Optimize ETL (Extract, Transform, Load) processes for efficiency and reliability.

Data Storage Solutions:

  • Implement and manage data storage solutions, including relational databases (e.g., SQL, PostgreSQL) and non-relational databases (e.g., MongoDB, Cassandra).
  • Set up and maintain data lakes for large-scale data storage.

Data Quality and Consistency:

  • Debug code issues / bugs using stack traces, logs, monitoring tools, and other resources.
  • Ensure data consistency and accuracy through validation and cleansing techniques.
  • Collaborate with cross-functional teams to address data-related issues.
  • Design and implement technical features leveraging best practices for technology stack being used.
  • Write production-ready code that is easily testable, understood by other developers and accounts for edge cases and errors.
  • Ensure highest quality of deliverables by following architecture/design guidelines, coding best practices, periodic design/code reviews and performing code/script reviews of senior engineers in the team.
  • Write unit tests as well as higher level tests to handle expected edge cases and errors gracefully, as well as happy paths.

Subject Matter Expertise:

  • Stay updated on industry trends and best practices in data engineering.
  • Provide guidance on data engineering tools, technologies, and methodologies.
  • Implement complex features with limited guidance from the engineering lead. For example: service or application-wide change.
  • Research & evaluate the latest technologies through rapid learning, conducting proof-of-concepts and creating prototype solutions.

Client Project Solutions:

  • Work closely with clients to understand their data engineering requirements.
  • Design and implement best-in-class data engineering solutions tailored to client projects.
  • Break down large features into estimable tasks, leads estimation and can align with clients.

Mentorship and Collaboration:

  • Mentor junior Data Engineers, fostering their growth and skill development.
  • Collaborate with other technical teams to integrate data solutions seamlessly.
  • Participate in scrum calls and agile ceremonies, and effectively communicate work progress, issues and dependencies.
  • Collaborate with client facing teams to understand solution context and contribute in technical requirement gathering and analysis.
  • Work with technical architects on the team to validate design and implementation approach.

Education / Skills / Experience

Education: A relevant bachelors or higher-education degree in Computer Science, Data Science, or related fields.

Technical Skills:

  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
  • Familiarity with cloud-based systems (e.g., AWS, Azure).
  • Knowledge of data integration and ETL tools (e.g., Talend, Informatica, Apache NiFi).
  • Good Expertise on Data Ingestion, Data Storage, Orchestration, Data Fabric, Error logging and Auditing, Job Monitoring, data management on Cloud preferably Azure or AWS.
  • Good knowledge of Azure Databricks and/or AWS EMR
  • Good understanding of Data warehousing concepts and best practices
  • Strong in at least one of the Programming languages - Python or Java, Scala, etc. and Programming basics - Data Structures.
  • Good to have
    • Azure Certification on Data Engineering
    • AWS certification on Data Engineering
    • Knowledge of data modeling
  • Travel to other global offices as needed to work with client or other internal project teams.
  • Ability to travel to other offices or client locations as needed.
  • Strong communication skills

Experience:

  • 3 to 5 years of experience in Data Engineering role.
  • Minimum 5+ relevant industry experience with Big data - Hive, Spark, Hadoop, queueing system like Apache Kafka/Rabbit MQ/AWS Kinesis
  • Hands on experience in building metadata driven, reusable design patterns for data pipeline, orchestration, ingestion patterns (batch, real time);
  • Experience in designing and implementation of solution on distributed computing and cloud services platform (but not limited to) - AWS, Azure, GCP;
  • Hands on experience building CI/CD pipelines and awareness of practices for application monitoring.



Perks & Benefits:

ZS offers a comprehensive total rewards package including health and well-being, financial planning, annual leave, personal growth and professional development. Our robust skills development programs, multiple career progression options and internal mobility paths and collaborative culture empowers you to thrive as an individual and global team member.

We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.

Considering applying?

At ZS, we're building a diverse and inclusive company where people bring their passions to inspire life-changing impact in global healthcare and beyond. We are most interested in finding the best candidate for the job and recognize the value that candidates with all backgrounds, including non-traditional ones, bring. If you are interested in joining us, we encourage you to apply even if you don't meet 100% of the requirements listed above.

ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.

To Complete Your Application:

Candidates must possess work authorization for their intended country of employment. An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.

NO AGENCY CALLS, PLEASE.

Find Out More At:

www.zs.com

Apply now!

Similar offers

Searching...
No similar offer found.
An error has occured, try again later.

Jobs.ca network