Data Engineer - AWS

, , New Zealand

COMPANY ENVIRONMENT

Adaptiv is the leader in data and integration consulting and development in NZ, delivering innovative solutions to meet our clients’ needs through cloud-based services.  We employ the best of the best in the industry which makes it easy to support our staff in gaining the skills necessary to become integration experts.

No two days are the same, and while we provide complex solutions for some impressive clients, we know when to switch off and have fun. With no office politics, an excellent company culture and a modern rooftop office (BBQ anyone?), this kind of opportunity does not come around often.

POSITION SUMMARY

The AWS Data Engineer position is a critical role as it provides data consulting across the Company’s partner businesses (clients). The position is responsible for assisting with the design, implementation, review, and updates of the Company’s IT solutions.  This is a varied position with exposure to data technologies both on-premises and on AWS.

This position will be required to work on multiple projects at any one time and balance workload accordingly. The role is required to use tools and techniques related to cloud development in a dynamic, constantly changing environment.

This position is highly responsive to the requests of clients with work priorities largely influenced by these stakeholders.

SIGNIFICANT WORKING RELATIONSHIPS

Internal

·         Managing Director

·         Support Team

·         General Manager

·         Executive Management Team

·         Architecture Team

·         Development Team

·         Sales and Marketing Team

·         Human Resources Team

·         Finance Team

·         Infrastructure Team

·         Data Practice Lead

External

·         Clients

·         Suppliers and Vendors

POSITION RESPONSIBILITIES

Data Engineering

Deliver data solution architecture for clients (data lakes, cloud data warehouses, data enhancement via machine learning APIs)

Be part of a team on larger scale deployment and deployments

Lead in the development and implementations of the company’s data engineering solutions on AWS

Undertake hands-on development for client projects

Provide guidance and demonstrate best practices when delivering solutions

Understanding of modern data platforms (cloud or on-premises)

Most of the work will be done using tools of the trade (AWS Glue). Knowledge in both SQL and Python required.

Experience with AWS data analytics services

Data Architecture

Provide consultancy services to our customers

Develop principles and policies for development of a data lake, cloud data warehouse (CDW), machine learning

Continuous Integration and Infrastructure as Code

Experienced in use of industry-leading CI/CD platforms such as Git, Cloud Formation, AWS CDK and IaC

Can design and implement full CI/CD pipelines for a data solution

Integration Testing

Build test driven practices utilising best of breed frameworks for unit and integration testing

Test and UAT environment provisioning for clients

Cloud Integration

Create and design compelling architectural blueprints to deliver value to our customers

Complete independent vendor evaluation

Implement data engineering and machine learning solution on the AWS technology stack

Implementation assistance on current projects

Implement proof of concept prototypes

Training

We will provide access and support to any data engineering training needs on any platforms (GCP, Azure, AWS). You will be able to choose your own path.

Getting certified is highly encouraged

Continuous Improvement

Identify and propose development and architectural improvements to existing systems

Identify and introduce industry best practice standards in all projects, work requests and responsibilities

Seek to educate team members and stakeholders about best practice where appropriate

Work with partner businesses/clients to help drive “thought leadership” on data and cloud architecture

Constantly up skill on latest technologies to remain at the forefront of service delivery

Assist with driving Adaptiv’s thought leadership via social media

Work Planning & Management

Manage daily tasks and projects to ensure work is completed consistent with assigned priorities and deadlines

Assist in evaluating work requests on a technical, architectural and consistency level to provide feedback to stakeholders on viability

Participate in planning meetings as required

Initiate and attend meetings with team and stakeholders to give timely updates on work progress and resolution of issues

Report progress to team and Project Coordinator as appropriate.

Assist the executive team with presales and project establishment

Occupational Health & Safety

Responsible for taking reasonable care to ensure own health and safety at work, and to avoid adversely affecting the safety or health of any other person at work

Ensuring adherence to organisation-wide policies, procedures and monitoring the compliance of all team members

Responsibilities on Demand

Due to the fluid and dynamic environment within the group, new, additional, or amended position responsibilities may be required at any time

Successful demonstration of change orientation is an ongoing responsibility of all positions

KEY RESULT AREAS

Act as a subject matter expert in data engineering and AWS data technologies.

Work with client teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from AWS.

Work with Agile and DevOps techniques and implementation approaches in the delivery.

Showcase your AWS Data engineering experience when communicating with clients on their requirements, turning these into technical data solutions.

Build and deliver Data solutions using AWS products and offerings.

Willingness to learn and upskill yourself on other cloud platform (GCP, Azure). Getting certified is highly encouraged!

Represent the Adaptiv brand on the turf and help us deliver projects on time and on budget

Co-own and build our AWS community, contributing in the knowledge exchange learning programme of the platform either via blog posts, LinkedIn articles, conferences and roadshows

PERSON SPECIFICATION

Qualifications

At least 5 years of professional experience in a consulting environment on a cloud Platform with a focus on AWS.

University degree not necessarily required as we believe more in people than diplomas. Experience matters more.

Ideally you should at least have one valid and active AWS certification

Skills

Hands on and deep experience building Data Analytics solutions on AWS (e.g. Redshift, RDS, Aurora, DynamoDB, Glue, Athena, S3, SNS, SQS, Lambda, QuickSight, Cloud formation, AWS CDK and IaC).

Experience in Spark (Scala/Python/Java) and Kafka.

Experience architecting and building Data Lakes on AWS (S3, Glue)

Experience building data models in a CDW (Redshift) based on Start Schemas, Wide Tables (or OBT).

Experience working with AI/ML as a service

Knowledge in MDM, Metadata Management, Data Quality, Data Lineage tools and more generally in Data Governance.

End to End Data Engineering and Lifecycle (including non-functional requirements and operations) management.

Regulatory and Compliance work in Data Management.

End to End Solution Design skills - Prototyping, Usability testing and data visualization literacy.

Experience with SQL and NoSQL modern data stores.

Knowledge in both SQL and Python

Experience with AWS data analytics services

Experienced in use of industry-leading CI/CD platforms such as Git, Cloud Formation, AWS CDK and IaC

Personal Competencies & Attributes

Excellent communication skills both verbal and written

A strong eye for detail

Self-managing with a h ighly motivated and results driven approach

Sense of urgency, can-do and proactive attitude

Ability to juggle multiple tasks and deadlines

Excellent relationship/interpersonal skills

Ability to think outside the box and demonstrates sound problem-solving mindset

Flexible and adaptable

Complete professionalism

Sense of humour

Our offer

Competitive remuneration package

With us, the focus in HR is more on the Human than the Resources

Casual Friday morning tea and early evening nibbles drinks are on us

You choose your weapon: either a MacBook Pro or a Windows workstation

Your mobile subscription is on us

A central office in the heart of Ponsonby and Grey Lynn

If you’ve got a dog, bring it to the office!

Access to AWS certification trainings and exams

#J-18808-Ljbffr